-- Logs begin at Mon 2022-05-09 19:37:08 UTC, end at Mon 2022-05-09 20:53:54 UTC. -- May 09 20:09:52.847237 dv-cinder-836996-15-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 09 20:09:52.858138 dv-cinder-836996-15-iscsi devstack@keystone.service[79817]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 09 20:09:52.860258 dv-cinder-836996-15-iscsi devstack@keystone.service[79817]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 9 20:09:52 2022] *** May 09 20:09:52.860258 dv-cinder-836996-15-iscsi devstack@keystone.service[79817]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 09 20:09:52.860258 dv-cinder-836996-15-iscsi devstack@keystone.service[79817]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 09 20:09:52.860258 dv-cinder-836996-15-iscsi devstack@keystone.service[79817]: nodename: dv-cinder-836996-15-iscsi May 09 20:09:52.860258 dv-cinder-836996-15-iscsi devstack@keystone.service[79817]: machine: x86_64 May 09 20:09:52.860258 dv-cinder-836996-15-iscsi devstack@keystone.service[79817]: clock source: unix May 09 20:09:52.860258 dv-cinder-836996-15-iscsi devstack@keystone.service[79817]: pcre jit disabled May 09 20:09:52.860258 dv-cinder-836996-15-iscsi devstack@keystone.service[79817]: detected number of CPU cores: 4 May 09 20:09:52.860258 dv-cinder-836996-15-iscsi devstack@keystone.service[79817]: current working directory: / May 09 20:09:52.860258 dv-cinder-836996-15-iscsi devstack@keystone.service[79817]: detected binary path: /usr/bin/uwsgi-core May 09 20:09:52.860258 dv-cinder-836996-15-iscsi devstack@keystone.service[79817]: your processes number limit is 47680 May 09 20:09:52.860839 dv-cinder-836996-15-iscsi devstack@keystone.service[79817]: your memory page size is 4096 bytes May 09 20:09:52.860839 dv-cinder-836996-15-iscsi devstack@keystone.service[79817]: detected max file descriptor number: 2048 May 09 20:09:52.860839 dv-cinder-836996-15-iscsi devstack@keystone.service[79817]: lock engine: pthread robust mutexes May 09 20:09:52.860839 dv-cinder-836996-15-iscsi devstack@keystone.service[79817]: thunder lock: enabled May 09 20:09:52.860839 dv-cinder-836996-15-iscsi devstack@keystone.service[79817]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 09 20:09:52.860839 dv-cinder-836996-15-iscsi devstack@keystone.service[79817]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 09 20:09:52.906837 dv-cinder-836996-15-iscsi devstack@keystone.service[79817]: Python main interpreter initialized at 0x55e8aa6399c0 May 09 20:09:52.906837 dv-cinder-836996-15-iscsi devstack@keystone.service[79817]: python threads support enabled May 09 20:09:52.906837 dv-cinder-836996-15-iscsi devstack@keystone.service[79817]: your server socket listen backlog is limited to 100 connections May 09 20:09:52.906837 dv-cinder-836996-15-iscsi devstack@keystone.service[79817]: your mercy for graceful operations on workers is 90 seconds May 09 20:09:52.907249 dv-cinder-836996-15-iscsi devstack@keystone.service[79817]: mapped 403077 bytes (393 KB) for 2 cores May 09 20:09:52.907314 dv-cinder-836996-15-iscsi devstack@keystone.service[79817]: *** Operational MODE: preforking *** May 09 20:09:52.907611 dv-cinder-836996-15-iscsi devstack@keystone.service[79817]: *** uWSGI is running in multiple interpreter mode *** May 09 20:09:52.907611 dv-cinder-836996-15-iscsi devstack@keystone.service[79817]: spawned uWSGI master process (pid: 79817) May 09 20:09:52.907824 dv-cinder-836996-15-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 09 20:09:52.908404 dv-cinder-836996-15-iscsi devstack@keystone.service[79817]: spawned uWSGI worker 1 (pid: 79828, cores: 1) May 09 20:09:52.909232 dv-cinder-836996-15-iscsi devstack@keystone.service[79817]: spawned uWSGI worker 2 (pid: 79829, cores: 1) May 09 20:09:52.909232 dv-cinder-836996-15-iscsi devstack@keystone.service[79817]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 09 20:09:58.655653 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 09 20:09:58.655653 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: from cryptography.utils import int_from_bytes May 09 20:09:58.656395 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 09 20:09:58.656395 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: from cryptography.utils import int_from_bytes May 09 20:09:58.656967 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 09 20:09:58.656967 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: from cryptography.utils import int_from_bytes May 09 20:09:58.657546 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 09 20:09:58.657546 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: from cryptography.utils import int_from_bytes May 09 20:09:58.706090 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 09 20:09:58.706239 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 09 20:09:58.706319 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 09 20:09:58.706393 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 09 20:09:58.706461 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] command line args: [] {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 09 20:09:58.706525 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] command line args: [] {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 09 20:09:58.706772 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 09 20:09:58.706864 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 09 20:09:58.706930 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] ================================================================================ {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 09 20:09:58.706988 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] ================================================================================ {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 09 20:09:58.707143 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] admin_token = **** {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.707222 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] admin_token = **** {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.707367 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] config_dir = [] {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.707553 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] config_dir = [] {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.707667 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.707754 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.707827 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] config_source = [] {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.707891 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] config_source = [] {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.707953 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] debug = True {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.708012 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] debug = True {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.708068 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.710473 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.710576 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.710646 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.710704 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.710761 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.710825 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.710889 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.710952 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.711014 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.711077 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] list_limit = None {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.711141 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] list_limit = None {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.711199 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] log_config_append = None {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.711260 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] log_config_append = None {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.711316 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.711371 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.711452 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] log_dir = None {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.711526 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] log_dir = None {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.711591 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] log_file = None {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.711648 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] log_file = None {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.711709 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.711772 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.711834 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.711900 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.711958 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.712018 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.712081 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.712145 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.712208 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.712277 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.712343 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.712401 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.712457 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.712514 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.712514 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.712514 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.712514 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.712514 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.712767 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.712767 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.713029 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.713303 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.713610 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.713758 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.44/identity {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.713970 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.714083 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] publish_errors = False {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.714155 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.714221 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.714425 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.714531 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.714602 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.714666 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.714855 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.714958 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.715020 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.715189 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.715294 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] standard_threads = False {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.715478 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.715585 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.715763 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.715860 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.715983 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.44/identity {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.716055 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] use_journal = False {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.716119 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] publish_errors = False {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.716177 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] use_json = False {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.716386 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] use_stderr = False {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.716487 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.716550 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] use_syslog = False {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.716607 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.716784 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.716880 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.716965 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.717033 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.717241 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.717338 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.717398 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] standard_threads = False {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.717454 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.717645 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.717741 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.717897 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.717979 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.718037 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.718094 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.718284 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] use_journal = False {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.718485 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.718676 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] use_json = False {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.718676 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] use_stderr = False {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.718958 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.719140 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] use_syslog = False {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.719361 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.719564 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 20:09:58.719746 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.719858 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.720096 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.720180 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.720442 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.720517 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.720575 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.720632 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.720688 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.720756 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.720815 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.720872 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.720929 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.720985 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.721048 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.721114 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.721184 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.721248 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.721306 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.721363 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.721418 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.721485 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.721548 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.721837 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.721970 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.722094 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.722219 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.722353 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.722485 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.722617 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.722751 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.722878 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.723634 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.723803 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.723933 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.724058 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.724193 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.724319 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.724319 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.724561 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.724694 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.724825 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.724956 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.725128 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.725128 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.725381 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.725513 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.725639 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.725769 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.725904 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.726029 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.726231 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.726359 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.726485 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.726485 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.726718 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.726842 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.726974 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.726974 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.727216 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.727340 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.727494 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.727629 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.727777 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.727909 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.728035 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.728158 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.728282 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.728405 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.728538 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.728663 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.728787 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.728929 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.729093 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.729236 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.729362 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.729605 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.729734 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.729859 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.729983 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.730124 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.730257 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.730417 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.730623 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.730812 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.730995 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.731186 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.731186 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.731186 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.731186 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.731186 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.731186 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.732353 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.732577 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.732836 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.733040 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.733232 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.733416 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.733633 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.733831 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.734020 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.734204 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.734394 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.734624 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.734825 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.734989 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.735148 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.735303 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.735449 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.735610 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.735747 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.735924 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.736056 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.736189 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.736316 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.736442 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.736607 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.736739 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.736880 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.737042 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.737172 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.737298 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.737422 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.737555 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.737687 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.737820 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.737983 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.738121 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.738247 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.738379 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.738516 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.739319 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.739510 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.739649 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.739782 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.739910 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.740048 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.740175 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.740307 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.740434 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.740594 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.740758 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.740901 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.741040 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.741167 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.741292 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.741417 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.741542 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.741737 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.741866 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.741990 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.742116 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.742242 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.742366 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.742499 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.742626 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.742751 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.742886 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.743011 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.743137 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.743284 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.743429 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.743562 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.743687 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.743811 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.743936 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.744072 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.744200 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.744326 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.744451 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.744574 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.744717 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.744852 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.744990 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.745117 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.745243 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.745370 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.745495 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.745620 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.745753 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.745880 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.745880 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.746114 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.746240 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.746381 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.746516 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.746643 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] auth.external = None {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.746773 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.746899 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.747024 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.747148 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.747287 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.747461 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.747595 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.747721 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] auth.password = None {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.747845 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.747971 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] auth.token = None {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.748107 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.748243 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.748369 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.748495 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.748619 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.748784 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.748919 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.749074 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.749212 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.749340 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.749468 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.749600 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.749739 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.749868 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.750002 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.750140 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] credential.caching = True {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.750267 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] auth.external = None {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.750393 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.750518 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.750643 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.750643 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.750890 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.751018 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.751150 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.751150 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] auth.password = None {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.751413 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.751549 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] auth.token = None {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.751676 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.751814 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.751941 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.752066 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.752207 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.752341 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.752468 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.752603 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.752731 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.752857 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.752991 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.753125 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.753262 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.753389 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.753514 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.753650 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] credential.caching = True {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.753787 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.753922 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.754055 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.754222 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.754359 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] federation.caching = True {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.754485 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.754619 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.754748 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.754873 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.755005 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.755132 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.755553 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.755700 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.755830 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.755956 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.756083 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.756208 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.756334 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.756469 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.756603 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.756730 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.756857 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.756983 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.757116 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.757318 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.757448 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.757585 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.757711 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.757845 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] identity.caching = True {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.757973 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.758108 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.758236 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] federation.caching = True {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.758362 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.758487 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.758612 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.758738 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.758873 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.759001 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.759128 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.759263 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.759389 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.759541 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.759679 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.759807 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.759934 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.760060 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.760185 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.760311 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.760445 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.760584 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.760713 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.760838 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.760964 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.761100 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.761235 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.761364 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] identity.caching = True {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.761490 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.761622 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.761749 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.761874 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.762009 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.762138 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.762265 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.762391 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.762517 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.762651 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.762792 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.762925 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.763052 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.763195 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.763324 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.763506 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.763638 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.763638 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.763873 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.763999 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.764124 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.764258 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.764385 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.764385 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.764632 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.764758 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.764890 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.764890 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.765137 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.765264 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.765390 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.765516 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.765642 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.765780 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.765907 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.766040 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.766166 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.766302 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.766428 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.766562 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.766689 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.766834 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.766964 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.767089 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.767215 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.767350 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.767499 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.767627 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.767753 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.767879 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.768004 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.768150 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.768278 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.768405 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.768531 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.768657 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.768782 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.768916 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.769049 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.769184 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.769323 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.769458 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.769590 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.769731 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.769971 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.770196 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.770444 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.770594 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.770729 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.770871 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.771005 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.771138 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.771270 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.771454 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] ldap.user = None {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.771596 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.771741 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.771875 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.772050 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.772194 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.772327 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.772459 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.772601 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.772735 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.772867 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.772999 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.773131 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.773263 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.773414 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.773550 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.773682 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.773814 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.773946 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.774091 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.774232 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.774367 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.774500 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.774633 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.774765 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.774897 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.775039 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.775172 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.775304 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.775453 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] ldap.user = None {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.775592 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.775727 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.775871 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.776016 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.776149 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.776282 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.776415 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.776555 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.776690 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.776823 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.776956 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.776956 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.777206 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.777351 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.777487 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.777619 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.777762 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.777903 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.778036 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.778036 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.778298 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.778430 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.778562 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.778694 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.778828 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.778969 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.779103 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.779234 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.779366 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.779366 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.779659 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.779802 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.779937 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.780070 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.780219 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.780352 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.780501 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.780647 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.780781 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.780913 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.781046 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.781178 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.781309 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.781459 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] resource.caching = True {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.781593 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.781724 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.781856 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.781988 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.782119 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.782259 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.782392 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.782524 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.782656 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.782787 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.782787 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.783112 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.783112 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.783386 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.783561 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.783697 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.783829 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.783970 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.784105 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.784238 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] role.caching = True {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.784370 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.784502 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] role.driver = sql {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.784502 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.784760 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.784760 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.785012 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.785144 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.785286 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.785420 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.786110 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.786452 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] resource.caching = True {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.786594 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.786728 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.786862 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.786995 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.787137 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.787272 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.787424 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.787565 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.787698 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.787842 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.787986 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.788120 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.788253 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.788386 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.788518 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.788651 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.788792 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.788926 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.789058 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.789191 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] role.caching = True {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.789324 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.789457 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] role.driver = sql {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.789457 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.789726 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.789859 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.789992 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.790125 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.790266 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.790266 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.790524 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.790663 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.790796 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.790929 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.791069 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.791204 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.791337 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.791541 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.791677 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.791810 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.791953 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.792088 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.792220 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.792352 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.792352 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.792602 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.792743 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.792877 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.793010 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.793142 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.793283 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.793416 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.793557 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.793557 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.793808 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.793947 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.794085 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.794218 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] token.caching = True {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.794359 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.794493 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.794627 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.794760 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.794893 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.795025 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.795176 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.795311 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.795462 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.795602 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.795736 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.795869 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.796013 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.796148 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.796280 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.796419 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.796551 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.796685 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.796826 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.796970 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.797104 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.797237 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.797369 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.797501 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.797642 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.797777 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.797909 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.798041 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.798173 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.798314 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.798448 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.798580 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.798712 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.798857 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.798990 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] token.caching = True {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.798990 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.799253 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] database.connection = **** {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.799408 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.799562 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.799697 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.799831 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.799963 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.800096 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.800237 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.800371 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.800503 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.800635 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.800787 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.800921 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.801198 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.801924 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.802070 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.802204 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.802338 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.802472 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.802614 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.802749 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.802882 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.803016 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.803149 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.803294 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.803506 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.803649 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.803783 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.803916 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.804060 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.804198 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.804340 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.804475 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.804475 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.804725 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] database.connection = **** {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.804866 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.805009 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.805144 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 09 20:09:58.805296 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.805296 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.805296 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.805296 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.805296 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.805296 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.805296 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.805296 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.805296 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.806451 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.806451 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.806451 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.806451 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.806451 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.806451 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.806451 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.806451 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 20:09:58.806451 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 09 20:09:58.822757 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 20:09:58.822983 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 20:09:58.823198 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 20:09:58.825568 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 20:09:58.825804 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 20:09:58.826030 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 20:09:58.831992 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 20:09:58.835291 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 20:09:58.861687 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 20:09:58.861919 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 20:09:58.862132 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 20:09:58.862364 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 20:09:58.916339 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 20:09:58.916729 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 20:09:58.967988 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 20:09:58.968253 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 20:09:58.968421 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 20:09:58.968577 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 20:09:59.035729 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 20:09:59.036116 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 20:09:59.036270 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 20:09:59.036442 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 20:09:59.036587 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 20:09:59.036728 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 20:09:59.036728 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 20:09:59.036993 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 20:09:59.037140 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 20:09:59.037279 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 20:09:59.037279 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 20:09:59.037279 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 20:09:59.061766 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 20:09:59.062092 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 20:09:59.062255 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 20:09:59.062411 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 20:09:59.062561 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 20:09:59.062708 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 20:09:59.062853 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 20:09:59.063009 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 20:09:59.063166 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 20:09:59.063308 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 20:09:59.063528 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 20:09:59.063678 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 20:09:59.063838 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 20:09:59.063838 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 20:09:59.074664 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 20:09:59.074848 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 20:09:59.089998 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 20:09:59.090262 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 20:09:59.090413 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 20:09:59.090566 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 20:09:59.090703 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 20:09:59.090839 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 20:09:59.090974 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 20:09:59.091120 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 20:09:59.091257 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 20:09:59.091419 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 20:09:59.091567 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 20:09:59.091702 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 20:09:59.091850 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 20:09:59.091998 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 20:09:59.109006 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.109222 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.109365 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 09 20:09:59.109516 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 09 20:09:59.109655 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.109789 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.109924 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 09 20:09:59.110057 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 09 20:09:59.110193 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.110337 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.110473 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.110620 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.110756 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.110899 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.111044 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.111180 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.122470 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.122744 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.123009 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.123287 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.126734 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.127012 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.127275 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.127579 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.132465 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79829) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 20:09:59.135784 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79829) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 20:09:59.136057 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.136336 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.136723 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.136864 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79828) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 20:09:59.137014 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.137255 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.137527 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.137806 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.138076 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.138346 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.138612 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.140031 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79828) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 20:09:59.140304 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.140581 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.140968 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.141249 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.141508 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.141776 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.142047 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.142315 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.142580 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.142841 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.165521 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.167164 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79829) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 20:09:59.167465 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.169414 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.171024 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79828) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 20:09:59.171298 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.172829 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79829) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 20:09:59.173105 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.173382 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.177253 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79828) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 20:09:59.177522 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.177796 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.181361 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79829) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 20:09:59.181646 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.185084 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79828) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 20:09:59.185360 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.186306 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79829) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 20:09:59.186588 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.186867 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.187145 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.187429 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.187707 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.187979 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.188244 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.189998 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79828) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 20:09:59.190279 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.190556 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.190833 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.191104 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.191374 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.191661 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.192581 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.207620 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.207905 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.211558 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.211831 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.212666 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79829) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 20:09:59.216356 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79828) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 20:09:59.216475 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.216704 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.219993 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.220285 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.221633 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79829) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 20:09:59.225828 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79828) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 20:09:59.226009 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79829) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 20:09:59.229430 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79828) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 20:09:59.229755 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.230050 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.230335 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.230609 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.230881 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.231151 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.233169 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.233465 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.233746 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.234026 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.234296 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.234566 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.250948 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79829) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 20:09:59.251323 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.251614 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.251879 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.254184 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79828) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 20:09:59.254664 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.254932 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.255531 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.260145 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.261858 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.262141 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.264427 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.266075 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.266228 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79829) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 20:09:59.266389 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.266532 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.266772 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.267056 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.267335 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.269437 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79828) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 20:09:59.269716 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.270039 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.270320 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.270674 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.280923 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79829) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 20:09:59.281202 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.281497 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.281777 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.282053 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.282331 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.282603 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.284268 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79828) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 20:09:59.284542 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.284824 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.285109 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.285383 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.286211 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.286562 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.302168 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79829) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 20:09:59.305277 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79828) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 20:09:59.305468 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79829) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 20:09:59.308556 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79828) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 20:09:59.308831 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.310450 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.311899 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.312081 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79829) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 20:09:59.312354 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.312647 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.313496 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.315125 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79828) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 20:09:59.315412 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.315706 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.320277 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.321879 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79829) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 20:09:59.323128 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.324759 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79828) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 20:09:59.325133 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.325420 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.325701 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.325975 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.327981 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.328267 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.328544 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.328817 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.335516 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79829) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 20:09:59.335815 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.336095 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.338072 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79828) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 20:09:59.338362 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.338637 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.344129 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79829) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 20:09:59.344364 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.344642 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.344914 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.345184 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.345465 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.345735 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.346016 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.346282 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.346543 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79828) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 20:09:59.346689 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.346828 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.346972 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.347120 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.347260 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.347449 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.347682 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.347825 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.348500 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.348500 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.348954 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.348954 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.349235 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.349439 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.349703 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.349972 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.350232 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.350485 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 20:09:59.387971 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55e8aa6399c0 pid: 79829 (default app) May 09 20:09:59.391423 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff767a04-3255-45b6-b332-5dbf9147945c None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:09:59.391704 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff767a04-3255-45b6-b332-5dbf9147945c None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:09:59.391982 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff767a04-3255-45b6-b332-5dbf9147945c None None] PATH_INFO: `/v3` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:09:59.393076 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55e8aa6399c0 pid: 79828 (default app) May 09 20:09:59.396443 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1/1] 10.222.0.44 () {50 vars in 791 bytes} [Mon May 9 20:09:59 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:07.365779 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18893c7-1070-43bc-a5e2-af3faa0e2977 None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:07.366353 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18893c7-1070-43bc-a5e2-af3faa0e2977 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:07.366353 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18893c7-1070-43bc-a5e2-af3faa0e2977 None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:07.370676 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1/2] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:10:07 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:10:07.375859 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6aed60-f9d7-46ef-9a80-6285826802b7 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:07.376254 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6aed60-f9d7-46ef-9a80-6285826802b7 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:07.376410 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6aed60-f9d7-46ef-9a80-6285826802b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:07.407321 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG oslo_db.sqlalchemy.engines [None req-3c6aed60-f9d7-46ef-9a80-6285826802b7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79829) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 20:10:07.589483 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG passlib.handlers.bcrypt [None req-3c6aed60-f9d7-46ef-9a80-6285826802b7 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=79829) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 09 20:10:07.589899 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG passlib.handlers.bcrypt [None req-3c6aed60-f9d7-46ef-9a80-6285826802b7 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79829) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 09 20:10:07.646822 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-3c6aed60-f9d7-46ef-9a80-6285826802b7 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:10:07.648387 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-3c6aed60-f9d7-46ef-9a80-6285826802b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:10:07.768695 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 2/3] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:10:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 09 20:10:07.803449 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18893c7-1070-43bc-a5e2-af3faa0e2977 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:07.837424 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG oslo_db.sqlalchemy.engines [None req-a18893c7-1070-43bc-a5e2-af3faa0e2977 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79828) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 20:10:07.962209 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18893c7-1070-43bc-a5e2-af3faa0e2977 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:07.966484 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7999bbb5-5b4f-4f8a-a7f2-1c0f1877af01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:07.967138 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999bbb5-5b4f-4f8a-a7f2-1c0f1877af01 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:07.967441 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999bbb5-5b4f-4f8a-a7f2-1c0f1877af01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:07.967719 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999bbb5-5b4f-4f8a-a7f2-1c0f1877af01 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:07.976599 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7999bbb5-5b4f-4f8a-a7f2-1c0f1877af01 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:08.028397 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: WARNING keystone.common.rbac_enforcer.enforcer [None req-7999bbb5-5b4f-4f8a-a7f2-1c0f1877af01 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 09 20:10:08.028735 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7999bbb5-5b4f-4f8a-a7f2-1c0f1877af01 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:08.039295 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 2/4] 10.222.0.44 () {58 vars in 1324 bytes} [Mon May 9 20:10:07 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 09 20:10:08.045119 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6aed60-f9d7-46ef-9a80-6285826802b7 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:08.059238 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6aed60-f9d7-46ef-9a80-6285826802b7 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:08.063629 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea793f0-756f-44bb-b175-d56fbf1e32b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:08.064736 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea793f0-756f-44bb-b175-d56fbf1e32b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:08.065021 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea793f0-756f-44bb-b175-d56fbf1e32b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:08.065296 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea793f0-756f-44bb-b175-d56fbf1e32b6 admin admin] PATH_INFO: `/v3/projects/fc21a92582474562a4faafd37e72b6be` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:08.066840 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea793f0-756f-44bb-b175-d56fbf1e32b6 admin admin] RBAC: Authorizing `identity:get_project(project_id=fc21a92582474562a4faafd37e72b6be)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:08.117396 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9ea793f0-756f-44bb-b175-d56fbf1e32b6 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 09 20:10:08.117727 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea793f0-756f-44bb-b175-d56fbf1e32b6 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:08.122319 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 3/5] 10.222.0.44 () {56 vars in 1207 bytes} [Mon May 9 20:10:08 2022] GET /identity/v3/projects/fc21a92582474562a4faafd37e72b6be => generated 344 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:10.321452 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac9d9b5-5af5-4cb0-ba6a-3a4e6ff09937 None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:10.322002 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac9d9b5-5af5-4cb0-ba6a-3a4e6ff09937 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:10.322002 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac9d9b5-5af5-4cb0-ba6a-3a4e6ff09937 None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:10.326141 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 3/6] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:10:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:10:10.331471 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5005a0-7863-4f34-8113-580bed3ffadf None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:10.331895 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5005a0-7863-4f34-8113-580bed3ffadf None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:10.332023 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5005a0-7863-4f34-8113-580bed3ffadf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:10.351502 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-8b5005a0-7863-4f34-8113-580bed3ffadf None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:10:10.352989 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-8b5005a0-7863-4f34-8113-580bed3ffadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:10:10.360635 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 4/7] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:10:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 09 20:10:10.383707 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac9d9b5-5af5-4cb0-ba6a-3a4e6ff09937 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:10.395572 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac9d9b5-5af5-4cb0-ba6a-3a4e6ff09937 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:10.399733 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d37c674-d8ed-44fb-95e7-5ee06d65b74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:10.400358 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d37c674-d8ed-44fb-95e7-5ee06d65b74f admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:10.400637 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d37c674-d8ed-44fb-95e7-5ee06d65b74f admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:10.400908 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d37c674-d8ed-44fb-95e7-5ee06d65b74f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:10.408276 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d37c674-d8ed-44fb-95e7-5ee06d65b74f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:10.410035 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d37c674-d8ed-44fb-95e7-5ee06d65b74f admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:10.418521 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 4/8] 10.222.0.44 () {58 vars in 1324 bytes} [Mon May 9 20:10:10 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 09 20:10:10.424603 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5005a0-7863-4f34-8113-580bed3ffadf None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:10.433969 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5005a0-7863-4f34-8113-580bed3ffadf None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:10.438348 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3bea36-84cb-40ca-b63b-c14e24a39d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:10.439205 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3bea36-84cb-40ca-b63b-c14e24a39d70 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:10.439524 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3bea36-84cb-40ca-b63b-c14e24a39d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:10.439802 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3bea36-84cb-40ca-b63b-c14e24a39d70 admin admin] PATH_INFO: `/v3/users/eda0196f36b948c2b847c376ca98040d` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:10.441191 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3bea36-84cb-40ca-b63b-c14e24a39d70 admin admin] RBAC: Authorizing `identity:get_user(user_id=eda0196f36b948c2b847c376ca98040d)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:10.443672 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3bea36-84cb-40ca-b63b-c14e24a39d70 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:10.445241 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 5/9] 10.222.0.44 () {56 vars in 1198 bytes} [Mon May 9 20:10:10 2022] GET /identity/v3/users/eda0196f36b948c2b847c376ca98040d => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:12.719304 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3412d-8bc9-4c6a-85ad-7a67b5d6699c None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:12.719869 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3412d-8bc9-4c6a-85ad-7a67b5d6699c None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:12.719958 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3412d-8bc9-4c6a-85ad-7a67b5d6699c None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:12.721244 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 5/10] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:10:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:10:12.727126 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4797161-3769-4fce-8707-1cf58ac6b5b5 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:12.727577 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4797161-3769-4fce-8707-1cf58ac6b5b5 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:12.727849 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4797161-3769-4fce-8707-1cf58ac6b5b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:12.778571 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb5ee1a-57f0-47ac-948f-a11a47895304 None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:12.778848 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb5ee1a-57f0-47ac-948f-a11a47895304 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:12.779122 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb5ee1a-57f0-47ac-948f-a11a47895304 None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:12.780525 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 6/11] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:10:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 20:10:12.787542 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb7596-a5d4-48b2-ae02-178b79ab4626 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:12.787830 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb7596-a5d4-48b2-ae02-178b79ab4626 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:12.788107 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb7596-a5d4-48b2-ae02-178b79ab4626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:12.829255 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG passlib.handlers.bcrypt [None req-18fb7596-a5d4-48b2-ae02-178b79ab4626 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=79828) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 09 20:10:12.829730 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG passlib.handlers.bcrypt [None req-18fb7596-a5d4-48b2-ae02-178b79ab4626 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79828) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 09 20:10:12.853157 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-e4797161-3769-4fce-8707-1cf58ac6b5b5 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:10:12.854351 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-e4797161-3769-4fce-8707-1cf58ac6b5b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:10:12.876321 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-18fb7596-a5d4-48b2-ae02-178b79ab4626 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:10:12.877881 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-18fb7596-a5d4-48b2-ae02-178b79ab4626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:10:12.932778 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 6/12] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:10:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 20:10:12.955823 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4797161-3769-4fce-8707-1cf58ac6b5b5 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:12.975847 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 7/13] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:10:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 20:10:12.998108 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fb7596-a5d4-48b2-ae02-178b79ab4626 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:13.050495 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4797161-3769-4fce-8707-1cf58ac6b5b5 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:13.083486 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b04e435-d0b2-42d1-ae54-07aac46600b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:13.084216 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b04e435-d0b2-42d1-ae54-07aac46600b8 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:13.084501 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b04e435-d0b2-42d1-ae54-07aac46600b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:13.084776 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b04e435-d0b2-42d1-ae54-07aac46600b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:13.091376 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fb7596-a5d4-48b2-ae02-178b79ab4626 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:13.095477 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b04e435-d0b2-42d1-ae54-07aac46600b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:10:13.106735 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-6b04e435-d0b2-42d1-ae54-07aac46600b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 20:10:13.106735 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:10:13.106735 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:10:13.106735 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:10:13.106735 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:10:13.106735 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:10:13.106735 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:10:13.106735 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:10:13.106735 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:10:13.106735 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:10:13.106735 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:10:13.106735 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:10:13.106735 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:10:13.106735 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:10:13.106735 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:10:13.106735 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:10:13.107768 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:10:13.107768 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:10:13.107768 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:10:13.107768 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:10:13.107768 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:10:13.107768 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:10:13.107768 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:10:13.107768 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:10:13.107768 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:10:13.107768 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:10:13.107768 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:10:13.107768 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:10:13.107768 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:10:13.107768 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:10:13.107768 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:10:13.107768 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:10:13.108572 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:10:13.108572 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:10:13.108572 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:10:13.108572 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:10:13.108572 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:10:13.108572 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:10:13.108572 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:10:13.108572 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:10:13.108572 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:10:13.108572 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:10:13.108572 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 20:10:13.108572 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:10:13.108572 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 7/14] 10.222.0.44 () {56 vars in 1096 bytes} [Mon May 9 20:10:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 20:10:13.114198 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b04e435-d0b2-42d1-ae54-07aac46600b8 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:13.123759 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a368ef31-99f2-4d74-836b-de0e8c4eb180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:13.124663 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a368ef31-99f2-4d74-836b-de0e8c4eb180 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:13.124947 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a368ef31-99f2-4d74-836b-de0e8c4eb180 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:13.125217 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a368ef31-99f2-4d74-836b-de0e8c4eb180 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:13.189223 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a368ef31-99f2-4d74-836b-de0e8c4eb180 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:13.190735 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a368ef31-99f2-4d74-836b-de0e8c4eb180 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:13.208931 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b04e435-d0b2-42d1-ae54-07aac46600b8 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:13.241154 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b5f946-1cec-4c16-a6ac-d4b583f36ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:13.241810 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b5f946-1cec-4c16-a6ac-d4b583f36ec0 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:13.242090 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b5f946-1cec-4c16-a6ac-d4b583f36ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:13.242360 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b5f946-1cec-4c16-a6ac-d4b583f36ec0 None admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:13.243104 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b5f946-1cec-4c16-a6ac-d4b583f36ec0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:10:13.243430 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b5f946-1cec-4c16-a6ac-d4b583f36ec0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:13.244822 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b5f946-1cec-4c16-a6ac-d4b583f36ec0 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:13.256439 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 8/15] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 9 20:10:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:10:13.262042 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b5f946-1cec-4c16-a6ac-d4b583f36ec0 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:13.283189 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 8/16] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 9 20:10:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 09 20:10:13.288786 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a368ef31-99f2-4d74-836b-de0e8c4eb180 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:13.355116 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b5f946-1cec-4c16-a6ac-d4b583f36ec0 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:13.381125 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a368ef31-99f2-4d74-836b-de0e8c4eb180 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:13.388872 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2080461-044c-49f4-83a8-6e642311ce73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:13.389736 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2080461-044c-49f4-83a8-6e642311ce73 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:13.390012 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2080461-044c-49f4-83a8-6e642311ce73 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:13.390280 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2080461-044c-49f4-83a8-6e642311ce73 None admin] PATH_INFO: `/v3/users/eda0196f36b948c2b847c376ca98040d` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:13.391489 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2080461-044c-49f4-83a8-6e642311ce73 None admin] RBAC: Authorizing `identity:get_user(user_id=eda0196f36b948c2b847c376ca98040d)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:13.392948 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2080461-044c-49f4-83a8-6e642311ce73 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:13.395237 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 9/17] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 9 20:10:13 2022] GET /identity/v3/users/eda0196f36b948c2b847c376ca98040d => generated 247 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:10:13.400396 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2080461-044c-49f4-83a8-6e642311ce73 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:13.412716 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1466c2cd-6319-43bd-9cf4-485435a7df7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:13.413532 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466c2cd-6319-43bd-9cf4-485435a7df7e None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:13.413815 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466c2cd-6319-43bd-9cf4-485435a7df7e None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:13.414087 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466c2cd-6319-43bd-9cf4-485435a7df7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:13.497547 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2080461-044c-49f4-83a8-6e642311ce73 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:13.531914 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63984826-ce34-4b4b-a2e6-aaf0499d633f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:13.532695 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63984826-ce34-4b4b-a2e6-aaf0499d633f None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:13.532973 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63984826-ce34-4b4b-a2e6-aaf0499d633f None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:13.533242 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63984826-ce34-4b4b-a2e6-aaf0499d633f None admin] PATH_INFO: `/v3/domains/default` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:13.534426 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63984826-ce34-4b4b-a2e6-aaf0499d633f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:13.536519 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63984826-ce34-4b4b-a2e6-aaf0499d633f None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:13.538050 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 10/18] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:10:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:10:13.540821 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1466c2cd-6319-43bd-9cf4-485435a7df7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:13.542285 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1466c2cd-6319-43bd-9cf4-485435a7df7e None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:13.543660 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63984826-ce34-4b4b-a2e6-aaf0499d633f None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:13.563605 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-1466c2cd-6319-43bd-9cf4-485435a7df7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:10:13.563605 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:10:13.563605 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:10:13.563605 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:10:13.563605 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:10:13.563605 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:10:13.563605 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:10:13.563605 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:10:13.563605 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:10:13.563605 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:10:13.563605 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:10:13.563605 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:10:13.563605 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 20:10:13.563605 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 20:10:13.563605 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 20:10:13.564648 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 20:10:13.564648 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:10:13.564648 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:10:13.564648 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:10:13.564648 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:10:13.564648 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:10:13.564648 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:10:13.564648 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:10:13.564648 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:10:13.564648 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:10:13.564648 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:10:13.564648 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:10:13.564648 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:10:13.564648 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:10:13.564648 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:10:13.564648 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:10:13.564648 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:10:13.571195 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 20:10:13.571195 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 20:10:13.571195 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:10:13.571195 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:10:13.571195 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 9/19] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:10:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 20:10:13.571517 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1466c2cd-6319-43bd-9cf4-485435a7df7e None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:13.637252 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63984826-ce34-4b4b-a2e6-aaf0499d633f None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:13.665458 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1466c2cd-6319-43bd-9cf4-485435a7df7e None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:13.668929 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49695953-a66e-42c0-832d-963e4d14588a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:13.669577 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49695953-a66e-42c0-832d-963e4d14588a None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:13.669860 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49695953-a66e-42c0-832d-963e4d14588a None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:13.670131 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49695953-a66e-42c0-832d-963e4d14588a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:13.670988 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49695953-a66e-42c0-832d-963e4d14588a None admin] RBAC: Adding query filter params (role.id=274130b78e304bb88789c1b349263f3c, scope.domain.id=default, user.id=eda0196f36b948c2b847c376ca98040d) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:10:13.671296 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49695953-a66e-42c0-832d-963e4d14588a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:13.672792 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49695953-a66e-42c0-832d-963e4d14588a None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:13.680055 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 11/20] 10.222.0.44 () {56 vars in 1322 bytes} [Mon May 9 20:10:13 2022] GET /identity/v3/role_assignments?user.id=eda0196f36b948c2b847c376ca98040d&scope.domain.id=default&role.id=274130b78e304bb88789c1b349263f3c => generated 233 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:10:13.698133 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c13af-b82a-4c09-a2ef-d53029e144c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:13.698809 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c13af-b82a-4c09-a2ef-d53029e144c2 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:13.699092 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c13af-b82a-4c09-a2ef-d53029e144c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:13.699366 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c13af-b82a-4c09-a2ef-d53029e144c2 None admin] PATH_INFO: `/v3/domains` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:13.700151 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06c13af-b82a-4c09-a2ef-d53029e144c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:10:13.700456 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06c13af-b82a-4c09-a2ef-d53029e144c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:13.701885 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06c13af-b82a-4c09-a2ef-d53029e144c2 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:13.720887 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 10/21] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 9 20:10:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:10:16.364032 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e054942-647c-47ec-91ef-6e6ea4f06bd1 None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:16.365235 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e054942-647c-47ec-91ef-6e6ea4f06bd1 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:16.365713 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e054942-647c-47ec-91ef-6e6ea4f06bd1 None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:16.367864 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 12/22] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:10:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:10:16.373026 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd9475-c721-4429-af95-b6fcc4eed0a4 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:16.373900 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd9475-c721-4429-af95-b6fcc4eed0a4 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:16.374357 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd9475-c721-4429-af95-b6fcc4eed0a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:16.396103 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-3cbd9475-c721-4429-af95-b6fcc4eed0a4 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:10:16.397662 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-3cbd9475-c721-4429-af95-b6fcc4eed0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:10:16.484313 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 11/23] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:10:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 20:10:16.519259 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e054942-647c-47ec-91ef-6e6ea4f06bd1 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:16.553281 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad5e2f-9003-4f35-822c-99746594bf32 None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:16.553852 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad5e2f-9003-4f35-822c-99746594bf32 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:16.554321 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad5e2f-9003-4f35-822c-99746594bf32 None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:16.556347 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 12/24] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:10:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 20:10:16.574086 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad7ada-7e31-4388-837e-4f5acaf23ce0 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:16.574677 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad7ada-7e31-4388-837e-4f5acaf23ce0 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:16.575134 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad7ada-7e31-4388-837e-4f5acaf23ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:16.628500 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-6dad7ada-7e31-4388-837e-4f5acaf23ce0 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:10:16.630768 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-6dad7ada-7e31-4388-837e-4f5acaf23ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:10:16.657095 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e054942-647c-47ec-91ef-6e6ea4f06bd1 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:16.702101 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b42be6-9ea0-4090-aa06-2f2010b3431e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:16.702894 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b42be6-9ea0-4090-aa06-2f2010b3431e None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:16.703176 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b42be6-9ea0-4090-aa06-2f2010b3431e None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:16.703581 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b42be6-9ea0-4090-aa06-2f2010b3431e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:16.717328 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 13/25] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:10:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 09 20:10:16.718993 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63560278-78f5-42ea-9fb0-7a800d7a2beb None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:16.719503 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63560278-78f5-42ea-9fb0-7a800d7a2beb None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:16.719997 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63560278-78f5-42ea-9fb0-7a800d7a2beb None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:16.721488 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 14/26] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:10:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:10:16.727753 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f114a3-74c7-4265-828d-520f74ef2cbc None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:16.728290 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f114a3-74c7-4265-828d-520f74ef2cbc None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:16.728782 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f114a3-74c7-4265-828d-520f74ef2cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:16.729534 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b42be6-9ea0-4090-aa06-2f2010b3431e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:16.731139 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b42be6-9ea0-4090-aa06-2f2010b3431e None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:16.760962 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-48b42be6-9ea0-4090-aa06-2f2010b3431e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:10:16.760962 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:10:16.760962 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:10:16.760962 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:10:16.760962 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:10:16.760962 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:10:16.760962 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:10:16.760962 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:10:16.760962 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:10:16.760962 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:10:16.760962 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:10:16.760962 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:10:16.760962 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 20:10:16.760962 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 20:10:16.760962 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 20:10:16.761830 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 20:10:16.761830 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:10:16.761830 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:10:16.761830 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:10:16.761830 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:10:16.761830 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:10:16.761830 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:10:16.761830 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:10:16.761830 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:10:16.761830 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:10:16.761830 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:10:16.761830 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:10:16.761830 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:10:16.761830 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:10:16.761830 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:10:16.761830 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:10:16.761830 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:10:16.762645 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 20:10:16.762645 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 20:10:16.762645 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:10:16.762645 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:10:16.764213 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 13/27] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:10:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:10:16.765355 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-80f114a3-74c7-4265-828d-520f74ef2cbc None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:10:16.766284 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b42be6-9ea0-4090-aa06-2f2010b3431e None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:16.768263 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-80f114a3-74c7-4265-828d-520f74ef2cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:10:16.847919 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 15/28] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:10:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 20:10:16.849077 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f114a3-74c7-4265-828d-520f74ef2cbc None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:16.899295 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b42be6-9ea0-4090-aa06-2f2010b3431e None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:16.934770 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a345c8-f9e2-432f-9748-575f44e4752d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:16.935724 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a345c8-f9e2-432f-9748-575f44e4752d None admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:16.936167 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a345c8-f9e2-432f-9748-575f44e4752d None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:16.936600 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a345c8-f9e2-432f-9748-575f44e4752d None admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:16.937553 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a345c8-f9e2-432f-9748-575f44e4752d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:16.939156 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a345c8-f9e2-432f-9748-575f44e4752d None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:16.975134 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f114a3-74c7-4265-828d-520f74ef2cbc None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:17.011506 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7544d3c0-3363-43a5-a613-8829b1d70e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:17.012469 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7544d3c0-3363-43a5-a613-8829b1d70e30 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:17.012887 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7544d3c0-3363-43a5-a613-8829b1d70e30 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:17.013307 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7544d3c0-3363-43a5-a613-8829b1d70e30 None admin] PATH_INFO: `/v3/domains` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:17.014242 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7544d3c0-3363-43a5-a613-8829b1d70e30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:10:17.014680 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7544d3c0-3363-43a5-a613-8829b1d70e30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:17.016382 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7544d3c0-3363-43a5-a613-8829b1d70e30 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:17.028780 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 16/29] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 9 20:10:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:17.030430 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a453e9-47af-4e3a-8bf9-9e8508b3e9b7 None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:17.030856 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a453e9-47af-4e3a-8bf9-9e8508b3e9b7 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:17.031284 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a453e9-47af-4e3a-8bf9-9e8508b3e9b7 None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:17.033211 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 17/30] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:10:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:10:17.034207 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a453e9-47af-4e3a-8bf9-9e8508b3e9b7 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:17.086352 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 14/31] 10.222.0.44 () {60 vars in 1131 bytes} [Mon May 9 20:10:16 2022] POST /identity/v3/roles => generated 219 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:10:17.087347 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a345c8-f9e2-432f-9748-575f44e4752d None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:17.141231 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a453e9-47af-4e3a-8bf9-9e8508b3e9b7 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:17.186739 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4c2ae2-ba3c-4953-9b6c-0fc253687bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:17.188892 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c2ae2-ba3c-4953-9b6c-0fc253687bc3 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:17.194053 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c2ae2-ba3c-4953-9b6c-0fc253687bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:17.194719 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c2ae2-ba3c-4953-9b6c-0fc253687bc3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:17.221170 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4c2ae2-ba3c-4953-9b6c-0fc253687bc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:10:17.237622 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-ef4c2ae2-ba3c-4953-9b6c-0fc253687bc3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 20:10:17.237622 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:10:17.237622 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:10:17.237622 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:10:17.237622 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:10:17.237622 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:10:17.237622 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:10:17.237622 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:10:17.237622 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:10:17.237622 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:10:17.237622 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:10:17.237622 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:10:17.237622 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:10:17.237622 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:10:17.237622 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:10:17.237622 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:10:17.238949 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:10:17.238949 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:10:17.238949 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:10:17.238949 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:10:17.238949 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:10:17.238949 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:10:17.238949 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:10:17.238949 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:10:17.238949 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:10:17.238949 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:10:17.238949 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:10:17.238949 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:10:17.238949 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:10:17.238949 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:10:17.238949 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:10:17.238949 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:10:17.239761 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:10:17.239761 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:10:17.239761 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:10:17.239761 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:10:17.239761 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:10:17.239761 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:10:17.239761 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:10:17.239761 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:10:17.239761 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:10:17.239761 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:10:17.239761 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 20:10:17.239761 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:10:17.245526 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 18/32] 10.222.0.44 () {56 vars in 1096 bytes} [Mon May 9 20:10:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:10:17.247999 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36345438-83b7-41f9-8c46-5314ebf79707 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:17.249152 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36345438-83b7-41f9-8c46-5314ebf79707 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:17.249843 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36345438-83b7-41f9-8c46-5314ebf79707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:17.252176 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a345c8-f9e2-432f-9748-575f44e4752d None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:17.287228 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-36345438-83b7-41f9-8c46-5314ebf79707 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:10:17.290501 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-36345438-83b7-41f9-8c46-5314ebf79707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:10:17.324869 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b47f50-4c35-4a7a-9e90-1e41daff6846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:17.325917 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b47f50-4c35-4a7a-9e90-1e41daff6846 None admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:17.326459 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b47f50-4c35-4a7a-9e90-1e41daff6846 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:17.326736 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b47f50-4c35-4a7a-9e90-1e41daff6846 None admin] PATH_INFO: `/v3/projects` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:17.327471 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b47f50-4c35-4a7a-9e90-1e41daff6846 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:17.329132 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b47f50-4c35-4a7a-9e90-1e41daff6846 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:17.363571 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 15/33] 10.222.0.44 () {60 vars in 1141 bytes} [Mon May 9 20:10:17 2022] POST /identity/v3/projects => generated 301 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:10:17.364485 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b47f50-4c35-4a7a-9e90-1e41daff6846 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:17.436560 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 19/34] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:10:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 20:10:17.472148 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36345438-83b7-41f9-8c46-5314ebf79707 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:17.566186 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b47f50-4c35-4a7a-9e90-1e41daff6846 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:17.631840 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c131f8-6eac-4cbb-9b17-2ebe9a3973bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:17.632512 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c131f8-6eac-4cbb-9b17-2ebe9a3973bd None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:17.632956 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c131f8-6eac-4cbb-9b17-2ebe9a3973bd None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:17.633394 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c131f8-6eac-4cbb-9b17-2ebe9a3973bd None admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:17.634330 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c131f8-6eac-4cbb-9b17-2ebe9a3973bd None admin] RBAC: Adding query filter params (name=admin) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:10:17.634816 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c131f8-6eac-4cbb-9b17-2ebe9a3973bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:17.636491 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c131f8-6eac-4cbb-9b17-2ebe9a3973bd None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:17.654359 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36345438-83b7-41f9-8c46-5314ebf79707 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:17.655423 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 16/35] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 9 20:10:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:17.662435 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c131f8-6eac-4cbb-9b17-2ebe9a3973bd None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:17.701542 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d450be9e-8509-4bff-a0a8-96b343d5cb3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:17.702206 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d450be9e-8509-4bff-a0a8-96b343d5cb3f None admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:17.702490 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d450be9e-8509-4bff-a0a8-96b343d5cb3f None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:17.704038 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d450be9e-8509-4bff-a0a8-96b343d5cb3f None admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:17.704849 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d450be9e-8509-4bff-a0a8-96b343d5cb3f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:17.706255 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d450be9e-8509-4bff-a0a8-96b343d5cb3f None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:17.785085 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c131f8-6eac-4cbb-9b17-2ebe9a3973bd None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:17.824205 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554fac22-aec1-4a4e-a463-a1fd25cf5054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:17.825378 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554fac22-aec1-4a4e-a463-a1fd25cf5054 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:17.825797 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554fac22-aec1-4a4e-a463-a1fd25cf5054 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:17.826209 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554fac22-aec1-4a4e-a463-a1fd25cf5054 None admin] PATH_INFO: `/v3/users/eda0196f36b948c2b847c376ca98040d` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:17.827610 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554fac22-aec1-4a4e-a463-a1fd25cf5054 None admin] RBAC: Authorizing `identity:get_user(user_id=eda0196f36b948c2b847c376ca98040d)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:17.829201 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554fac22-aec1-4a4e-a463-a1fd25cf5054 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:17.831004 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 17/36] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 9 20:10:17 2022] GET /identity/v3/users/eda0196f36b948c2b847c376ca98040d => generated 247 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:17.837259 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554fac22-aec1-4a4e-a463-a1fd25cf5054 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:17.841290 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 20/37] 10.222.0.44 () {60 vars in 1131 bytes} [Mon May 9 20:10:17 2022] POST /identity/v3/roles => generated 225 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 20:10:17.865465 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a96778e-fb53-40ce-8312-ba24ba07bd63 None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:17.865754 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a96778e-fb53-40ce-8312-ba24ba07bd63 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:17.866039 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a96778e-fb53-40ce-8312-ba24ba07bd63 None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:17.868476 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 21/38] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:10:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 20:10:17.874808 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcdf3da-bbf6-4649-89fb-61eee90d73bd None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:17.875097 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcdf3da-bbf6-4649-89fb-61eee90d73bd None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:17.875378 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcdf3da-bbf6-4649-89fb-61eee90d73bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:17.902608 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-9fcdf3da-bbf6-4649-89fb-61eee90d73bd None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:10:17.904243 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-9fcdf3da-bbf6-4649-89fb-61eee90d73bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:10:17.954299 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554fac22-aec1-4a4e-a463-a1fd25cf5054 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:17.983019 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 22/39] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:10:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 20:10:17.993193 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa98c581-8759-4d5a-9a82-9b052cc0f013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:17.994336 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98c581-8759-4d5a-9a82-9b052cc0f013 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:17.994792 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98c581-8759-4d5a-9a82-9b052cc0f013 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:17.995235 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98c581-8759-4d5a-9a82-9b052cc0f013 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:17.996736 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa98c581-8759-4d5a-9a82-9b052cc0f013 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:17.998410 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa98c581-8759-4d5a-9a82-9b052cc0f013 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:18.000422 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 18/40] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:10:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:10:18.007072 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcdf3da-bbf6-4649-89fb-61eee90d73bd None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:18.008512 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa98c581-8759-4d5a-9a82-9b052cc0f013 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:18.120797 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa98c581-8759-4d5a-9a82-9b052cc0f013 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:18.122050 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcdf3da-bbf6-4649-89fb-61eee90d73bd None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:18.157859 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b4fbca-9978-43ad-b0e1-0364ee4d549c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:18.158525 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b4fbca-9978-43ad-b0e1-0364ee4d549c None admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:18.158806 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b4fbca-9978-43ad-b0e1-0364ee4d549c None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:18.158965 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25428d0d-b85e-46fa-b530-adf215093143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:18.159069 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b4fbca-9978-43ad-b0e1-0364ee4d549c None admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:18.159821 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25428d0d-b85e-46fa-b530-adf215093143 None admin] REQUEST_METHOD: `PUT` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:18.159918 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b4fbca-9978-43ad-b0e1-0364ee4d549c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:18.160641 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25428d0d-b85e-46fa-b530-adf215093143 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:18.160990 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25428d0d-b85e-46fa-b530-adf215093143 None admin] PATH_INFO: `/v3/domains/default/users/eda0196f36b948c2b847c376ca98040d/roles/274130b78e304bb88789c1b349263f3c` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:18.161859 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b4fbca-9978-43ad-b0e1-0364ee4d549c None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:18.163523 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25428d0d-b85e-46fa-b530-adf215093143 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=eda0196f36b948c2b847c376ca98040d, role_id=274130b78e304bb88789c1b349263f3c)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:18.165087 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25428d0d-b85e-46fa-b530-adf215093143 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:18.175129 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 19/41] 10.222.0.44 () {60 vars in 1131 bytes} [Mon May 9 20:10:18 2022] POST /identity/v3/roles => generated 223 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:10:18.176947 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ced37-a8fe-49a7-affe-782ece802cfa None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:18.177262 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ced37-a8fe-49a7-affe-782ece802cfa None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:18.177538 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ced37-a8fe-49a7-affe-782ece802cfa None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:18.179933 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 20/42] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:10:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:10:18.180324 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 23/43] 10.222.0.44 () {58 vars in 1361 bytes} [Mon May 9 20:10:18 2022] PUT /identity/v3/domains/default/users/eda0196f36b948c2b847c376ca98040d/roles/274130b78e304bb88789c1b349263f3c => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:10:18.189028 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a24432-f8b7-4541-bdf2-02160009a07f None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:18.189393 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a24432-f8b7-4541-bdf2-02160009a07f None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:18.189787 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a24432-f8b7-4541-bdf2-02160009a07f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:18.209698 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-44a24432-f8b7-4541-bdf2-02160009a07f None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:10:18.211557 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-44a24432-f8b7-4541-bdf2-02160009a07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:10:18.311434 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 21/44] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:10:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 20:10:18.329190 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25428d0d-b85e-46fa-b530-adf215093143 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:18.446070 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25428d0d-b85e-46fa-b530-adf215093143 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:18.490436 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258da9b5-e6b5-41c4-b179-9de212c69eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:18.491234 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258da9b5-e6b5-41c4-b179-9de212c69eef None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:18.491551 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258da9b5-e6b5-41c4-b179-9de212c69eef None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:18.491835 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258da9b5-e6b5-41c4-b179-9de212c69eef None admin] PATH_INFO: `/v3/domains/default` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:18.492995 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258da9b5-e6b5-41c4-b179-9de212c69eef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:18.494455 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258da9b5-e6b5-41c4-b179-9de212c69eef None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:18.496648 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 24/45] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:10:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:18.503760 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a24432-f8b7-4541-bdf2-02160009a07f None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:18.612917 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a24432-f8b7-4541-bdf2-02160009a07f None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:18.651587 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f860d80b-a61f-4ee7-b39a-9ea9f34adbca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:18.652243 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f860d80b-a61f-4ee7-b39a-9ea9f34adbca None admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:18.652532 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f860d80b-a61f-4ee7-b39a-9ea9f34adbca None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:18.652809 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f860d80b-a61f-4ee7-b39a-9ea9f34adbca None admin] PATH_INFO: `/v3/projects` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:18.653532 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f860d80b-a61f-4ee7-b39a-9ea9f34adbca None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:18.655191 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f860d80b-a61f-4ee7-b39a-9ea9f34adbca None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:18.685036 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 22/46] 10.222.0.44 () {60 vars in 1141 bytes} [Mon May 9 20:10:18 2022] POST /identity/v3/projects => generated 312 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 20:10:20.460479 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c4914-9ed7-4b38-a065-959dc3fae635 None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:20.460999 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c4914-9ed7-4b38-a065-959dc3fae635 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:20.461104 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c4914-9ed7-4b38-a065-959dc3fae635 None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:20.462402 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 25/47] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:10:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:10:20.467739 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7065946f-c5b1-4675-adbd-9c1016611409 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:20.468122 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7065946f-c5b1-4675-adbd-9c1016611409 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:20.468295 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7065946f-c5b1-4675-adbd-9c1016611409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:20.485200 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-7065946f-c5b1-4675-adbd-9c1016611409 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:10:20.486375 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-7065946f-c5b1-4675-adbd-9c1016611409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:10:20.549154 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 23/48] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:10:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 20:10:20.572632 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c4914-9ed7-4b38-a065-959dc3fae635 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:20.669666 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c4914-9ed7-4b38-a065-959dc3fae635 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:20.701264 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb8dc6-d4b2-4985-b412-141b1c53a346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:20.702045 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb8dc6-d4b2-4985-b412-141b1c53a346 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:20.702329 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb8dc6-d4b2-4985-b412-141b1c53a346 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:20.702607 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb8dc6-d4b2-4985-b412-141b1c53a346 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:20.712863 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bb8dc6-d4b2-4985-b412-141b1c53a346 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:10:20.720347 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-f5bb8dc6-d4b2-4985-b412-141b1c53a346 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 20:10:20.720347 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:10:20.720347 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:10:20.720347 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:10:20.720347 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:10:20.720347 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:10:20.720347 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:10:20.720347 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:10:20.720347 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:10:20.720347 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:10:20.720347 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:10:20.720347 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:10:20.720347 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:10:20.720347 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:10:20.720347 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:10:20.720347 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:10:20.721387 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:10:20.721387 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:10:20.721387 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:10:20.721387 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:10:20.721387 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:10:20.721387 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:10:20.721387 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:10:20.721387 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:10:20.721387 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:10:20.721387 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:10:20.721387 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:10:20.721387 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:10:20.721387 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:10:20.721387 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:10:20.721387 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:10:20.721387 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:10:20.722194 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:10:20.722194 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:10:20.722194 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:10:20.722194 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:10:20.722194 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:10:20.722194 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:10:20.722194 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:10:20.722194 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:10:20.722194 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:10:20.722194 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:10:20.722194 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 20:10:20.722194 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:10:20.722194 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 26/49] 10.222.0.44 () {56 vars in 1096 bytes} [Mon May 9 20:10:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:10:20.727908 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7065946f-c5b1-4675-adbd-9c1016611409 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:20.825629 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7065946f-c5b1-4675-adbd-9c1016611409 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:20.858091 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a538807-2da7-46c2-968b-56d6b9fd57b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:20.858751 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a538807-2da7-46c2-968b-56d6b9fd57b6 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:20.859034 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a538807-2da7-46c2-968b-56d6b9fd57b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:20.859306 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a538807-2da7-46c2-968b-56d6b9fd57b6 None admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:20.860087 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a538807-2da7-46c2-968b-56d6b9fd57b6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:10:20.860393 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a538807-2da7-46c2-968b-56d6b9fd57b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:20.861774 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a538807-2da7-46c2-968b-56d6b9fd57b6 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:20.869692 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 24/50] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 9 20:10:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:20.875154 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb8dc6-d4b2-4985-b412-141b1c53a346 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:20.968105 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b0f46-f25c-4c5f-a9ca-dd5353a3c754 None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:20.968421 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b0f46-f25c-4c5f-a9ca-dd5353a3c754 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:20.968767 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b0f46-f25c-4c5f-a9ca-dd5353a3c754 None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:20.970218 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 25/51] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:10:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 20:10:20.972372 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb8dc6-d4b2-4985-b412-141b1c53a346 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:20.975918 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2db775-c04d-4212-a6a3-7b38df96acd3 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:20.976205 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2db775-c04d-4212-a6a3-7b38df96acd3 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:20.976486 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2db775-c04d-4212-a6a3-7b38df96acd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:20.993575 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-ba2db775-c04d-4212-a6a3-7b38df96acd3 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:10:20.994770 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-ba2db775-c04d-4212-a6a3-7b38df96acd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:10:21.004880 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4850dc-46a8-4491-87cf-e80ff7352f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:21.006018 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4850dc-46a8-4491-87cf-e80ff7352f45 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:21.006305 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4850dc-46a8-4491-87cf-e80ff7352f45 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:21.006577 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4850dc-46a8-4491-87cf-e80ff7352f45 None admin] PATH_INFO: `/v3/users/eda0196f36b948c2b847c376ca98040d` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:21.007794 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4850dc-46a8-4491-87cf-e80ff7352f45 None admin] RBAC: Authorizing `identity:get_user(user_id=eda0196f36b948c2b847c376ca98040d)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:21.009246 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4850dc-46a8-4491-87cf-e80ff7352f45 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:21.010871 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 27/52] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 9 20:10:20 2022] GET /identity/v3/users/eda0196f36b948c2b847c376ca98040d => generated 247 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:10:21.016107 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4850dc-46a8-4491-87cf-e80ff7352f45 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:21.057713 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 26/53] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:10:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 20:10:21.079759 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2db775-c04d-4212-a6a3-7b38df96acd3 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:21.109882 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4850dc-46a8-4491-87cf-e80ff7352f45 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:21.141113 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d059cd-f00b-4ec9-888c-d8f201522110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:21.141887 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d059cd-f00b-4ec9-888c-d8f201522110 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:21.142171 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d059cd-f00b-4ec9-888c-d8f201522110 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:21.142445 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d059cd-f00b-4ec9-888c-d8f201522110 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:21.143630 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d059cd-f00b-4ec9-888c-d8f201522110 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:21.145410 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d059cd-f00b-4ec9-888c-d8f201522110 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:21.147245 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 28/54] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:10:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:10:21.152587 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d059cd-f00b-4ec9-888c-d8f201522110 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:21.173025 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2db775-c04d-4212-a6a3-7b38df96acd3 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:21.205824 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cf7c71-d175-4fed-ad1e-60b7e12f9c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:21.206606 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf7c71-d175-4fed-ad1e-60b7e12f9c18 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:21.206894 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf7c71-d175-4fed-ad1e-60b7e12f9c18 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:21.208263 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf7c71-d175-4fed-ad1e-60b7e12f9c18 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:21.209459 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cf7c71-d175-4fed-ad1e-60b7e12f9c18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:21.210928 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cf7c71-d175-4fed-ad1e-60b7e12f9c18 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:21.212584 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 27/55] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:10:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:10:21.217993 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cf7c71-d175-4fed-ad1e-60b7e12f9c18 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:21.246061 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d059cd-f00b-4ec9-888c-d8f201522110 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:21.277991 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f319bd-0d67-4a16-952d-b2aaf84b0a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:21.278638 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f319bd-0d67-4a16-952d-b2aaf84b0a35 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:21.278921 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f319bd-0d67-4a16-952d-b2aaf84b0a35 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:21.279197 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f319bd-0d67-4a16-952d-b2aaf84b0a35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:21.280241 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f319bd-0d67-4a16-952d-b2aaf84b0a35 None admin] RBAC: Adding query filter params (role.id=274130b78e304bb88789c1b349263f3c, scope.domain.id=default, user.id=eda0196f36b948c2b847c376ca98040d) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:10:21.280556 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f319bd-0d67-4a16-952d-b2aaf84b0a35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:21.282005 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f319bd-0d67-4a16-952d-b2aaf84b0a35 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:21.289670 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 29/56] 10.222.0.44 () {56 vars in 1322 bytes} [Mon May 9 20:10:21 2022] GET /identity/v3/role_assignments?user.id=eda0196f36b948c2b847c376ca98040d&scope.domain.id=default&role.id=274130b78e304bb88789c1b349263f3c => generated 530 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:10:21.314785 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cf7c71-d175-4fed-ad1e-60b7e12f9c18 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:21.351926 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d9de51-fbab-4308-aab6-23f0af26c133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:21.352613 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d9de51-fbab-4308-aab6-23f0af26c133 None admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:21.352898 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d9de51-fbab-4308-aab6-23f0af26c133 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:21.353177 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d9de51-fbab-4308-aab6-23f0af26c133 None admin] PATH_INFO: `/v3/projects` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:21.353907 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d9de51-fbab-4308-aab6-23f0af26c133 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:21.355436 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d9de51-fbab-4308-aab6-23f0af26c133 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:21.385542 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 28/57] 10.222.0.44 () {60 vars in 1140 bytes} [Mon May 9 20:10:21 2022] POST /identity/v3/projects => generated 298 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 20:10:23.615933 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed954f2-e8f7-40d5-83c2-fbcd34b687bf None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:23.616409 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed954f2-e8f7-40d5-83c2-fbcd34b687bf None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:23.616513 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed954f2-e8f7-40d5-83c2-fbcd34b687bf None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:23.617835 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 30/58] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:10:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:10:23.623054 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b7197-7dbb-41a3-9980-d99d66196fe7 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:23.623440 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b7197-7dbb-41a3-9980-d99d66196fe7 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:23.623637 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b7197-7dbb-41a3-9980-d99d66196fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:23.639904 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-3b7b7197-7dbb-41a3-9980-d99d66196fe7 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:10:23.641071 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-3b7b7197-7dbb-41a3-9980-d99d66196fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:10:23.703096 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 29/59] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:10:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 20:10:23.727704 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed954f2-e8f7-40d5-83c2-fbcd34b687bf None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:23.825974 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed954f2-e8f7-40d5-83c2-fbcd34b687bf None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:23.857347 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9095c9b9-4969-48b6-a99b-f56ed540b2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:23.858055 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095c9b9-4969-48b6-a99b-f56ed540b2cf None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:23.858336 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095c9b9-4969-48b6-a99b-f56ed540b2cf None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:23.858609 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095c9b9-4969-48b6-a99b-f56ed540b2cf None admin] PATH_INFO: `/v3/domains/default` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:23.859790 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9095c9b9-4969-48b6-a99b-f56ed540b2cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:23.861230 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9095c9b9-4969-48b6-a99b-f56ed540b2cf None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:23.862826 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 31/60] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:10:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:23.868507 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7b7197-7dbb-41a3-9980-d99d66196fe7 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:23.959646 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7b7197-7dbb-41a3-9980-d99d66196fe7 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:23.990578 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081faf32-32b0-4b4b-a0a6-debcc516aa72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:23.991226 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081faf32-32b0-4b4b-a0a6-debcc516aa72 None admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:23.991539 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081faf32-32b0-4b4b-a0a6-debcc516aa72 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:23.991814 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081faf32-32b0-4b4b-a0a6-debcc516aa72 None admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:23.992521 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081faf32-32b0-4b4b-a0a6-debcc516aa72 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:23.994027 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081faf32-32b0-4b4b-a0a6-debcc516aa72 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:24.018214 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 30/61] 10.222.0.44 () {60 vars in 1132 bytes} [Mon May 9 20:10:23 2022] POST /identity/v3/users => generated 275 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:10:27.208722 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6842056-1106-4bb8-a651-b5252b8230a6 None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:27.209296 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6842056-1106-4bb8-a651-b5252b8230a6 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:27.209296 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6842056-1106-4bb8-a651-b5252b8230a6 None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:27.210914 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 32/62] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:10:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:10:27.216095 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546aeae3-fe67-48eb-9f5d-1d4652f9b04c None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:27.216492 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546aeae3-fe67-48eb-9f5d-1d4652f9b04c None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:27.216655 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546aeae3-fe67-48eb-9f5d-1d4652f9b04c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:27.240468 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-546aeae3-fe67-48eb-9f5d-1d4652f9b04c None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:10:27.241685 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-546aeae3-fe67-48eb-9f5d-1d4652f9b04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:10:27.324677 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 31/63] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:10:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 20:10:27.365445 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6842056-1106-4bb8-a651-b5252b8230a6 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:27.494142 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6842056-1106-4bb8-a651-b5252b8230a6 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:27.534698 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed10b2c-96ee-454b-812b-dd99359207c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:27.536116 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed10b2c-96ee-454b-812b-dd99359207c4 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:27.536401 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed10b2c-96ee-454b-812b-dd99359207c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:27.536862 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed10b2c-96ee-454b-812b-dd99359207c4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:27.553494 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed10b2c-96ee-454b-812b-dd99359207c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:10:27.561181 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-3ed10b2c-96ee-454b-812b-dd99359207c4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 20:10:27.561181 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:10:27.561181 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:10:27.561181 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:10:27.561181 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:10:27.561181 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:10:27.561181 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:10:27.561181 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:10:27.561181 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:10:27.561181 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:10:27.561181 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:10:27.561181 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:10:27.561181 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:10:27.561181 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:10:27.561181 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:10:27.561181 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:10:27.562012 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:10:27.562012 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:10:27.562012 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:10:27.562012 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:10:27.562012 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:10:27.562012 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:10:27.562012 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:10:27.562012 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:10:27.562012 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:10:27.562012 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:10:27.562012 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:10:27.562012 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:10:27.562012 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:10:27.562012 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:10:27.562012 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:10:27.562012 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:10:27.562796 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:10:27.562796 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:10:27.562796 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:10:27.562796 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:10:27.562796 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:10:27.562796 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:10:27.562796 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:10:27.562796 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:10:27.562796 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:10:27.562796 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:10:27.562796 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 20:10:27.562796 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:10:27.562796 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 33/64] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 9 20:10:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:10:27.569279 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546aeae3-fe67-48eb-9f5d-1d4652f9b04c None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:27.671694 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546aeae3-fe67-48eb-9f5d-1d4652f9b04c None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:27.672129 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a755e125-b0c8-46a2-8184-ba87f072ee3b None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:27.672644 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a755e125-b0c8-46a2-8184-ba87f072ee3b None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:27.673123 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a755e125-b0c8-46a2-8184-ba87f072ee3b None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:27.674706 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 34/65] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:10:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 20:10:27.680604 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29894e-9ca8-48f0-8c21-d64d518c2042 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:27.681135 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29894e-9ca8-48f0-8c21-d64d518c2042 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:27.681609 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29894e-9ca8-48f0-8c21-d64d518c2042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:27.712261 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10851177-7c05-45b6-a594-89522caa2573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:27.713350 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10851177-7c05-45b6-a594-89522caa2573 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:27.713836 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10851177-7c05-45b6-a594-89522caa2573 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:27.714347 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10851177-7c05-45b6-a594-89522caa2573 None admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:27.715328 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10851177-7c05-45b6-a594-89522caa2573 None admin] RBAC: Adding query filter params (name=member) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:10:27.715791 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10851177-7c05-45b6-a594-89522caa2573 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:27.717342 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10851177-7c05-45b6-a594-89522caa2573 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:27.719855 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-4d29894e-9ca8-48f0-8c21-d64d518c2042 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:10:27.721950 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-4d29894e-9ca8-48f0-8c21-d64d518c2042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:10:27.735537 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 32/66] 10.222.0.44 () {56 vars in 1101 bytes} [Mon May 9 20:10:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:27.746424 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10851177-7c05-45b6-a594-89522caa2573 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:27.843455 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 35/67] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:10:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 20:10:27.849716 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c926ccf-5d47-4371-8c96-5d72a05ef429 None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:27.852345 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c926ccf-5d47-4371-8c96-5d72a05ef429 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:27.854294 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c926ccf-5d47-4371-8c96-5d72a05ef429 None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:27.861161 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 36/68] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:10:27 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:10:27.867519 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b17938c-58f9-4e82-bd1c-b01c22cdb592 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:27.868060 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b17938c-58f9-4e82-bd1c-b01c22cdb592 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:27.868533 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b17938c-58f9-4e82-bd1c-b01c22cdb592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:27.890986 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-8b17938c-58f9-4e82-bd1c-b01c22cdb592 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:10:27.893133 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-8b17938c-58f9-4e82-bd1c-b01c22cdb592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:10:27.898058 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10851177-7c05-45b6-a594-89522caa2573 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:27.938827 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601289ed-6af9-4e74-8637-8d317868e321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:27.939729 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601289ed-6af9-4e74-8637-8d317868e321 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:27.940011 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601289ed-6af9-4e74-8637-8d317868e321 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:27.940289 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601289ed-6af9-4e74-8637-8d317868e321 None admin] PATH_INFO: `/v3/users/178306c7b6c64cbfa5ff0a58f91fde9a` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:27.956890 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601289ed-6af9-4e74-8637-8d317868e321 None admin] RBAC: Authorizing `identity:get_user(user_id=178306c7b6c64cbfa5ff0a58f91fde9a)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:27.958698 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601289ed-6af9-4e74-8637-8d317868e321 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:27.961339 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 33/69] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 9 20:10:27 2022] GET /identity/v3/users/178306c7b6c64cbfa5ff0a58f91fde9a => generated 275 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:27.962119 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601289ed-6af9-4e74-8637-8d317868e321 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:27.977237 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 37/70] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:10:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 20:10:27.978255 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b17938c-58f9-4e82-bd1c-b01c22cdb592 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:28.086513 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601289ed-6af9-4e74-8637-8d317868e321 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:28.091976 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b17938c-58f9-4e82-bd1c-b01c22cdb592 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:28.119921 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2fcaa4-8556-478a-b183-fa5b31846220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:28.120721 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2fcaa4-8556-478a-b183-fa5b31846220 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:28.121006 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2fcaa4-8556-478a-b183-fa5b31846220 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:28.121340 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2fcaa4-8556-478a-b183-fa5b31846220 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:28.124188 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99afcbf1-8502-44b8-af50-b4b6f763203a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:28.124832 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99afcbf1-8502-44b8-af50-b4b6f763203a None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:28.125116 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99afcbf1-8502-44b8-af50-b4b6f763203a None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:28.125391 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99afcbf1-8502-44b8-af50-b4b6f763203a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:28.132924 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2fcaa4-8556-478a-b183-fa5b31846220 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:10:28.141023 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-1e2fcaa4-8556-478a-b183-fa5b31846220 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 20:10:28.141023 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:10:28.141023 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:10:28.141023 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:10:28.141023 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:10:28.141023 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:10:28.141023 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:10:28.141023 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:10:28.141023 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:10:28.141023 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:10:28.141023 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:10:28.141023 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:10:28.141023 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:10:28.141023 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:10:28.141023 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:10:28.141023 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:10:28.141860 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:10:28.141860 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:10:28.141860 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:10:28.141860 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:10:28.141860 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:10:28.141860 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:10:28.141860 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:10:28.141860 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:10:28.141860 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:10:28.141860 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:10:28.141860 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:10:28.141860 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:10:28.141860 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:10:28.141860 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:10:28.141860 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:10:28.141860 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:10:28.142605 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:10:28.142605 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:10:28.142605 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:10:28.142605 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:10:28.142605 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:10:28.142605 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:10:28.142605 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:10:28.142605 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:10:28.142605 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:10:28.142605 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:10:28.142605 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 20:10:28.142605 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:10:28.142605 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 34/71] 10.222.0.44 () {56 vars in 1114 bytes} [Mon May 9 20:10:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:10:28.143911 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2fcaa4-8556-478a-b183-fa5b31846220 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:28.195562 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99afcbf1-8502-44b8-af50-b4b6f763203a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:28.197042 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99afcbf1-8502-44b8-af50-b4b6f763203a None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:28.238181 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2fcaa4-8556-478a-b183-fa5b31846220 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:28.270284 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fefd28-2bc6-44a7-91c3-54fab0af5cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:28.271055 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fefd28-2bc6-44a7-91c3-54fab0af5cda None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:28.271336 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fefd28-2bc6-44a7-91c3-54fab0af5cda None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:28.271730 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fefd28-2bc6-44a7-91c3-54fab0af5cda None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:28.281623 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fefd28-2bc6-44a7-91c3-54fab0af5cda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:10:28.288938 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 38/72] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 9 20:10:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 20:10:28.289460 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-45fefd28-2bc6-44a7-91c3-54fab0af5cda None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 20:10:28.289460 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:10:28.289460 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:10:28.289460 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:10:28.289460 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:10:28.289460 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:10:28.289460 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:10:28.289460 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:10:28.289460 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:10:28.289460 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:10:28.289460 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:10:28.289460 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:10:28.289460 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:10:28.289460 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:10:28.289460 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:10:28.289460 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:10:28.290317 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:10:28.290317 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:10:28.290317 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:10:28.290317 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:10:28.290317 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:10:28.290317 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:10:28.290317 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:10:28.290317 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:10:28.290317 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:10:28.290317 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:10:28.290317 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:10:28.290317 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:10:28.290317 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:10:28.290317 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:10:28.290317 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:10:28.290317 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:10:28.291081 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:10:28.291081 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:10:28.291081 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:10:28.291081 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:10:28.291081 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:10:28.291081 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:10:28.291081 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:10:28.291081 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:10:28.291081 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:10:28.291081 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:10:28.291081 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 20:10:28.291081 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:10:28.292135 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feaf7dc-8cba-46e7-8f9c-c575ee7941dd None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:28.292135 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feaf7dc-8cba-46e7-8f9c-c575ee7941dd None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:28.292135 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feaf7dc-8cba-46e7-8f9c-c575ee7941dd None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:28.292135 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 39/73] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:10:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:10:28.292767 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feaf7dc-8cba-46e7-8f9c-c575ee7941dd None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:28.295629 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 35/74] 10.222.0.44 () {56 vars in 1096 bytes} [Mon May 9 20:10:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:10:28.296966 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2b52e-82ce-4a08-ae90-3fefe479eb07 None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:28.297256 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2b52e-82ce-4a08-ae90-3fefe479eb07 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:28.297536 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2b52e-82ce-4a08-ae90-3fefe479eb07 None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:28.299603 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 36/75] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:10:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:10:28.299826 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db2b52e-82ce-4a08-ae90-3fefe479eb07 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:28.390728 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feaf7dc-8cba-46e7-8f9c-c575ee7941dd None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:28.404153 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db2b52e-82ce-4a08-ae90-3fefe479eb07 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:28.422717 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e4da0b-5887-4e15-ac4a-c77300562e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:28.423378 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e4da0b-5887-4e15-ac4a-c77300562e0d None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:28.423694 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e4da0b-5887-4e15-ac4a-c77300562e0d None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:28.423973 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e4da0b-5887-4e15-ac4a-c77300562e0d None admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:28.424722 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e4da0b-5887-4e15-ac4a-c77300562e0d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:10:28.425035 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e4da0b-5887-4e15-ac4a-c77300562e0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:28.427146 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e4da0b-5887-4e15-ac4a-c77300562e0d None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:28.435495 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaf5364-ba71-46da-bbb6-bf2078389023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:28.436335 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf5364-ba71-46da-bbb6-bf2078389023 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:28.436611 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf5364-ba71-46da-bbb6-bf2078389023 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:28.436880 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf5364-ba71-46da-bbb6-bf2078389023 None admin] PATH_INFO: `/v3/projects/2019f358cc3841408e7d4693c6b8133a` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:28.437954 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 40/76] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 9 20:10:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:28.438091 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaf5364-ba71-46da-bbb6-bf2078389023 None admin] RBAC: Authorizing `identity:get_project(project_id=2019f358cc3841408e7d4693c6b8133a)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:28.438742 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e4da0b-5887-4e15-ac4a-c77300562e0d None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:28.439601 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaf5364-ba71-46da-bbb6-bf2078389023 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:28.441966 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 37/77] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 9 20:10:28 2022] GET /identity/v3/projects/2019f358cc3841408e7d4693c6b8133a => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:28.443270 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eed036-9e72-4fbf-a982-e999e72e5d50 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:28.443812 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eed036-9e72-4fbf-a982-e999e72e5d50 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:28.443812 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eed036-9e72-4fbf-a982-e999e72e5d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:28.459826 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-57eed036-9e72-4fbf-a982-e999e72e5d50 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:10:28.461002 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-57eed036-9e72-4fbf-a982-e999e72e5d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:10:28.525604 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 38/78] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:10:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 20:10:28.526690 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b172c428-dbcd-40e5-88a9-4910e2e29def None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:28.526985 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b172c428-dbcd-40e5-88a9-4910e2e29def None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:28.527278 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b172c428-dbcd-40e5-88a9-4910e2e29def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:28.539227 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e4da0b-5887-4e15-ac4a-c77300562e0d None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:28.543871 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-b172c428-dbcd-40e5-88a9-4910e2e29def None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:10:28.545045 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-b172c428-dbcd-40e5-88a9-4910e2e29def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:10:28.574363 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9482e3-86f9-433f-ab3f-51134b405f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:28.575033 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9482e3-86f9-433f-ab3f-51134b405f3a None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:28.575321 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9482e3-86f9-433f-ab3f-51134b405f3a None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:28.578025 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9482e3-86f9-433f-ab3f-51134b405f3a None admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:28.578025 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9482e3-86f9-433f-ab3f-51134b405f3a None admin] RBAC: Adding query filter params (name=admin) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:10:28.578025 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9482e3-86f9-433f-ab3f-51134b405f3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:28.578265 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9482e3-86f9-433f-ab3f-51134b405f3a None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:28.586246 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 41/79] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 9 20:10:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:28.587064 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9482e3-86f9-433f-ab3f-51134b405f3a None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:28.609655 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 39/80] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:10:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 20:10:28.610493 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b172c428-dbcd-40e5-88a9-4910e2e29def None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:28.683223 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9482e3-86f9-433f-ab3f-51134b405f3a None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:28.702327 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b172c428-dbcd-40e5-88a9-4910e2e29def None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:28.713695 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74827484-27fa-4929-9049-8bc8beab915b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:28.714555 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74827484-27fa-4929-9049-8bc8beab915b None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:28.714840 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74827484-27fa-4929-9049-8bc8beab915b None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:28.715111 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74827484-27fa-4929-9049-8bc8beab915b None admin] PATH_INFO: `/v3/users/178306c7b6c64cbfa5ff0a58f91fde9a` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:28.716333 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74827484-27fa-4929-9049-8bc8beab915b None admin] RBAC: Authorizing `identity:get_user(user_id=178306c7b6c64cbfa5ff0a58f91fde9a)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:28.717777 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74827484-27fa-4929-9049-8bc8beab915b None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:28.719414 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 42/81] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 9 20:10:28 2022] GET /identity/v3/users/178306c7b6c64cbfa5ff0a58f91fde9a => generated 275 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:28.720180 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74827484-27fa-4929-9049-8bc8beab915b None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:28.734066 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f42e65a-5a18-4827-9e93-185718d5518f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:28.734795 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42e65a-5a18-4827-9e93-185718d5518f None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:28.735144 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42e65a-5a18-4827-9e93-185718d5518f None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:28.735444 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42e65a-5a18-4827-9e93-185718d5518f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:28.736264 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f42e65a-5a18-4827-9e93-185718d5518f None admin] RBAC: Adding query filter params (role.id=79f90a0bf6ea43d0b3c434e31556253a, scope.project.id=2019f358cc3841408e7d4693c6b8133a, user.id=178306c7b6c64cbfa5ff0a58f91fde9a) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:10:28.736573 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f42e65a-5a18-4827-9e93-185718d5518f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:28.738636 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f42e65a-5a18-4827-9e93-185718d5518f None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:28.743930 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 40/82] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 9 20:10:28 2022] GET /identity/v3/role_assignments?user.id=178306c7b6c64cbfa5ff0a58f91fde9a&scope.project.id=2019f358cc3841408e7d4693c6b8133a&role.id=79f90a0bf6ea43d0b3c434e31556253a => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:28.744692 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f42e65a-5a18-4827-9e93-185718d5518f None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:28.823336 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74827484-27fa-4929-9049-8bc8beab915b None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:28.847933 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f42e65a-5a18-4827-9e93-185718d5518f None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:28.858108 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f0a3f-ed8a-420f-8c19-eebe63ea681a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:28.858918 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f0a3f-ed8a-420f-8c19-eebe63ea681a None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:28.859202 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f0a3f-ed8a-420f-8c19-eebe63ea681a None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:28.859507 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f0a3f-ed8a-420f-8c19-eebe63ea681a None admin] PATH_INFO: `/v3/domains/default` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:28.860718 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828f0a3f-ed8a-420f-8c19-eebe63ea681a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:28.862194 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828f0a3f-ed8a-420f-8c19-eebe63ea681a None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:28.864886 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 43/83] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:10:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:28.865464 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f0a3f-ed8a-420f-8c19-eebe63ea681a None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:28.884229 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdeb757-1465-48dd-bf42-368d648607c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:28.885163 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdeb757-1465-48dd-bf42-368d648607c2 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:28.885503 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdeb757-1465-48dd-bf42-368d648607c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:28.885778 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdeb757-1465-48dd-bf42-368d648607c2 None admin] PATH_INFO: `/v3/users/eda0196f36b948c2b847c376ca98040d` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:28.887060 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdeb757-1465-48dd-bf42-368d648607c2 None admin] RBAC: Authorizing `identity:get_user(user_id=eda0196f36b948c2b847c376ca98040d)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:28.888629 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdeb757-1465-48dd-bf42-368d648607c2 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:28.890334 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 41/84] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 9 20:10:28 2022] GET /identity/v3/users/eda0196f36b948c2b847c376ca98040d => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:28.891118 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdeb757-1465-48dd-bf42-368d648607c2 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:28.970381 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f0a3f-ed8a-420f-8c19-eebe63ea681a None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:28.993446 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdeb757-1465-48dd-bf42-368d648607c2 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:29.002758 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d2f53-a620-425a-a76f-bb4edcbb6dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:29.003604 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d2f53-a620-425a-a76f-bb4edcbb6dd6 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:29.004498 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d2f53-a620-425a-a76f-bb4edcbb6dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:29.004773 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d2f53-a620-425a-a76f-bb4edcbb6dd6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:29.014878 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8d2f53-a620-425a-a76f-bb4edcbb6dd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:10:29.022561 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-2c8d2f53-a620-425a-a76f-bb4edcbb6dd6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 20:10:29.022561 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:10:29.022561 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:10:29.022561 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:10:29.022561 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:10:29.022561 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:10:29.022561 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:10:29.022561 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:10:29.022561 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:10:29.022561 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:10:29.022561 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:10:29.022561 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:10:29.022561 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:10:29.022561 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:10:29.022561 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:10:29.022561 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:10:29.023414 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:10:29.023414 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:10:29.023414 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:10:29.023414 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:10:29.023414 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:10:29.023414 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:10:29.023414 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:10:29.023414 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:10:29.023414 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:10:29.023414 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:10:29.023414 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:10:29.023414 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:10:29.023414 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:10:29.023414 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:10:29.023414 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:10:29.023414 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:10:29.029247 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:10:29.029247 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:10:29.029247 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:10:29.029247 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:10:29.029247 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:10:29.029247 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:10:29.029247 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:10:29.029247 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:10:29.029247 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:10:29.029247 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:10:29.029247 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 20:10:29.029247 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:10:29.029247 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 44/85] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 9 20:10:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:10:29.029247 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d2f53-a620-425a-a76f-bb4edcbb6dd6 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:29.032529 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf157ab-2103-49f3-a7cd-1ad96f0402e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:29.033185 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf157ab-2103-49f3-a7cd-1ad96f0402e8 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:29.033471 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf157ab-2103-49f3-a7cd-1ad96f0402e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:29.033750 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf157ab-2103-49f3-a7cd-1ad96f0402e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:29.103293 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf157ab-2103-49f3-a7cd-1ad96f0402e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:29.104814 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf157ab-2103-49f3-a7cd-1ad96f0402e8 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:29.123704 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d2f53-a620-425a-a76f-bb4edcbb6dd6 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:29.157215 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b02454-9621-47f2-b864-0aeeb107cf21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:29.157875 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b02454-9621-47f2-b864-0aeeb107cf21 None admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:29.158157 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b02454-9621-47f2-b864-0aeeb107cf21 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:29.158435 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b02454-9621-47f2-b864-0aeeb107cf21 None admin] PATH_INFO: `/v3/users` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:29.159137 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b02454-9621-47f2-b864-0aeeb107cf21 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:29.160661 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b02454-9621-47f2-b864-0aeeb107cf21 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:29.187484 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 45/86] 10.222.0.44 () {60 vars in 1132 bytes} [Mon May 9 20:10:29 2022] POST /identity/v3/users => generated 289 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:10:29.188621 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b02454-9621-47f2-b864-0aeeb107cf21 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:29.207487 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 42/87] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 9 20:10:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 20:10:29.208454 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf157ab-2103-49f3-a7cd-1ad96f0402e8 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:29.294745 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b02454-9621-47f2-b864-0aeeb107cf21 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:29.315076 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf157ab-2103-49f3-a7cd-1ad96f0402e8 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:29.332798 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360a9aff-58e3-4631-a7ba-30857211bef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:29.334305 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a9aff-58e3-4631-a7ba-30857211bef6 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:29.334974 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a9aff-58e3-4631-a7ba-30857211bef6 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:29.335663 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a9aff-58e3-4631-a7ba-30857211bef6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:29.351755 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a982c215-0d62-4d61-9e0b-395ce89882b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:29.352482 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982c215-0d62-4d61-9e0b-395ce89882b1 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:29.352766 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982c215-0d62-4d61-9e0b-395ce89882b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:29.353035 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982c215-0d62-4d61-9e0b-395ce89882b1 None admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:29.353844 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a982c215-0d62-4d61-9e0b-395ce89882b1 None admin] RBAC: Adding query filter params (name=member) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:10:29.354083 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a982c215-0d62-4d61-9e0b-395ce89882b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:29.355543 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a982c215-0d62-4d61-9e0b-395ce89882b1 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:29.364791 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 43/88] 10.222.0.44 () {56 vars in 1101 bytes} [Mon May 9 20:10:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:29.365670 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a982c215-0d62-4d61-9e0b-395ce89882b1 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:29.409471 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360a9aff-58e3-4631-a7ba-30857211bef6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:29.411873 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360a9aff-58e3-4631-a7ba-30857211bef6 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:29.477916 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a982c215-0d62-4d61-9e0b-395ce89882b1 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:29.516745 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffe7859-a579-4a6a-b336-cb62fb77efbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:29.517835 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe7859-a579-4a6a-b336-cb62fb77efbf None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:29.518258 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe7859-a579-4a6a-b336-cb62fb77efbf None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:29.518758 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe7859-a579-4a6a-b336-cb62fb77efbf None admin] PATH_INFO: `/v3/projects/2019f358cc3841408e7d4693c6b8133a` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:29.520427 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffe7859-a579-4a6a-b336-cb62fb77efbf None admin] RBAC: Authorizing `identity:get_project(project_id=2019f358cc3841408e7d4693c6b8133a)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:29.522080 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffe7859-a579-4a6a-b336-cb62fb77efbf None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:29.522654 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 46/89] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 9 20:10:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 20:10:29.527418 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360a9aff-58e3-4631-a7ba-30857211bef6 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:29.528603 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 44/90] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 9 20:10:29 2022] GET /identity/v3/projects/2019f358cc3841408e7d4693c6b8133a => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:29.530195 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffe7859-a579-4a6a-b336-cb62fb77efbf None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:29.640790 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360a9aff-58e3-4631-a7ba-30857211bef6 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:29.665355 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffe7859-a579-4a6a-b336-cb62fb77efbf None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:29.682968 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e97691-ff52-4925-8bdc-856168f17d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:29.684040 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e97691-ff52-4925-8bdc-856168f17d53 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:29.684414 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e97691-ff52-4925-8bdc-856168f17d53 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:29.684806 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e97691-ff52-4925-8bdc-856168f17d53 None admin] PATH_INFO: `/v3/users/178306c7b6c64cbfa5ff0a58f91fde9a` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:29.686957 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e97691-ff52-4925-8bdc-856168f17d53 None admin] RBAC: Authorizing `identity:get_user(user_id=178306c7b6c64cbfa5ff0a58f91fde9a)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:29.688448 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e97691-ff52-4925-8bdc-856168f17d53 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:29.690083 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 47/91] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 9 20:10:29 2022] GET /identity/v3/users/178306c7b6c64cbfa5ff0a58f91fde9a => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:29.690842 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e97691-ff52-4925-8bdc-856168f17d53 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:29.709720 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d1d94a-c969-4798-8cee-5170cc5dbf09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:29.711023 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d1d94a-c969-4798-8cee-5170cc5dbf09 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:29.711309 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d1d94a-c969-4798-8cee-5170cc5dbf09 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:29.711615 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d1d94a-c969-4798-8cee-5170cc5dbf09 None admin] PATH_INFO: `/v3/projects/2019f358cc3841408e7d4693c6b8133a` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:29.712917 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d1d94a-c969-4798-8cee-5170cc5dbf09 None admin] RBAC: Authorizing `identity:get_project(project_id=2019f358cc3841408e7d4693c6b8133a)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:29.714847 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d1d94a-c969-4798-8cee-5170cc5dbf09 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:29.717354 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 45/92] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 9 20:10:29 2022] GET /identity/v3/projects/2019f358cc3841408e7d4693c6b8133a => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:10:29.718520 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d1d94a-c969-4798-8cee-5170cc5dbf09 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:29.791496 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e97691-ff52-4925-8bdc-856168f17d53 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:29.835591 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fead2573-b2d9-434e-be96-3d7f04baf280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:29.836323 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead2573-b2d9-434e-be96-3d7f04baf280 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:29.836702 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead2573-b2d9-434e-be96-3d7f04baf280 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:29.837092 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead2573-b2d9-434e-be96-3d7f04baf280 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:29.838026 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fead2573-b2d9-434e-be96-3d7f04baf280 None admin] RBAC: Adding query filter params (role.id=52c0c2910c294965839ef51e91b156a1, scope.project.id=2019f358cc3841408e7d4693c6b8133a, user.id=178306c7b6c64cbfa5ff0a58f91fde9a) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:10:29.838432 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fead2573-b2d9-434e-be96-3d7f04baf280 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:29.840010 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fead2573-b2d9-434e-be96-3d7f04baf280 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:29.844405 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d1d94a-c969-4798-8cee-5170cc5dbf09 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:29.845655 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 48/93] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 9 20:10:29 2022] GET /identity/v3/role_assignments?user.id=178306c7b6c64cbfa5ff0a58f91fde9a&scope.project.id=2019f358cc3841408e7d4693c6b8133a&role.id=52c0c2910c294965839ef51e91b156a1 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:29.846443 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fead2573-b2d9-434e-be96-3d7f04baf280 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:29.940282 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbaba1b-35c2-4f1b-a711-b489bb17aae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:29.940960 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbaba1b-35c2-4f1b-a711-b489bb17aae0 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:29.941861 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbaba1b-35c2-4f1b-a711-b489bb17aae0 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:29.942134 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbaba1b-35c2-4f1b-a711-b489bb17aae0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:30.031130 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbaba1b-35c2-4f1b-a711-b489bb17aae0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:30.032704 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbaba1b-35c2-4f1b-a711-b489bb17aae0 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:30.095561 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fead2573-b2d9-434e-be96-3d7f04baf280 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:30.148147 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 46/94] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 9 20:10:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 20:10:30.154666 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbaba1b-35c2-4f1b-a711-b489bb17aae0 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:30.170556 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f924480c-6830-4110-80a5-2465f7a50705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:30.171224 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924480c-6830-4110-80a5-2465f7a50705 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:30.171531 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924480c-6830-4110-80a5-2465f7a50705 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:30.171812 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924480c-6830-4110-80a5-2465f7a50705 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:30.172647 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f924480c-6830-4110-80a5-2465f7a50705 None admin] RBAC: Adding query filter params (role.id=274130b78e304bb88789c1b349263f3c, scope.project.id=2019f358cc3841408e7d4693c6b8133a, user.id=eda0196f36b948c2b847c376ca98040d) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:10:30.172956 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f924480c-6830-4110-80a5-2465f7a50705 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:30.174389 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f924480c-6830-4110-80a5-2465f7a50705 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:30.186427 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 49/95] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 9 20:10:29 2022] GET /identity/v3/role_assignments?user.id=eda0196f36b948c2b847c376ca98040d&scope.project.id=2019f358cc3841408e7d4693c6b8133a&role.id=274130b78e304bb88789c1b349263f3c => generated 259 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:30.275934 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbaba1b-35c2-4f1b-a711-b489bb17aae0 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:30.311698 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b3cb1e-1860-459f-a513-7b270341c08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:30.312584 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b3cb1e-1860-459f-a513-7b270341c08a None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:30.312864 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b3cb1e-1860-459f-a513-7b270341c08a None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:30.313136 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b3cb1e-1860-459f-a513-7b270341c08a None admin] PATH_INFO: `/v3/projects/4d560e1dd2c742bfbd13e0b7acc3dc8a` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:30.314390 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b3cb1e-1860-459f-a513-7b270341c08a None admin] RBAC: Authorizing `identity:get_project(project_id=4d560e1dd2c742bfbd13e0b7acc3dc8a)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:30.315994 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b3cb1e-1860-459f-a513-7b270341c08a None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:30.318357 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 47/96] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 9 20:10:30 2022] GET /identity/v3/projects/4d560e1dd2c742bfbd13e0b7acc3dc8a => generated 312 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:10:30.324243 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f924480c-6830-4110-80a5-2465f7a50705 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:30.430944 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f924480c-6830-4110-80a5-2465f7a50705 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:30.466890 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c49181e-d011-4308-99a2-d41347a210cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:30.467608 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c49181e-d011-4308-99a2-d41347a210cd None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:30.467898 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c49181e-d011-4308-99a2-d41347a210cd None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:30.468178 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c49181e-d011-4308-99a2-d41347a210cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:30.469026 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c49181e-d011-4308-99a2-d41347a210cd None admin] RBAC: Adding query filter params (role.id=79f90a0bf6ea43d0b3c434e31556253a, scope.project.id=4d560e1dd2c742bfbd13e0b7acc3dc8a, user.id=178306c7b6c64cbfa5ff0a58f91fde9a) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:10:30.469340 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c49181e-d011-4308-99a2-d41347a210cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:30.470801 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c49181e-d011-4308-99a2-d41347a210cd None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:30.477729 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 50/97] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 9 20:10:30 2022] GET /identity/v3/role_assignments?user.id=178306c7b6c64cbfa5ff0a58f91fde9a&scope.project.id=4d560e1dd2c742bfbd13e0b7acc3dc8a&role.id=79f90a0bf6ea43d0b3c434e31556253a => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:31.668590 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ab2cb-f48f-4835-9e6e-d1254a0932e2 None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:31.669100 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ab2cb-f48f-4835-9e6e-d1254a0932e2 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:31.669172 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ab2cb-f48f-4835-9e6e-d1254a0932e2 None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:31.671010 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 48/98] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:10:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:10:31.677160 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d2be38-7a29-4ea8-ad01-3c425cde6867 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:31.678109 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d2be38-7a29-4ea8-ad01-3c425cde6867 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:31.678585 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d2be38-7a29-4ea8-ad01-3c425cde6867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:31.700438 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-96d2be38-7a29-4ea8-ad01-3c425cde6867 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:10:31.701980 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-96d2be38-7a29-4ea8-ad01-3c425cde6867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:10:31.782945 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 51/99] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:10:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 20:10:31.833921 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ab2cb-f48f-4835-9e6e-d1254a0932e2 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:31.945036 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ab2cb-f48f-4835-9e6e-d1254a0932e2 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:31.991056 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de30741-75ba-4827-bdc0-84e436652bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:31.992273 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de30741-75ba-4827-bdc0-84e436652bc3 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:31.992755 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de30741-75ba-4827-bdc0-84e436652bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:31.993222 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de30741-75ba-4827-bdc0-84e436652bc3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:32.009295 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de30741-75ba-4827-bdc0-84e436652bc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:10:32.017272 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-6de30741-75ba-4827-bdc0-84e436652bc3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 20:10:32.017272 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:10:32.017272 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:10:32.017272 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:10:32.017272 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:10:32.017272 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:10:32.017272 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:10:32.017272 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:10:32.017272 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:10:32.017272 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:10:32.017272 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:10:32.017272 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:10:32.017272 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:10:32.017272 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:10:32.017272 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:10:32.017272 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:10:32.018111 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:10:32.018111 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:10:32.018111 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:10:32.018111 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:10:32.018111 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:10:32.018111 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:10:32.018111 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:10:32.018111 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:10:32.018111 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:10:32.018111 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:10:32.018111 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:10:32.018111 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:10:32.018111 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:10:32.018111 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:10:32.018111 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:10:32.018111 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:10:32.018876 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:10:32.018876 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:10:32.018876 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:10:32.018876 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:10:32.018876 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:10:32.018876 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:10:32.018876 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:10:32.018876 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:10:32.018876 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:10:32.018876 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:10:32.018876 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 20:10:32.018876 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:10:32.025498 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 49/100] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 9 20:10:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:10:32.030992 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d2be38-7a29-4ea8-ad01-3c425cde6867 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:32.149651 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d2be38-7a29-4ea8-ad01-3c425cde6867 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:32.190465 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aecd3d7-577d-4d89-acff-ac7a381aec9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:32.191202 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aecd3d7-577d-4d89-acff-ac7a381aec9e None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:32.191518 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aecd3d7-577d-4d89-acff-ac7a381aec9e None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:32.191795 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aecd3d7-577d-4d89-acff-ac7a381aec9e None admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:32.192554 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aecd3d7-577d-4d89-acff-ac7a381aec9e None admin] RBAC: Adding query filter params (name=member) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:10:32.192861 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aecd3d7-577d-4d89-acff-ac7a381aec9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:32.194257 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aecd3d7-577d-4d89-acff-ac7a381aec9e None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:32.202862 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 52/101] 10.222.0.44 () {56 vars in 1101 bytes} [Mon May 9 20:10:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:32.208780 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de30741-75ba-4827-bdc0-84e436652bc3 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:32.313117 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de30741-75ba-4827-bdc0-84e436652bc3 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:32.351423 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d972098-a7c8-474d-8da0-532392aed478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:32.352305 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d972098-a7c8-474d-8da0-532392aed478 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:32.352585 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d972098-a7c8-474d-8da0-532392aed478 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:32.352856 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d972098-a7c8-474d-8da0-532392aed478 None admin] PATH_INFO: `/v3/users/178306c7b6c64cbfa5ff0a58f91fde9a` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:32.354079 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d972098-a7c8-474d-8da0-532392aed478 None admin] RBAC: Authorizing `identity:get_user(user_id=178306c7b6c64cbfa5ff0a58f91fde9a)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:32.355560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d972098-a7c8-474d-8da0-532392aed478 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:32.357207 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 50/102] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 9 20:10:32 2022] GET /identity/v3/users/178306c7b6c64cbfa5ff0a58f91fde9a => generated 275 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:32.362902 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aecd3d7-577d-4d89-acff-ac7a381aec9e None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:32.471537 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aecd3d7-577d-4d89-acff-ac7a381aec9e None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:32.510899 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aa089d-1b8f-4093-bbe2-c255fc94e852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:32.511796 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa089d-1b8f-4093-bbe2-c255fc94e852 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:32.512081 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa089d-1b8f-4093-bbe2-c255fc94e852 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:32.512356 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa089d-1b8f-4093-bbe2-c255fc94e852 None admin] PATH_INFO: `/v3/projects/2019f358cc3841408e7d4693c6b8133a` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:32.513567 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aa089d-1b8f-4093-bbe2-c255fc94e852 None admin] RBAC: Authorizing `identity:get_project(project_id=2019f358cc3841408e7d4693c6b8133a)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:32.515011 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aa089d-1b8f-4093-bbe2-c255fc94e852 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:32.517078 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 53/103] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 9 20:10:32 2022] GET /identity/v3/projects/2019f358cc3841408e7d4693c6b8133a => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:32.522641 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d972098-a7c8-474d-8da0-532392aed478 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:32.644914 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd44cf-d0c0-4741-baf1-1c1a160780e8 None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:32.645749 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd44cf-d0c0-4741-baf1-1c1a160780e8 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:32.646224 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd44cf-d0c0-4741-baf1-1c1a160780e8 None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:32.648509 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 54/104] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:10:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:10:32.655426 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bd4030-f111-4d8d-a8fc-ef4529166381 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:32.655426 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bd4030-f111-4d8d-a8fc-ef4529166381 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:32.655426 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bd4030-f111-4d8d-a8fc-ef4529166381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:32.657927 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d972098-a7c8-474d-8da0-532392aed478 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:32.684805 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-04bd4030-f111-4d8d-a8fc-ef4529166381 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:10:32.686013 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-04bd4030-f111-4d8d-a8fc-ef4529166381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:10:32.718584 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2633f2-5cdf-4f2e-8d9d-8c04f8d2699c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:32.719497 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2633f2-5cdf-4f2e-8d9d-8c04f8d2699c None admin] REQUEST_METHOD: `PUT` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:32.719777 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2633f2-5cdf-4f2e-8d9d-8c04f8d2699c None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:32.720045 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2633f2-5cdf-4f2e-8d9d-8c04f8d2699c None admin] PATH_INFO: `/v3/projects/2019f358cc3841408e7d4693c6b8133a/users/178306c7b6c64cbfa5ff0a58f91fde9a/roles/79f90a0bf6ea43d0b3c434e31556253a` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:32.723575 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2633f2-5cdf-4f2e-8d9d-8c04f8d2699c None admin] RBAC: Authorizing `identity:create_grant(project_id=2019f358cc3841408e7d4693c6b8133a, user_id=178306c7b6c64cbfa5ff0a58f91fde9a, role_id=79f90a0bf6ea43d0b3c434e31556253a)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:32.724967 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2633f2-5cdf-4f2e-8d9d-8c04f8d2699c None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:32.757441 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 51/105] 10.222.0.44 () {58 vars in 1439 bytes} [Mon May 9 20:10:32 2022] PUT /identity/v3/projects/2019f358cc3841408e7d4693c6b8133a/users/178306c7b6c64cbfa5ff0a58f91fde9a/roles/79f90a0bf6ea43d0b3c434e31556253a => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:10:32.793043 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352daa4-e8d5-4501-8617-d9b8f5f2767d None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:32.793331 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352daa4-e8d5-4501-8617-d9b8f5f2767d None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:32.793767 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352daa4-e8d5-4501-8617-d9b8f5f2767d None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:32.795501 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 52/106] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:10:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 20:10:32.802462 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb342c4d-e946-445e-8131-e2f721c38b0d None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:32.803223 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb342c4d-e946-445e-8131-e2f721c38b0d None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:32.803674 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb342c4d-e946-445e-8131-e2f721c38b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:32.809195 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 55/107] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:10:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 20:10:32.823202 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-eb342c4d-e946-445e-8131-e2f721c38b0d None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:10:32.824731 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-eb342c4d-e946-445e-8131-e2f721c38b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:10:32.847668 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bd4030-f111-4d8d-a8fc-ef4529166381 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:32.899833 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 53/108] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:10:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 20:10:32.922935 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb342c4d-e946-445e-8131-e2f721c38b0d None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:33.029996 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb342c4d-e946-445e-8131-e2f721c38b0d None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:33.066555 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e63996f-69dd-4c7b-93cd-97044efc16d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:33.067831 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e63996f-69dd-4c7b-93cd-97044efc16d6 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:33.067946 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bd4030-f111-4d8d-a8fc-ef4529166381 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:33.068353 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e63996f-69dd-4c7b-93cd-97044efc16d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:33.068764 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e63996f-69dd-4c7b-93cd-97044efc16d6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:33.092793 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e63996f-69dd-4c7b-93cd-97044efc16d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:10:33.110081 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-7e63996f-69dd-4c7b-93cd-97044efc16d6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 20:10:33.110081 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:10:33.110081 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:10:33.110081 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:10:33.110081 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:10:33.110081 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:10:33.110081 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:10:33.110081 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:10:33.110081 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:10:33.110081 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:10:33.110081 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:10:33.110081 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:10:33.110081 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:10:33.110081 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:10:33.110081 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:10:33.110081 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:10:33.111146 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:10:33.111146 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:10:33.111146 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:10:33.111146 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:10:33.111146 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:10:33.111146 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:10:33.111146 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:10:33.111146 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:10:33.111146 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:10:33.111146 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:10:33.111146 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:10:33.111146 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:10:33.111146 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:10:33.111146 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:10:33.111146 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:10:33.111146 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:10:33.112062 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:10:33.112062 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:10:33.112062 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:10:33.112062 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:10:33.112062 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:10:33.112062 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:10:33.112062 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:10:33.112062 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:10:33.112062 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:10:33.112062 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:10:33.112062 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 20:10:33.112062 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:10:33.115788 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 54/109] 10.222.0.44 () {56 vars in 1114 bytes} [Mon May 9 20:10:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 20:10:33.132354 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e63996f-69dd-4c7b-93cd-97044efc16d6 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:33.149253 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcafb8e-620f-4245-ad8c-42b175881a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:33.150397 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcafb8e-620f-4245-ad8c-42b175881a4f None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:33.150825 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcafb8e-620f-4245-ad8c-42b175881a4f None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:33.152682 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcafb8e-620f-4245-ad8c-42b175881a4f None admin] PATH_INFO: `/v3/domains/default` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:33.154731 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcafb8e-620f-4245-ad8c-42b175881a4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:33.157043 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcafb8e-620f-4245-ad8c-42b175881a4f None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:33.159205 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 56/110] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:10:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:10:33.165290 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcafb8e-620f-4245-ad8c-42b175881a4f None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:33.249404 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e63996f-69dd-4c7b-93cd-97044efc16d6 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:33.284427 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a201446-5ed9-4d11-ac17-727c929e9bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:33.286018 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a201446-5ed9-4d11-ac17-727c929e9bfb None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:33.286530 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a201446-5ed9-4d11-ac17-727c929e9bfb None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:33.286994 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a201446-5ed9-4d11-ac17-727c929e9bfb None admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:33.287971 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a201446-5ed9-4d11-ac17-727c929e9bfb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:10:33.288471 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a201446-5ed9-4d11-ac17-727c929e9bfb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:33.290253 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a201446-5ed9-4d11-ac17-727c929e9bfb None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:33.298745 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 55/111] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 9 20:10:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:10:33.305283 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a201446-5ed9-4d11-ac17-727c929e9bfb None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:33.379519 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcafb8e-620f-4245-ad8c-42b175881a4f None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:33.447499 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da608f33-723d-485b-bedb-6a3b64a1ff09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:33.448674 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da608f33-723d-485b-bedb-6a3b64a1ff09 None admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:33.449174 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da608f33-723d-485b-bedb-6a3b64a1ff09 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:33.449767 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da608f33-723d-485b-bedb-6a3b64a1ff09 None admin] PATH_INFO: `/v3/projects` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:33.450663 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da608f33-723d-485b-bedb-6a3b64a1ff09 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:33.452455 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da608f33-723d-485b-bedb-6a3b64a1ff09 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:33.486202 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 57/112] 10.222.0.44 () {60 vars in 1141 bytes} [Mon May 9 20:10:33 2022] POST /identity/v3/projects => generated 302 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 20:10:33.488577 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a201446-5ed9-4d11-ac17-727c929e9bfb None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:33.488891 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd60e9f-71d3-4df6-80cf-093d83b8608a None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:33.489380 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd60e9f-71d3-4df6-80cf-093d83b8608a None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:33.489841 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd60e9f-71d3-4df6-80cf-093d83b8608a None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:33.491941 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 58/113] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:10:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:10:33.502078 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89de5b5-dd1a-40c2-ad4f-bbbbb8c84f78 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:33.502688 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89de5b5-dd1a-40c2-ad4f-bbbbb8c84f78 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:33.503241 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89de5b5-dd1a-40c2-ad4f-bbbbb8c84f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:33.538045 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-f89de5b5-dd1a-40c2-ad4f-bbbbb8c84f78 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:10:33.539632 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-f89de5b5-dd1a-40c2-ad4f-bbbbb8c84f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:10:33.599410 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3362ee-6a38-419f-9277-5e4cf3ad3ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:33.600294 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3362ee-6a38-419f-9277-5e4cf3ad3ac3 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:33.600572 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3362ee-6a38-419f-9277-5e4cf3ad3ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:33.600843 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3362ee-6a38-419f-9277-5e4cf3ad3ac3 None admin] PATH_INFO: `/v3/users/178306c7b6c64cbfa5ff0a58f91fde9a` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:33.602042 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3362ee-6a38-419f-9277-5e4cf3ad3ac3 None admin] RBAC: Authorizing `identity:get_user(user_id=178306c7b6c64cbfa5ff0a58f91fde9a)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:33.603512 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3362ee-6a38-419f-9277-5e4cf3ad3ac3 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:33.605454 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 56/114] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 9 20:10:33 2022] GET /identity/v3/users/178306c7b6c64cbfa5ff0a58f91fde9a => generated 275 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:10:33.622461 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3362ee-6a38-419f-9277-5e4cf3ad3ac3 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:33.623456 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 59/115] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:10:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 20:10:33.670430 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89de5b5-dd1a-40c2-ad4f-bbbbb8c84f78 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:33.826739 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3362ee-6a38-419f-9277-5e4cf3ad3ac3 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:33.836947 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89de5b5-dd1a-40c2-ad4f-bbbbb8c84f78 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:33.884714 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bb23bd-469a-48a4-9e19-48ed0145e5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:33.885942 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb23bd-469a-48a4-9e19-48ed0145e5ae None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:33.886444 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb23bd-469a-48a4-9e19-48ed0145e5ae None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:33.886919 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb23bd-469a-48a4-9e19-48ed0145e5ae None admin] PATH_INFO: `/v3/projects/2019f358cc3841408e7d4693c6b8133a` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:33.888965 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bb23bd-469a-48a4-9e19-48ed0145e5ae None admin] RBAC: Authorizing `identity:get_project(project_id=2019f358cc3841408e7d4693c6b8133a)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:33.891298 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bb23bd-469a-48a4-9e19-48ed0145e5ae None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:33.893448 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 57/116] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 9 20:10:33 2022] GET /identity/v3/projects/2019f358cc3841408e7d4693c6b8133a => generated 298 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:10:33.900277 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bb23bd-469a-48a4-9e19-48ed0145e5ae None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:33.904503 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d01b939-c639-4218-a7b3-47f30c77b9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:33.907152 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01b939-c639-4218-a7b3-47f30c77b9f4 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:33.908445 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01b939-c639-4218-a7b3-47f30c77b9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:33.908933 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01b939-c639-4218-a7b3-47f30c77b9f4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:33.926063 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d01b939-c639-4218-a7b3-47f30c77b9f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:10:33.934297 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-4d01b939-c639-4218-a7b3-47f30c77b9f4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 09 20:10:33.934297 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:10:33.934297 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:10:33.934297 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:10:33.934297 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:10:33.934297 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:10:33.934297 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:10:33.934297 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:10:33.934297 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:10:33.934297 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:10:33.934297 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:10:33.934297 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:10:33.934297 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:10:33.934297 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:10:33.934297 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:10:33.934297 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:10:33.935176 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:10:33.935176 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:10:33.935176 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:10:33.935176 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:10:33.935176 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:10:33.935176 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:10:33.935176 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:10:33.935176 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:10:33.935176 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:10:33.935176 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:10:33.935176 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:10:33.935176 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:10:33.935176 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:10:33.935176 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:10:33.935176 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:10:33.935176 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:10:33.936019 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:10:33.936019 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:10:33.936019 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:10:33.936019 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:10:33.936019 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:10:33.936019 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:10:33.936019 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:10:33.936019 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:10:33.936019 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:10:33.936019 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:10:33.936019 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 09 20:10:33.936019 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:10:33.938747 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 60/117] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 9 20:10:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:10:33.940224 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0af10f-efbd-4be8-9744-f26e4578818d None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:33.940731 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0af10f-efbd-4be8-9744-f26e4578818d None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:33.941770 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0af10f-efbd-4be8-9744-f26e4578818d None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:33.943262 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 61/118] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:10:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:10:33.948018 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f9511-a314-4109-906c-a17376ba1ee6 None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:33.948302 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f9511-a314-4109-906c-a17376ba1ee6 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:33.948667 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f9511-a314-4109-906c-a17376ba1ee6 None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:33.950101 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 62/119] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:10:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:10:33.950527 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39f9511-a314-4109-906c-a17376ba1ee6 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:34.019866 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bb23bd-469a-48a4-9e19-48ed0145e5ae None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:34.055811 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041f09b3-56a7-41c7-873a-7b4638eb6c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:34.057280 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f09b3-56a7-41c7-873a-7b4638eb6c46 None admin] REQUEST_METHOD: `PUT` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:34.057561 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f09b3-56a7-41c7-873a-7b4638eb6c46 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:34.057832 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f09b3-56a7-41c7-873a-7b4638eb6c46 None admin] PATH_INFO: `/v3/projects/2019f358cc3841408e7d4693c6b8133a/users/178306c7b6c64cbfa5ff0a58f91fde9a/roles/52c0c2910c294965839ef51e91b156a1` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:34.060665 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041f09b3-56a7-41c7-873a-7b4638eb6c46 None admin] RBAC: Authorizing `identity:create_grant(project_id=2019f358cc3841408e7d4693c6b8133a, user_id=178306c7b6c64cbfa5ff0a58f91fde9a, role_id=52c0c2910c294965839ef51e91b156a1)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:34.062386 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041f09b3-56a7-41c7-873a-7b4638eb6c46 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:34.081390 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 58/120] 10.222.0.44 () {58 vars in 1439 bytes} [Mon May 9 20:10:33 2022] PUT /identity/v3/projects/2019f358cc3841408e7d4693c6b8133a/users/178306c7b6c64cbfa5ff0a58f91fde9a/roles/52c0c2910c294965839ef51e91b156a1 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:10:34.083029 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39f9511-a314-4109-906c-a17376ba1ee6 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:34.088638 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb9e2bc-9b8a-4d64-a99c-e1ad746113b1 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:34.090204 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb9e2bc-9b8a-4d64-a99c-e1ad746113b1 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:34.090736 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb9e2bc-9b8a-4d64-a99c-e1ad746113b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:34.126658 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-6bb9e2bc-9b8a-4d64-a99c-e1ad746113b1 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:10:34.131085 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-6bb9e2bc-9b8a-4d64-a99c-e1ad746113b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:10:34.158895 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5c79bf-b06b-4597-bbc1-6efff95a6d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:34.161168 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c79bf-b06b-4597-bbc1-6efff95a6d57 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:34.161699 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c79bf-b06b-4597-bbc1-6efff95a6d57 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:34.163068 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c79bf-b06b-4597-bbc1-6efff95a6d57 None admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:34.164120 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5c79bf-b06b-4597-bbc1-6efff95a6d57 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:10:34.164890 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5c79bf-b06b-4597-bbc1-6efff95a6d57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:34.167712 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5c79bf-b06b-4597-bbc1-6efff95a6d57 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:34.187208 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 63/121] 10.222.0.44 () {56 vars in 1101 bytes} [Mon May 9 20:10:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:34.193924 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080da41-f6c8-411b-8a8c-981a78b0d3c9 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:34.194698 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080da41-f6c8-411b-8a8c-981a78b0d3c9 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:34.196458 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080da41-f6c8-411b-8a8c-981a78b0d3c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:34.228792 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-8080da41-f6c8-411b-8a8c-981a78b0d3c9 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:10:34.230559 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-8080da41-f6c8-411b-8a8c-981a78b0d3c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:10:34.272874 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 59/122] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:10:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 20:10:34.274173 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb9e2bc-9b8a-4d64-a99c-e1ad746113b1 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:34.348328 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 64/123] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:10:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 20:10:34.349209 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8080da41-f6c8-411b-8a8c-981a78b0d3c9 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:34.403726 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb9e2bc-9b8a-4d64-a99c-e1ad746113b1 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:34.437898 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0534ca96-f4d9-4f7b-b75e-5722c0baf542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:34.438764 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534ca96-f4d9-4f7b-b75e-5722c0baf542 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:34.439042 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534ca96-f4d9-4f7b-b75e-5722c0baf542 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:34.439313 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534ca96-f4d9-4f7b-b75e-5722c0baf542 None admin] PATH_INFO: `/v3/users/e24f61c5e1bf4dc5aee55d87a45b67dc` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:34.452955 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8080da41-f6c8-411b-8a8c-981a78b0d3c9 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:34.453759 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0534ca96-f4d9-4f7b-b75e-5722c0baf542 None admin] RBAC: Authorizing `identity:get_user(user_id=e24f61c5e1bf4dc5aee55d87a45b67dc)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:34.455311 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0534ca96-f4d9-4f7b-b75e-5722c0baf542 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:34.457579 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 60/124] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 9 20:10:34 2022] GET /identity/v3/users/e24f61c5e1bf4dc5aee55d87a45b67dc => generated 289 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:34.458270 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0534ca96-f4d9-4f7b-b75e-5722c0baf542 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:34.489144 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3750eea-b538-44cb-a163-d84c662ffa13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:34.489939 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3750eea-b538-44cb-a163-d84c662ffa13 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:34.490223 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3750eea-b538-44cb-a163-d84c662ffa13 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:34.490498 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3750eea-b538-44cb-a163-d84c662ffa13 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:34.500857 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3750eea-b538-44cb-a163-d84c662ffa13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:10:34.509355 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-e3750eea-b538-44cb-a163-d84c662ffa13 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 20:10:34.509355 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:10:34.509355 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:10:34.509355 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:10:34.509355 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:10:34.509355 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:10:34.509355 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:10:34.509355 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:10:34.509355 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:10:34.509355 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:10:34.509355 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:10:34.509355 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:10:34.509355 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:10:34.509355 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:10:34.509355 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:10:34.509355 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:10:34.510210 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:10:34.510210 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:10:34.510210 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:10:34.510210 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:10:34.510210 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:10:34.510210 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:10:34.510210 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:10:34.510210 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:10:34.510210 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:10:34.510210 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:10:34.510210 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:10:34.510210 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:10:34.510210 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:10:34.510210 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:10:34.510210 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:10:34.510210 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:10:34.510999 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:10:34.510999 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:10:34.510999 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:10:34.510999 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:10:34.510999 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:10:34.510999 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:10:34.510999 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:10:34.510999 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:10:34.510999 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:10:34.510999 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:10:34.510999 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 20:10:34.510999 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:10:34.510999 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 65/125] 10.222.0.44 () {56 vars in 1096 bytes} [Mon May 9 20:10:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:10:34.511659 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3750eea-b538-44cb-a163-d84c662ffa13 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:34.562932 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0534ca96-f4d9-4f7b-b75e-5722c0baf542 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:34.596977 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42713c8d-45f8-4931-8fb4-ecebe957f3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:34.598411 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42713c8d-45f8-4931-8fb4-ecebe957f3cf None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:34.598633 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42713c8d-45f8-4931-8fb4-ecebe957f3cf None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:34.598905 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42713c8d-45f8-4931-8fb4-ecebe957f3cf None admin] PATH_INFO: `/v3/roles/member` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:34.609028 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42713c8d-45f8-4931-8fb4-ecebe957f3cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:10:34.612175 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3750eea-b538-44cb-a163-d84c662ffa13 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:34.617243 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-42713c8d-45f8-4931-8fb4-ecebe957f3cf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 20:10:34.617243 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:10:34.617243 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:10:34.617243 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:10:34.617243 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:10:34.617243 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:10:34.617243 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:10:34.617243 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:10:34.617243 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:10:34.617243 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:10:34.617243 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:10:34.617243 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:10:34.617243 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:10:34.617243 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:10:34.617243 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:10:34.617243 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:10:34.618123 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:10:34.618123 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:10:34.618123 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:10:34.618123 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:10:34.618123 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:10:34.618123 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:10:34.618123 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:10:34.618123 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:10:34.618123 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:10:34.618123 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:10:34.618123 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:10:34.618123 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:10:34.618123 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:10:34.618123 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:10:34.618123 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:10:34.618123 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:10:34.618903 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:10:34.618903 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:10:34.618903 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:10:34.618903 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:10:34.618903 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:10:34.618903 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:10:34.618903 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:10:34.618903 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:10:34.618903 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:10:34.618903 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:10:34.618903 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 20:10:34.618903 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:10:34.618903 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 61/126] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 9 20:10:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:10:34.620145 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42713c8d-45f8-4931-8fb4-ecebe957f3cf None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:34.647317 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3e4770-c1a7-47ca-9ecf-e21009a20039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:34.648059 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e4770-c1a7-47ca-9ecf-e21009a20039 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:34.648346 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e4770-c1a7-47ca-9ecf-e21009a20039 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:34.648623 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e4770-c1a7-47ca-9ecf-e21009a20039 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:34.717691 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3e4770-c1a7-47ca-9ecf-e21009a20039 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:34.718640 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42713c8d-45f8-4931-8fb4-ecebe957f3cf None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:34.719188 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3e4770-c1a7-47ca-9ecf-e21009a20039 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:34.752366 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf6db8e-9138-47e7-9e69-bb7724f8daa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:34.753031 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf6db8e-9138-47e7-9e69-bb7724f8daa2 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:34.753309 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf6db8e-9138-47e7-9e69-bb7724f8daa2 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:34.754278 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf6db8e-9138-47e7-9e69-bb7724f8daa2 None admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:34.755892 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf6db8e-9138-47e7-9e69-bb7724f8daa2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:10:34.755892 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf6db8e-9138-47e7-9e69-bb7724f8daa2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:34.757094 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf6db8e-9138-47e7-9e69-bb7724f8daa2 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:34.765725 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 62/127] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 9 20:10:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:34.766373 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf6db8e-9138-47e7-9e69-bb7724f8daa2 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:34.827438 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 66/128] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 9 20:10:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 20:10:34.832183 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3e4770-c1a7-47ca-9ecf-e21009a20039 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:34.869491 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf6db8e-9138-47e7-9e69-bb7724f8daa2 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:34.902880 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a085f8-d34e-4638-a41e-ac15795b6737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:34.903588 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a085f8-d34e-4638-a41e-ac15795b6737 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:34.903870 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a085f8-d34e-4638-a41e-ac15795b6737 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:34.904140 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a085f8-d34e-4638-a41e-ac15795b6737 None admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:34.904881 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a085f8-d34e-4638-a41e-ac15795b6737 None admin] RBAC: Adding query filter params (name=member) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:10:34.905182 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a085f8-d34e-4638-a41e-ac15795b6737 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:34.906555 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a085f8-d34e-4638-a41e-ac15795b6737 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:34.916190 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 63/129] 10.222.0.44 () {56 vars in 1101 bytes} [Mon May 9 20:10:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:34.917006 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a085f8-d34e-4638-a41e-ac15795b6737 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:34.950222 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3e4770-c1a7-47ca-9ecf-e21009a20039 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:34.984332 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bcc283-a2a0-4be9-a94b-72150a9053e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:34.985202 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bcc283-a2a0-4be9-a94b-72150a9053e9 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:34.985483 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bcc283-a2a0-4be9-a94b-72150a9053e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:34.985756 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bcc283-a2a0-4be9-a94b-72150a9053e9 None admin] PATH_INFO: `/v3/users/eda0196f36b948c2b847c376ca98040d` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:34.986968 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bcc283-a2a0-4be9-a94b-72150a9053e9 None admin] RBAC: Authorizing `identity:get_user(user_id=eda0196f36b948c2b847c376ca98040d)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:34.988537 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bcc283-a2a0-4be9-a94b-72150a9053e9 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:34.990333 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 67/130] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 9 20:10:34 2022] GET /identity/v3/users/eda0196f36b948c2b847c376ca98040d => generated 247 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:34.991055 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bcc283-a2a0-4be9-a94b-72150a9053e9 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:35.013518 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a085f8-d34e-4638-a41e-ac15795b6737 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:35.060111 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba38726-7082-4786-a217-e9b54be2c531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:35.060983 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba38726-7082-4786-a217-e9b54be2c531 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:35.061263 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba38726-7082-4786-a217-e9b54be2c531 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:35.061537 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba38726-7082-4786-a217-e9b54be2c531 None admin] PATH_INFO: `/v3/projects/2019f358cc3841408e7d4693c6b8133a` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:35.062764 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba38726-7082-4786-a217-e9b54be2c531 None admin] RBAC: Authorizing `identity:get_project(project_id=2019f358cc3841408e7d4693c6b8133a)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:35.064256 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba38726-7082-4786-a217-e9b54be2c531 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:35.066334 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 64/131] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 9 20:10:34 2022] GET /identity/v3/projects/2019f358cc3841408e7d4693c6b8133a => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:35.067307 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba38726-7082-4786-a217-e9b54be2c531 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:35.090408 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bcc283-a2a0-4be9-a94b-72150a9053e9 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:35.124745 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37c321a-6dbd-4f71-9eaa-ebfe83b3b259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:35.125652 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c321a-6dbd-4f71-9eaa-ebfe83b3b259 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:35.125936 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c321a-6dbd-4f71-9eaa-ebfe83b3b259 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:35.126256 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c321a-6dbd-4f71-9eaa-ebfe83b3b259 None admin] PATH_INFO: `/v3/users/178306c7b6c64cbfa5ff0a58f91fde9a` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:35.129857 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37c321a-6dbd-4f71-9eaa-ebfe83b3b259 None admin] RBAC: Authorizing `identity:get_user(user_id=178306c7b6c64cbfa5ff0a58f91fde9a)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:35.129857 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37c321a-6dbd-4f71-9eaa-ebfe83b3b259 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:35.131252 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 68/132] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 9 20:10:34 2022] GET /identity/v3/users/178306c7b6c64cbfa5ff0a58f91fde9a => generated 275 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:35.132046 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37c321a-6dbd-4f71-9eaa-ebfe83b3b259 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:35.234314 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37c321a-6dbd-4f71-9eaa-ebfe83b3b259 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:35.269245 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f9929d-4b5c-48a0-b8dc-1c41f26c99df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:35.269916 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f9929d-4b5c-48a0-b8dc-1c41f26c99df None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:35.270200 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f9929d-4b5c-48a0-b8dc-1c41f26c99df None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:35.270475 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f9929d-4b5c-48a0-b8dc-1c41f26c99df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:35.271316 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f9929d-4b5c-48a0-b8dc-1c41f26c99df None admin] RBAC: Adding query filter params (role.id=8957f6409fdf419abdc10d421c213a32, scope.project.id=2019f358cc3841408e7d4693c6b8133a, user.id=e24f61c5e1bf4dc5aee55d87a45b67dc) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:10:35.271660 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f9929d-4b5c-48a0-b8dc-1c41f26c99df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:35.273185 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f9929d-4b5c-48a0-b8dc-1c41f26c99df None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:35.278231 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba38726-7082-4786-a217-e9b54be2c531 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:35.278750 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 69/133] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 9 20:10:35 2022] GET /identity/v3/role_assignments?user.id=e24f61c5e1bf4dc5aee55d87a45b67dc&scope.project.id=2019f358cc3841408e7d4693c6b8133a&role.id=8957f6409fdf419abdc10d421c213a32 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:35.279647 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f9929d-4b5c-48a0-b8dc-1c41f26c99df None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:35.342965 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c93caf-9529-45ff-bf2c-6096eca11d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:35.343880 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c93caf-9529-45ff-bf2c-6096eca11d82 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:35.344255 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c93caf-9529-45ff-bf2c-6096eca11d82 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:35.344545 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c93caf-9529-45ff-bf2c-6096eca11d82 None admin] PATH_INFO: `/v3/projects/2019f358cc3841408e7d4693c6b8133a` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:35.345738 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c93caf-9529-45ff-bf2c-6096eca11d82 None admin] RBAC: Authorizing `identity:get_project(project_id=2019f358cc3841408e7d4693c6b8133a)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:35.347190 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c93caf-9529-45ff-bf2c-6096eca11d82 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:35.349748 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 65/134] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 9 20:10:35 2022] GET /identity/v3/projects/2019f358cc3841408e7d4693c6b8133a => generated 298 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:35.355282 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c93caf-9529-45ff-bf2c-6096eca11d82 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:35.386154 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f9929d-4b5c-48a0-b8dc-1c41f26c99df None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:35.438007 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa179be-9379-4966-a3af-199294ee99cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:35.438888 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa179be-9379-4966-a3af-199294ee99cf None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:35.439174 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa179be-9379-4966-a3af-199294ee99cf None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:35.439469 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa179be-9379-4966-a3af-199294ee99cf None admin] PATH_INFO: `/v3/projects/4d560e1dd2c742bfbd13e0b7acc3dc8a` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:35.442183 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa179be-9379-4966-a3af-199294ee99cf None admin] RBAC: Authorizing `identity:get_project(project_id=4d560e1dd2c742bfbd13e0b7acc3dc8a)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:35.443682 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa179be-9379-4966-a3af-199294ee99cf None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:35.445410 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 70/135] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 9 20:10:35 2022] GET /identity/v3/projects/4d560e1dd2c742bfbd13e0b7acc3dc8a => generated 312 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:35.452894 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa179be-9379-4966-a3af-199294ee99cf None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:35.611275 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c93caf-9529-45ff-bf2c-6096eca11d82 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:35.661153 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa179be-9379-4966-a3af-199294ee99cf None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:35.674735 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9181a528-5d70-4f44-9970-0e0ac02fe33e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:35.676188 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181a528-5d70-4f44-9970-0e0ac02fe33e None admin] REQUEST_METHOD: `PUT` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:35.676513 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181a528-5d70-4f44-9970-0e0ac02fe33e None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:35.676832 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181a528-5d70-4f44-9970-0e0ac02fe33e None admin] PATH_INFO: `/v3/projects/2019f358cc3841408e7d4693c6b8133a/users/eda0196f36b948c2b847c376ca98040d/roles/274130b78e304bb88789c1b349263f3c` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:35.678678 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9181a528-5d70-4f44-9970-0e0ac02fe33e None admin] RBAC: Authorizing `identity:create_grant(project_id=2019f358cc3841408e7d4693c6b8133a, user_id=eda0196f36b948c2b847c376ca98040d, role_id=274130b78e304bb88789c1b349263f3c)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:35.680163 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9181a528-5d70-4f44-9970-0e0ac02fe33e None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:35.703639 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 66/136] 10.222.0.44 () {58 vars in 1439 bytes} [Mon May 9 20:10:35 2022] PUT /identity/v3/projects/2019f358cc3841408e7d4693c6b8133a/users/eda0196f36b948c2b847c376ca98040d/roles/274130b78e304bb88789c1b349263f3c => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:10:35.717390 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767babbc-2253-4de7-8ebd-df2904c7f5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:35.718299 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767babbc-2253-4de7-8ebd-df2904c7f5e0 None admin] REQUEST_METHOD: `PUT` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:35.718576 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767babbc-2253-4de7-8ebd-df2904c7f5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:35.718845 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767babbc-2253-4de7-8ebd-df2904c7f5e0 None admin] PATH_INFO: `/v3/projects/4d560e1dd2c742bfbd13e0b7acc3dc8a/users/178306c7b6c64cbfa5ff0a58f91fde9a/roles/79f90a0bf6ea43d0b3c434e31556253a` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:35.722426 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767babbc-2253-4de7-8ebd-df2904c7f5e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=4d560e1dd2c742bfbd13e0b7acc3dc8a, user_id=178306c7b6c64cbfa5ff0a58f91fde9a, role_id=79f90a0bf6ea43d0b3c434e31556253a)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:35.723932 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767babbc-2253-4de7-8ebd-df2904c7f5e0 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:35.747054 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 71/137] 10.222.0.44 () {58 vars in 1439 bytes} [Mon May 9 20:10:35 2022] PUT /identity/v3/projects/4d560e1dd2c742bfbd13e0b7acc3dc8a/users/178306c7b6c64cbfa5ff0a58f91fde9a/roles/79f90a0bf6ea43d0b3c434e31556253a => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:10:36.267423 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f26a3-ac9c-4da4-b72a-fa9101e47b6d None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:36.267929 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f26a3-ac9c-4da4-b72a-fa9101e47b6d None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:36.268008 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f26a3-ac9c-4da4-b72a-fa9101e47b6d None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:36.270073 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 67/138] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:10:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:10:36.285533 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44218029-3f89-4c1c-b6ab-67b23c5c2693 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:36.286036 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44218029-3f89-4c1c-b6ab-67b23c5c2693 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:36.286148 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44218029-3f89-4c1c-b6ab-67b23c5c2693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:36.312405 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-44218029-3f89-4c1c-b6ab-67b23c5c2693 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:10:36.313597 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-44218029-3f89-4c1c-b6ab-67b23c5c2693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:10:36.400278 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 72/139] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:10:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 20:10:36.438074 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5f26a3-ac9c-4da4-b72a-fa9101e47b6d None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:36.571423 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5f26a3-ac9c-4da4-b72a-fa9101e47b6d None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:36.605789 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d11d1fc-579d-4672-a0ab-eb9063a6d02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:36.606595 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d11d1fc-579d-4672-a0ab-eb9063a6d02e None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:36.606875 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d11d1fc-579d-4672-a0ab-eb9063a6d02e None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:36.607147 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d11d1fc-579d-4672-a0ab-eb9063a6d02e None admin] PATH_INFO: `/v3/roles/member` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:36.619051 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d11d1fc-579d-4672-a0ab-eb9063a6d02e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:10:36.626776 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-6d11d1fc-579d-4672-a0ab-eb9063a6d02e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 20:10:36.626776 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:10:36.626776 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:10:36.626776 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:10:36.626776 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:10:36.626776 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:10:36.626776 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:10:36.626776 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:10:36.626776 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:10:36.626776 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:10:36.626776 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:10:36.626776 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:10:36.626776 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:10:36.626776 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:10:36.626776 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:10:36.626776 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:10:36.627744 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:10:36.627744 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:10:36.627744 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:10:36.627744 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:10:36.627744 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:10:36.627744 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:10:36.627744 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:10:36.627744 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:10:36.627744 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:10:36.627744 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:10:36.627744 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:10:36.627744 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:10:36.627744 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:10:36.627744 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:10:36.627744 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:10:36.627744 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:10:36.628587 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:10:36.628587 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:10:36.628587 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:10:36.628587 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:10:36.628587 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:10:36.628587 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:10:36.628587 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:10:36.628587 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:10:36.628587 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:10:36.628587 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:10:36.628587 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 20:10:36.628587 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:10:36.628587 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 68/140] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 9 20:10:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:10:36.634810 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44218029-3f89-4c1c-b6ab-67b23c5c2693 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:36.749871 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44218029-3f89-4c1c-b6ab-67b23c5c2693 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:36.791800 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6423e471-a5f5-4cd8-81f5-b2e281330712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:36.792493 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423e471-a5f5-4cd8-81f5-b2e281330712 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:36.792819 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423e471-a5f5-4cd8-81f5-b2e281330712 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:36.793098 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423e471-a5f5-4cd8-81f5-b2e281330712 None admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:36.793865 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6423e471-a5f5-4cd8-81f5-b2e281330712 None admin] RBAC: Adding query filter params (name=member) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:10:36.794230 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6423e471-a5f5-4cd8-81f5-b2e281330712 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:36.795828 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6423e471-a5f5-4cd8-81f5-b2e281330712 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:36.807170 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 73/141] 10.222.0.44 () {56 vars in 1101 bytes} [Mon May 9 20:10:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:36.813020 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d11d1fc-579d-4672-a0ab-eb9063a6d02e None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:36.920485 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d11d1fc-579d-4672-a0ab-eb9063a6d02e None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:36.954428 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478bee4e-f3aa-4384-a4e6-d5ea38606716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:36.955289 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478bee4e-f3aa-4384-a4e6-d5ea38606716 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:36.955594 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478bee4e-f3aa-4384-a4e6-d5ea38606716 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:36.955868 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478bee4e-f3aa-4384-a4e6-d5ea38606716 None admin] PATH_INFO: `/v3/users/178306c7b6c64cbfa5ff0a58f91fde9a` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:36.957239 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478bee4e-f3aa-4384-a4e6-d5ea38606716 None admin] RBAC: Authorizing `identity:get_user(user_id=178306c7b6c64cbfa5ff0a58f91fde9a)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:36.958819 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478bee4e-f3aa-4384-a4e6-d5ea38606716 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:36.960860 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 69/142] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 9 20:10:36 2022] GET /identity/v3/users/178306c7b6c64cbfa5ff0a58f91fde9a => generated 275 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:36.966314 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6423e471-a5f5-4cd8-81f5-b2e281330712 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:36.995336 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3b57b-1473-4d3f-8c07-417c36807b48 None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:36.995684 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3b57b-1473-4d3f-8c07-417c36807b48 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:36.995904 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3b57b-1473-4d3f-8c07-417c36807b48 None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:36.997379 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 70/143] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:10:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 20:10:37.002549 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683284f3-9239-458d-aa93-adabd8b6e6ec None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:37.002826 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683284f3-9239-458d-aa93-adabd8b6e6ec None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:37.003100 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683284f3-9239-458d-aa93-adabd8b6e6ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:37.021250 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-683284f3-9239-458d-aa93-adabd8b6e6ec None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:10:37.022073 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-683284f3-9239-458d-aa93-adabd8b6e6ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:10:37.110840 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6423e471-a5f5-4cd8-81f5-b2e281330712 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:37.126162 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 71/144] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:10:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 20:10:37.150547 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527e802f-3b06-4f74-bac9-698ab131d422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:37.151195 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e802f-3b06-4f74-bac9-698ab131d422 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:37.151503 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e802f-3b06-4f74-bac9-698ab131d422 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:37.151779 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e802f-3b06-4f74-bac9-698ab131d422 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:37.187781 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683284f3-9239-458d-aa93-adabd8b6e6ec None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:37.274988 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527e802f-3b06-4f74-bac9-698ab131d422 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:37.280875 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527e802f-3b06-4f74-bac9-698ab131d422 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:37.316453 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683284f3-9239-458d-aa93-adabd8b6e6ec None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:37.356937 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b170aafc-d58e-4eb1-b77e-20f1631af795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:37.358080 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b170aafc-d58e-4eb1-b77e-20f1631af795 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:37.358365 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b170aafc-d58e-4eb1-b77e-20f1631af795 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:37.358706 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b170aafc-d58e-4eb1-b77e-20f1631af795 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:37.360209 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b170aafc-d58e-4eb1-b77e-20f1631af795 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:37.361838 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b170aafc-d58e-4eb1-b77e-20f1631af795 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:37.363806 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 72/145] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:10:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:10:37.369935 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b170aafc-d58e-4eb1-b77e-20f1631af795 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:37.482292 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b170aafc-d58e-4eb1-b77e-20f1631af795 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:37.484052 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 74/146] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 9 20:10:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 20:10:37.500534 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e135146-593c-448e-8c4f-41f676efd2c5 None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:37.501140 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e135146-593c-448e-8c4f-41f676efd2c5 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:37.501638 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e135146-593c-448e-8c4f-41f676efd2c5 None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:37.503207 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 75/147] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:10:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 20:10:37.508483 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e135146-593c-448e-8c4f-41f676efd2c5 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:37.524617 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eecac3-b0ba-4f03-8f80-3b2900f5af04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:37.525287 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eecac3-b0ba-4f03-8f80-3b2900f5af04 None admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:37.525570 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eecac3-b0ba-4f03-8f80-3b2900f5af04 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:37.526195 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eecac3-b0ba-4f03-8f80-3b2900f5af04 None admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:37.526927 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eecac3-b0ba-4f03-8f80-3b2900f5af04 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:37.528918 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eecac3-b0ba-4f03-8f80-3b2900f5af04 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:37.556706 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 73/148] 10.222.0.44 () {60 vars in 1132 bytes} [Mon May 9 20:10:37 2022] POST /identity/v3/users => generated 283 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 20:10:37.557808 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a6631-6864-4ad0-8cb5-4f7fc1bb5910 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:37.558097 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a6631-6864-4ad0-8cb5-4f7fc1bb5910 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:37.558737 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a6631-6864-4ad0-8cb5-4f7fc1bb5910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:37.609017 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-dc3a6631-6864-4ad0-8cb5-4f7fc1bb5910 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:10:37.612164 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-dc3a6631-6864-4ad0-8cb5-4f7fc1bb5910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:10:37.685857 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e135146-593c-448e-8c4f-41f676efd2c5 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:37.751662 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 74/149] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:10:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 20:10:37.754244 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d667f9-f31c-4f9a-b436-1a435fc7f304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:37.756306 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d667f9-f31c-4f9a-b436-1a435fc7f304 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:37.756853 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d667f9-f31c-4f9a-b436-1a435fc7f304 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:37.757334 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d667f9-f31c-4f9a-b436-1a435fc7f304 None admin] PATH_INFO: `/v3/projects/2019f358cc3841408e7d4693c6b8133a` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:37.758854 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d667f9-f31c-4f9a-b436-1a435fc7f304 None admin] RBAC: Authorizing `identity:get_project(project_id=2019f358cc3841408e7d4693c6b8133a)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:37.760662 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d667f9-f31c-4f9a-b436-1a435fc7f304 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:37.762650 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 76/150] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 9 20:10:37 2022] GET /identity/v3/projects/2019f358cc3841408e7d4693c6b8133a => generated 298 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:10:37.768853 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3a6631-6864-4ad0-8cb5-4f7fc1bb5910 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:37.841959 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d667f9-f31c-4f9a-b436-1a435fc7f304 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:37.893985 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3a6631-6864-4ad0-8cb5-4f7fc1bb5910 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:37.929496 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef86f21-5986-4a83-a8d4-986034648bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:37.930513 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef86f21-5986-4a83-a8d4-986034648bda None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:37.931032 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef86f21-5986-4a83-a8d4-986034648bda None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:37.931547 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef86f21-5986-4a83-a8d4-986034648bda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:37.932596 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef86f21-5986-4a83-a8d4-986034648bda None admin] RBAC: Adding query filter params (role.id=79f90a0bf6ea43d0b3c434e31556253a, scope.project.id=2019f358cc3841408e7d4693c6b8133a, user.id=178306c7b6c64cbfa5ff0a58f91fde9a) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:10:37.933128 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef86f21-5986-4a83-a8d4-986034648bda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:37.934954 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef86f21-5986-4a83-a8d4-986034648bda None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:37.942883 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 75/151] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 9 20:10:37 2022] GET /identity/v3/role_assignments?user.id=178306c7b6c64cbfa5ff0a58f91fde9a&scope.project.id=2019f358cc3841408e7d4693c6b8133a&role.id=79f90a0bf6ea43d0b3c434e31556253a => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:38.023207 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d667f9-f31c-4f9a-b436-1a435fc7f304 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:38.073098 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b0748c-f656-4f67-8b0e-f88e855a4993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:38.073935 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b0748c-f656-4f67-8b0e-f88e855a4993 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:38.074212 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b0748c-f656-4f67-8b0e-f88e855a4993 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:38.074483 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b0748c-f656-4f67-8b0e-f88e855a4993 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:38.086744 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b0748c-f656-4f67-8b0e-f88e855a4993 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:10:38.096836 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-17b0748c-f656-4f67-8b0e-f88e855a4993 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 20:10:38.096836 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:10:38.096836 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:10:38.096836 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:10:38.096836 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:10:38.096836 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:10:38.096836 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:10:38.096836 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:10:38.096836 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:10:38.096836 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:10:38.096836 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:10:38.096836 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:10:38.096836 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:10:38.096836 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:10:38.096836 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:10:38.096836 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:10:38.097816 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:10:38.097816 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:10:38.097816 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:10:38.097816 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:10:38.097816 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:10:38.097816 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:10:38.097816 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:10:38.097816 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:10:38.097816 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:10:38.097816 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:10:38.097816 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:10:38.097816 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:10:38.097816 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:10:38.097816 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:10:38.097816 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:10:38.097816 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:10:38.098590 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:10:38.098590 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:10:38.098590 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:10:38.098590 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:10:38.098590 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:10:38.098590 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:10:38.098590 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:10:38.098590 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:10:38.098590 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:10:38.098590 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:10:38.098590 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 20:10:38.098590 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:10:38.099190 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 77/152] 10.222.0.44 () {56 vars in 1114 bytes} [Mon May 9 20:10:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 20:10:38.104708 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef86f21-5986-4a83-a8d4-986034648bda None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:38.228399 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef86f21-5986-4a83-a8d4-986034648bda None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:38.265530 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5217261-d49b-418e-993f-24c5c322fd4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:38.266200 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5217261-d49b-418e-993f-24c5c322fd4b None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:38.266475 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5217261-d49b-418e-993f-24c5c322fd4b None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:38.266883 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5217261-d49b-418e-993f-24c5c322fd4b None admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:38.267750 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5217261-d49b-418e-993f-24c5c322fd4b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:10:38.268052 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5217261-d49b-418e-993f-24c5c322fd4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:38.269749 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5217261-d49b-418e-993f-24c5c322fd4b None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:38.278148 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 76/153] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 9 20:10:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:38.283617 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b0748c-f656-4f67-8b0e-f88e855a4993 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:38.327061 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3485d8-945f-44b1-986a-7a32b4037891 None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:38.327592 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3485d8-945f-44b1-986a-7a32b4037891 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:38.327667 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3485d8-945f-44b1-986a-7a32b4037891 None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:38.329013 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 77/154] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:10:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:10:38.334577 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f271595c-6188-4e98-9495-5f49910dd294 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:38.334858 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f271595c-6188-4e98-9495-5f49910dd294 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:38.335127 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f271595c-6188-4e98-9495-5f49910dd294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:38.360990 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-f271595c-6188-4e98-9495-5f49910dd294 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:10:38.362182 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-f271595c-6188-4e98-9495-5f49910dd294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:10:38.410989 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b0748c-f656-4f67-8b0e-f88e855a4993 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:38.450613 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e0d76b-5039-4bdd-a3e7-bc2428cc73b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:38.451603 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0d76b-5039-4bdd-a3e7-bc2428cc73b3 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:38.451929 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0d76b-5039-4bdd-a3e7-bc2428cc73b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:38.452162 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0d76b-5039-4bdd-a3e7-bc2428cc73b3 None admin] PATH_INFO: `/v3/users/178306c7b6c64cbfa5ff0a58f91fde9a` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:38.453438 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e0d76b-5039-4bdd-a3e7-bc2428cc73b3 None admin] RBAC: Authorizing `identity:get_user(user_id=178306c7b6c64cbfa5ff0a58f91fde9a)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:38.454960 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e0d76b-5039-4bdd-a3e7-bc2428cc73b3 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:38.457379 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 78/155] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 9 20:10:38 2022] GET /identity/v3/users/178306c7b6c64cbfa5ff0a58f91fde9a => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:38.462891 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e0d76b-5039-4bdd-a3e7-bc2428cc73b3 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:38.489214 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 78/156] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:10:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 20:10:38.518733 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f271595c-6188-4e98-9495-5f49910dd294 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:38.582950 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e0d76b-5039-4bdd-a3e7-bc2428cc73b3 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:38.626450 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4130acad-d6e8-4934-891e-66277607a772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:38.627108 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4130acad-d6e8-4934-891e-66277607a772 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:38.627409 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4130acad-d6e8-4934-891e-66277607a772 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:38.627755 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4130acad-d6e8-4934-891e-66277607a772 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:38.642046 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f271595c-6188-4e98-9495-5f49910dd294 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:38.682414 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2fb782-05cb-4b85-aeb5-159298cafd9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:38.683206 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2fb782-05cb-4b85-aeb5-159298cafd9b None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:38.683686 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2fb782-05cb-4b85-aeb5-159298cafd9b None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:38.683963 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2fb782-05cb-4b85-aeb5-159298cafd9b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:38.707027 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2fb782-05cb-4b85-aeb5-159298cafd9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:10:38.714971 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-5c2fb782-05cb-4b85-aeb5-159298cafd9b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 09 20:10:38.714971 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:10:38.714971 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:10:38.714971 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:10:38.714971 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:10:38.714971 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:10:38.714971 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:10:38.714971 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:10:38.714971 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:10:38.714971 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:10:38.714971 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:10:38.714971 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:10:38.714971 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:10:38.714971 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:10:38.714971 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:10:38.714971 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:10:38.715892 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:10:38.715892 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:10:38.715892 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:10:38.715892 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:10:38.715892 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:10:38.715892 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:10:38.715892 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:10:38.715892 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:10:38.715892 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:10:38.715892 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:10:38.715892 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:10:38.715892 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:10:38.715892 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:10:38.715892 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:10:38.715892 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:10:38.715892 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:10:38.716677 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:10:38.716677 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:10:38.716677 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:10:38.716677 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:10:38.716677 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:10:38.716677 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:10:38.716677 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:10:38.716677 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:10:38.716677 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:10:38.716677 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:10:38.716677 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 09 20:10:38.716677 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:10:38.721830 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 79/157] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 9 20:10:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 20:10:38.725609 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4130acad-d6e8-4934-891e-66277607a772 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:38.727632 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4130acad-d6e8-4934-891e-66277607a772 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:38.728326 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2fb782-05cb-4b85-aeb5-159298cafd9b None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:38.832091 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 79/158] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 9 20:10:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 09 20:10:38.838001 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4130acad-d6e8-4934-891e-66277607a772 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:38.871442 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2fb782-05cb-4b85-aeb5-159298cafd9b None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:38.912185 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a19352-3f06-4f05-9b3f-f895409b47f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:38.912875 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a19352-3f06-4f05-9b3f-f895409b47f3 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:38.913153 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a19352-3f06-4f05-9b3f-f895409b47f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:38.913422 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a19352-3f06-4f05-9b3f-f895409b47f3 None admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:38.914184 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a19352-3f06-4f05-9b3f-f895409b47f3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:10:38.914502 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a19352-3f06-4f05-9b3f-f895409b47f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:38.915923 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a19352-3f06-4f05-9b3f-f895409b47f3 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:38.925043 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 80/159] 10.222.0.44 () {56 vars in 1101 bytes} [Mon May 9 20:10:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:10:38.932233 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a19352-3f06-4f05-9b3f-f895409b47f3 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:38.952752 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4130acad-d6e8-4934-891e-66277607a772 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:38.994954 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b5b3dd-fc0e-46c6-8f7b-2a74065d7eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:38.996206 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5b3dd-fc0e-46c6-8f7b-2a74065d7eeb None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:38.996724 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5b3dd-fc0e-46c6-8f7b-2a74065d7eeb None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:38.997203 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5b3dd-fc0e-46c6-8f7b-2a74065d7eeb None admin] PATH_INFO: `/v3/projects/2019f358cc3841408e7d4693c6b8133a` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:39.004229 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b5b3dd-fc0e-46c6-8f7b-2a74065d7eeb None admin] RBAC: Authorizing `identity:get_project(project_id=2019f358cc3841408e7d4693c6b8133a)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:39.006328 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b5b3dd-fc0e-46c6-8f7b-2a74065d7eeb None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:39.008367 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 80/160] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 9 20:10:38 2022] GET /identity/v3/projects/2019f358cc3841408e7d4693c6b8133a => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:10:39.014245 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b5b3dd-fc0e-46c6-8f7b-2a74065d7eeb None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:39.052197 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a19352-3f06-4f05-9b3f-f895409b47f3 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:39.093600 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5a9ce4-6dea-4234-ba63-8eec99ae6aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:39.094408 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a9ce4-6dea-4234-ba63-8eec99ae6aec None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:39.094687 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a9ce4-6dea-4234-ba63-8eec99ae6aec None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:39.094955 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a9ce4-6dea-4234-ba63-8eec99ae6aec None admin] PATH_INFO: `/v3/users/e24f61c5e1bf4dc5aee55d87a45b67dc` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:39.100219 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5a9ce4-6dea-4234-ba63-8eec99ae6aec None admin] RBAC: Authorizing `identity:get_user(user_id=e24f61c5e1bf4dc5aee55d87a45b67dc)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:39.101707 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5a9ce4-6dea-4234-ba63-8eec99ae6aec None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:39.103435 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 81/161] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 9 20:10:38 2022] GET /identity/v3/users/e24f61c5e1bf4dc5aee55d87a45b67dc => generated 289 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:10:39.109304 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5a9ce4-6dea-4234-ba63-8eec99ae6aec None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:39.121664 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b5b3dd-fc0e-46c6-8f7b-2a74065d7eeb None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:39.161670 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72504c3-91d6-4e23-9a67-d2c3bd0b1b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:39.162760 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72504c3-91d6-4e23-9a67-d2c3bd0b1b85 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:39.164032 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72504c3-91d6-4e23-9a67-d2c3bd0b1b85 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:39.164518 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72504c3-91d6-4e23-9a67-d2c3bd0b1b85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:39.171090 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72504c3-91d6-4e23-9a67-d2c3bd0b1b85 None admin] RBAC: Adding query filter params (role.id=52c0c2910c294965839ef51e91b156a1, scope.project.id=2019f358cc3841408e7d4693c6b8133a, user.id=178306c7b6c64cbfa5ff0a58f91fde9a) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:10:39.171700 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72504c3-91d6-4e23-9a67-d2c3bd0b1b85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:39.173408 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72504c3-91d6-4e23-9a67-d2c3bd0b1b85 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:39.184554 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 81/162] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 9 20:10:39 2022] GET /identity/v3/role_assignments?user.id=178306c7b6c64cbfa5ff0a58f91fde9a&scope.project.id=2019f358cc3841408e7d4693c6b8133a&role.id=52c0c2910c294965839ef51e91b156a1 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:10:39.249674 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5a9ce4-6dea-4234-ba63-8eec99ae6aec None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:39.286338 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3913c0-7b36-4d11-ab2b-ac2581279704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:39.287616 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3913c0-7b36-4d11-ab2b-ac2581279704 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:39.288112 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3913c0-7b36-4d11-ab2b-ac2581279704 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:39.288600 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3913c0-7b36-4d11-ab2b-ac2581279704 None admin] PATH_INFO: `/v3/projects/2019f358cc3841408e7d4693c6b8133a` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:39.290019 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3913c0-7b36-4d11-ab2b-ac2581279704 None admin] RBAC: Authorizing `identity:get_project(project_id=2019f358cc3841408e7d4693c6b8133a)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:39.291750 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3913c0-7b36-4d11-ab2b-ac2581279704 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:39.293678 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 82/163] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 9 20:10:39 2022] GET /identity/v3/projects/2019f358cc3841408e7d4693c6b8133a => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:10:39.301659 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72504c3-91d6-4e23-9a67-d2c3bd0b1b85 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:39.357252 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c412605-2237-485f-9e08-10a51e3eacc0 None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:39.358326 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c412605-2237-485f-9e08-10a51e3eacc0 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:39.358816 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c412605-2237-485f-9e08-10a51e3eacc0 None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:39.360511 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 83/164] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:10:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:10:39.366851 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27a32d-4ce9-43d9-b0d2-1310abc90947 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:39.367447 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27a32d-4ce9-43d9-b0d2-1310abc90947 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:39.367927 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27a32d-4ce9-43d9-b0d2-1310abc90947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:39.395933 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-0e27a32d-4ce9-43d9-b0d2-1310abc90947 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:10:39.397625 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-0e27a32d-4ce9-43d9-b0d2-1310abc90947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:10:39.470781 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72504c3-91d6-4e23-9a67-d2c3bd0b1b85 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:39.508781 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 84/165] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:10:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 20:10:39.537261 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df65dd-bec8-491f-ade0-4eeafe7929fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:39.538177 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df65dd-bec8-491f-ade0-4eeafe7929fc None admin] REQUEST_METHOD: `PUT` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:39.538454 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df65dd-bec8-491f-ade0-4eeafe7929fc None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:39.538721 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df65dd-bec8-491f-ade0-4eeafe7929fc None admin] PATH_INFO: `/v3/projects/2019f358cc3841408e7d4693c6b8133a/users/e24f61c5e1bf4dc5aee55d87a45b67dc/roles/8957f6409fdf419abdc10d421c213a32` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:39.540826 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0df65dd-bec8-491f-ade0-4eeafe7929fc None admin] RBAC: Authorizing `identity:create_grant(project_id=2019f358cc3841408e7d4693c6b8133a, user_id=e24f61c5e1bf4dc5aee55d87a45b67dc, role_id=8957f6409fdf419abdc10d421c213a32)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:39.542293 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0df65dd-bec8-491f-ade0-4eeafe7929fc None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:39.556423 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e27a32d-4ce9-43d9-b0d2-1310abc90947 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:39.570436 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 82/166] 10.222.0.44 () {58 vars in 1439 bytes} [Mon May 9 20:10:39 2022] PUT /identity/v3/projects/2019f358cc3841408e7d4693c6b8133a/users/e24f61c5e1bf4dc5aee55d87a45b67dc/roles/8957f6409fdf419abdc10d421c213a32 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:10:39.695681 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e27a32d-4ce9-43d9-b0d2-1310abc90947 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:39.739252 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50026cd-3ac6-4609-8790-03b4fbf64a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:39.740086 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50026cd-3ac6-4609-8790-03b4fbf64a55 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:39.740362 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50026cd-3ac6-4609-8790-03b4fbf64a55 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:39.740623 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50026cd-3ac6-4609-8790-03b4fbf64a55 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:39.760363 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50026cd-3ac6-4609-8790-03b4fbf64a55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:10:39.767970 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-d50026cd-3ac6-4609-8790-03b4fbf64a55 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 20:10:39.767970 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:10:39.767970 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:10:39.767970 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:10:39.767970 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:10:39.767970 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:10:39.767970 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:10:39.767970 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:10:39.767970 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:10:39.767970 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:10:39.767970 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:10:39.767970 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:10:39.767970 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:10:39.767970 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:10:39.767970 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:10:39.767970 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:10:39.768828 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:10:39.768828 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:10:39.768828 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:10:39.768828 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:10:39.768828 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:10:39.768828 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:10:39.768828 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:10:39.768828 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:10:39.768828 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:10:39.768828 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:10:39.768828 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:10:39.768828 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:10:39.768828 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:10:39.768828 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:10:39.768828 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:10:39.768828 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:10:39.769667 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:10:39.769667 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:10:39.769667 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:10:39.769667 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:10:39.769667 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:10:39.769667 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:10:39.769667 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:10:39.769667 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:10:39.769667 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:10:39.769667 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:10:39.769667 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 20:10:39.769667 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:10:39.769667 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 85/167] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 9 20:10:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:10:39.775645 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df65dd-bec8-491f-ade0-4eeafe7929fc None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:39.892494 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df65dd-bec8-491f-ade0-4eeafe7929fc None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:39.899282 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a215c9b8-705b-4fbd-86b6-db9404265b83 None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:39.899615 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a215c9b8-705b-4fbd-86b6-db9404265b83 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:39.899849 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a215c9b8-705b-4fbd-86b6-db9404265b83 None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:39.901372 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 86/168] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:10:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:10:39.907171 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00434be5-ad47-4acb-8de4-1f638aa550f3 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:39.907527 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00434be5-ad47-4acb-8de4-1f638aa550f3 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:39.907729 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00434be5-ad47-4acb-8de4-1f638aa550f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:39.940407 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-00434be5-ad47-4acb-8de4-1f638aa550f3 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:10:39.942767 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-00434be5-ad47-4acb-8de4-1f638aa550f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:10:39.952682 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce5e360-2f80-4ec8-9734-878b83dbb298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:39.953368 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5e360-2f80-4ec8-9734-878b83dbb298 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:39.953646 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5e360-2f80-4ec8-9734-878b83dbb298 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:39.953914 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5e360-2f80-4ec8-9734-878b83dbb298 None admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:39.954665 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce5e360-2f80-4ec8-9734-878b83dbb298 None admin] RBAC: Adding query filter params (name=member) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:10:39.954964 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce5e360-2f80-4ec8-9734-878b83dbb298 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:39.956360 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce5e360-2f80-4ec8-9734-878b83dbb298 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:39.965161 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 83/169] 10.222.0.44 () {56 vars in 1101 bytes} [Mon May 9 20:10:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:39.973308 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce5e360-2f80-4ec8-9734-878b83dbb298 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:40.043635 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 87/170] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:10:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 20:10:40.103248 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce5e360-2f80-4ec8-9734-878b83dbb298 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:40.108790 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00434be5-ad47-4acb-8de4-1f638aa550f3 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:40.175940 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0718f631-0d3f-44f2-9125-f0cf9bdab2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:40.176995 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718f631-0d3f-44f2-9125-f0cf9bdab2f3 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:40.177276 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718f631-0d3f-44f2-9125-f0cf9bdab2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:40.177549 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718f631-0d3f-44f2-9125-f0cf9bdab2f3 None admin] PATH_INFO: `/v3/users/178306c7b6c64cbfa5ff0a58f91fde9a` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:40.179478 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0718f631-0d3f-44f2-9125-f0cf9bdab2f3 None admin] RBAC: Authorizing `identity:get_user(user_id=178306c7b6c64cbfa5ff0a58f91fde9a)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:40.180940 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0718f631-0d3f-44f2-9125-f0cf9bdab2f3 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:40.182758 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 84/171] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 9 20:10:39 2022] GET /identity/v3/users/178306c7b6c64cbfa5ff0a58f91fde9a => generated 275 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:40.188783 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0718f631-0d3f-44f2-9125-f0cf9bdab2f3 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:40.267153 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00434be5-ad47-4acb-8de4-1f638aa550f3 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:40.328110 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67a73c3-607d-4697-9903-b370ced1fd29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:40.329432 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a73c3-607d-4697-9903-b370ced1fd29 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:40.329723 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a73c3-607d-4697-9903-b370ced1fd29 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:40.330130 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a73c3-607d-4697-9903-b370ced1fd29 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:40.352612 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67a73c3-607d-4697-9903-b370ced1fd29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:10:40.361029 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-c67a73c3-607d-4697-9903-b370ced1fd29 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 20:10:40.361029 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:10:40.361029 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:10:40.361029 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:10:40.361029 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:10:40.361029 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:10:40.361029 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:10:40.361029 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:10:40.361029 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:10:40.361029 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:10:40.361029 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:10:40.361029 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:10:40.361029 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:10:40.361029 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:10:40.361029 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:10:40.361029 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:10:40.362339 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:10:40.362339 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:10:40.362339 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:10:40.362339 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:10:40.362339 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:10:40.362339 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:10:40.362339 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:10:40.362339 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:10:40.362339 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:10:40.362339 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:10:40.362339 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:10:40.362339 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:10:40.362339 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:10:40.362339 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:10:40.362339 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:10:40.362339 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:10:40.365323 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:10:40.365323 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:10:40.365323 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:10:40.365323 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:10:40.365323 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:10:40.365323 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:10:40.365323 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:10:40.365323 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:10:40.365323 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:10:40.365323 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:10:40.365323 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 20:10:40.365323 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:10:40.371723 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 88/172] 10.222.0.44 () {56 vars in 1096 bytes} [Mon May 9 20:10:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 20:10:40.372637 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67a73c3-607d-4697-9903-b370ced1fd29 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:40.413332 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0718f631-0d3f-44f2-9125-f0cf9bdab2f3 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:40.490392 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a4ac60-ad6e-4af0-a12a-16af6e55a874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:40.491087 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a4ac60-ad6e-4af0-a12a-16af6e55a874 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:40.491374 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a4ac60-ad6e-4af0-a12a-16af6e55a874 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:40.491690 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a4ac60-ad6e-4af0-a12a-16af6e55a874 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:40.552220 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67a73c3-607d-4697-9903-b370ced1fd29 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:40.611930 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e5c530-af09-4bc0-8f11-eacc287f0b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:40.613104 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e5c530-af09-4bc0-8f11-eacc287f0b95 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:40.613384 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e5c530-af09-4bc0-8f11-eacc287f0b95 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:40.613652 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e5c530-af09-4bc0-8f11-eacc287f0b95 None admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:40.614401 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e5c530-af09-4bc0-8f11-eacc287f0b95 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:10:40.614698 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e5c530-af09-4bc0-8f11-eacc287f0b95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:40.616580 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e5c530-af09-4bc0-8f11-eacc287f0b95 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:40.634677 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 89/173] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 9 20:10:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:10:40.635387 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a4ac60-ad6e-4af0-a12a-16af6e55a874 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:40.636881 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a4ac60-ad6e-4af0-a12a-16af6e55a874 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:40.665271 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e5c530-af09-4bc0-8f11-eacc287f0b95 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:40.776267 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e5c530-af09-4bc0-8f11-eacc287f0b95 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:40.812386 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f80a53-5009-43db-9d82-749c284d958c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:40.813596 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f80a53-5009-43db-9d82-749c284d958c None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:40.813882 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f80a53-5009-43db-9d82-749c284d958c None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:40.814150 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f80a53-5009-43db-9d82-749c284d958c None admin] PATH_INFO: `/v3/users/eda0196f36b948c2b847c376ca98040d` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:40.815347 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f80a53-5009-43db-9d82-749c284d958c None admin] RBAC: Authorizing `identity:get_user(user_id=eda0196f36b948c2b847c376ca98040d)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:40.817222 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f80a53-5009-43db-9d82-749c284d958c None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:40.818855 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 90/174] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 9 20:10:40 2022] GET /identity/v3/users/eda0196f36b948c2b847c376ca98040d => generated 247 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:10:40.824125 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f80a53-5009-43db-9d82-749c284d958c None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:40.847845 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 85/175] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 9 20:10:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 659 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 20:10:40.854057 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a4ac60-ad6e-4af0-a12a-16af6e55a874 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:40.934319 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f80a53-5009-43db-9d82-749c284d958c None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:40.968461 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b799b0-ab14-489f-bbc5-0b97e55202d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:40.969481 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b799b0-ab14-489f-bbc5-0b97e55202d4 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:40.969960 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b799b0-ab14-489f-bbc5-0b97e55202d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:40.970444 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b799b0-ab14-489f-bbc5-0b97e55202d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:41.033270 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a4ac60-ad6e-4af0-a12a-16af6e55a874 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:41.038842 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b799b0-ab14-489f-bbc5-0b97e55202d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:41.040726 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b799b0-ab14-489f-bbc5-0b97e55202d4 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:41.086908 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42aba27-c05f-4032-8001-4727f4743b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:41.088027 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42aba27-c05f-4032-8001-4727f4743b2e None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:41.088441 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42aba27-c05f-4032-8001-4727f4743b2e None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:41.088867 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42aba27-c05f-4032-8001-4727f4743b2e None admin] PATH_INFO: `/v3/projects/4d560e1dd2c742bfbd13e0b7acc3dc8a` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:41.090200 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42aba27-c05f-4032-8001-4727f4743b2e None admin] RBAC: Authorizing `identity:get_project(project_id=4d560e1dd2c742bfbd13e0b7acc3dc8a)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:41.091839 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42aba27-c05f-4032-8001-4727f4743b2e None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:41.099803 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 86/176] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 9 20:10:40 2022] GET /identity/v3/projects/4d560e1dd2c742bfbd13e0b7acc3dc8a => generated 312 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:10:41.100899 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42aba27-c05f-4032-8001-4727f4743b2e None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:41.140974 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 91/177] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 9 20:10:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 09 20:10:41.142666 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d139349a-608a-420c-8270-ba38afbefe35 None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:41.143169 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d139349a-608a-420c-8270-ba38afbefe35 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:41.143750 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d139349a-608a-420c-8270-ba38afbefe35 None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:41.150292 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 92/178] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:10:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:10:41.151756 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff00a7-446a-410f-870e-51cb783c48f4 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:41.152232 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff00a7-446a-410f-870e-51cb783c48f4 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:41.152690 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff00a7-446a-410f-870e-51cb783c48f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:41.169138 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-8fff00a7-446a-410f-870e-51cb783c48f4 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:10:41.170615 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-8fff00a7-446a-410f-870e-51cb783c48f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:10:41.236930 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 93/179] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:10:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 20:10:41.238267 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff00a7-446a-410f-870e-51cb783c48f4 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:41.249211 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42aba27-c05f-4032-8001-4727f4743b2e None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:41.283664 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ac8b0c-325b-4132-bdc2-da76aa0046a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:41.285188 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac8b0c-325b-4132-bdc2-da76aa0046a0 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:41.285649 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac8b0c-325b-4132-bdc2-da76aa0046a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:41.286297 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac8b0c-325b-4132-bdc2-da76aa0046a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:41.287310 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ac8b0c-325b-4132-bdc2-da76aa0046a0 None admin] RBAC: Adding query filter params (role.id=79f90a0bf6ea43d0b3c434e31556253a, scope.project.id=4d560e1dd2c742bfbd13e0b7acc3dc8a, user.id=178306c7b6c64cbfa5ff0a58f91fde9a) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:10:41.287842 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ac8b0c-325b-4132-bdc2-da76aa0046a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:41.289470 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ac8b0c-325b-4132-bdc2-da76aa0046a0 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:41.295663 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 87/180] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 9 20:10:41 2022] GET /identity/v3/role_assignments?user.id=178306c7b6c64cbfa5ff0a58f91fde9a&scope.project.id=4d560e1dd2c742bfbd13e0b7acc3dc8a&role.id=79f90a0bf6ea43d0b3c434e31556253a => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:41.296648 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ac8b0c-325b-4132-bdc2-da76aa0046a0 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:41.339128 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff00a7-446a-410f-870e-51cb783c48f4 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:41.376241 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaa5c22-428f-4741-a00c-6503d58864fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:41.377883 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa5c22-428f-4741-a00c-6503d58864fd None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:41.378975 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa5c22-428f-4741-a00c-6503d58864fd None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:41.379470 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa5c22-428f-4741-a00c-6503d58864fd None admin] PATH_INFO: `/v3/projects/2019f358cc3841408e7d4693c6b8133a` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:41.381361 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaa5c22-428f-4741-a00c-6503d58864fd None admin] RBAC: Authorizing `identity:get_project(project_id=2019f358cc3841408e7d4693c6b8133a)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:41.383054 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaa5c22-428f-4741-a00c-6503d58864fd None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:41.385041 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 94/181] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 9 20:10:41 2022] GET /identity/v3/projects/2019f358cc3841408e7d4693c6b8133a => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:41.390881 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaa5c22-428f-4741-a00c-6503d58864fd None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:41.400680 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ac8b0c-325b-4132-bdc2-da76aa0046a0 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:41.436777 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1044c9-be25-4bcd-8b6c-e4c10bb3fc24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:41.437973 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1044c9-be25-4bcd-8b6c-e4c10bb3fc24 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:41.438460 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1044c9-be25-4bcd-8b6c-e4c10bb3fc24 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:41.438938 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1044c9-be25-4bcd-8b6c-e4c10bb3fc24 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:41.450310 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1044c9-be25-4bcd-8b6c-e4c10bb3fc24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:10:41.458914 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-1b1044c9-be25-4bcd-8b6c-e4c10bb3fc24 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 20:10:41.458914 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:10:41.458914 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:10:41.458914 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:10:41.458914 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:10:41.458914 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:10:41.458914 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:10:41.458914 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:10:41.458914 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:10:41.458914 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:10:41.458914 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:10:41.458914 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:10:41.458914 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:10:41.458914 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:10:41.458914 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:10:41.458914 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:10:41.460082 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:10:41.460082 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:10:41.460082 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:10:41.460082 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:10:41.460082 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:10:41.460082 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:10:41.460082 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:10:41.460082 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:10:41.460082 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:10:41.460082 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:10:41.460082 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:10:41.460082 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:10:41.460082 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:10:41.460082 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:10:41.460082 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:10:41.460082 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:10:41.460871 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:10:41.460871 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:10:41.460871 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:10:41.460871 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:10:41.460871 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:10:41.460871 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:10:41.460871 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:10:41.460871 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:10:41.460871 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:10:41.460871 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:10:41.460871 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 20:10:41.460871 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:10:41.463254 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 88/182] 10.222.0.44 () {56 vars in 1096 bytes} [Mon May 9 20:10:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:10:41.473142 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1044c9-be25-4bcd-8b6c-e4c10bb3fc24 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:41.497221 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaa5c22-428f-4741-a00c-6503d58864fd None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:41.531704 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8516d09f-52c9-49cf-9b9e-995b13e1ee81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:41.532397 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8516d09f-52c9-49cf-9b9e-995b13e1ee81 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:41.532672 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8516d09f-52c9-49cf-9b9e-995b13e1ee81 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:41.532939 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8516d09f-52c9-49cf-9b9e-995b13e1ee81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:41.533784 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8516d09f-52c9-49cf-9b9e-995b13e1ee81 None admin] RBAC: Adding query filter params (role.id=274130b78e304bb88789c1b349263f3c, scope.project.id=2019f358cc3841408e7d4693c6b8133a, user.id=eda0196f36b948c2b847c376ca98040d) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:10:41.534091 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8516d09f-52c9-49cf-9b9e-995b13e1ee81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:41.536457 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8516d09f-52c9-49cf-9b9e-995b13e1ee81 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:41.542961 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 95/183] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 9 20:10:41 2022] GET /identity/v3/role_assignments?user.id=eda0196f36b948c2b847c376ca98040d&scope.project.id=2019f358cc3841408e7d4693c6b8133a&role.id=274130b78e304bb88789c1b349263f3c => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:10:41.682377 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1044c9-be25-4bcd-8b6c-e4c10bb3fc24 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:41.730156 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3a476e-0c87-44bf-88f4-790830fff541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:41.730877 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a476e-0c87-44bf-88f4-790830fff541 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:41.731162 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a476e-0c87-44bf-88f4-790830fff541 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:41.731460 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a476e-0c87-44bf-88f4-790830fff541 None admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:41.732252 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3a476e-0c87-44bf-88f4-790830fff541 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:10:41.732558 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3a476e-0c87-44bf-88f4-790830fff541 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:41.733990 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3a476e-0c87-44bf-88f4-790830fff541 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:41.747650 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 89/184] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 9 20:10:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:41.753504 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8516d09f-52c9-49cf-9b9e-995b13e1ee81 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:41.875365 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8516d09f-52c9-49cf-9b9e-995b13e1ee81 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:41.917987 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26f84c9-1c5a-4f82-992e-1609997f91d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:41.918861 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f84c9-1c5a-4f82-992e-1609997f91d8 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:41.919137 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f84c9-1c5a-4f82-992e-1609997f91d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:41.919418 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f84c9-1c5a-4f82-992e-1609997f91d8 None admin] PATH_INFO: `/v3/users/947758f7ba33471b95545fb857af3369` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:41.936344 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26f84c9-1c5a-4f82-992e-1609997f91d8 None admin] RBAC: Authorizing `identity:get_user(user_id=947758f7ba33471b95545fb857af3369)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:41.937784 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26f84c9-1c5a-4f82-992e-1609997f91d8 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:41.939532 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 96/185] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 9 20:10:41 2022] GET /identity/v3/users/947758f7ba33471b95545fb857af3369 => generated 283 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:10:41.945246 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3a476e-0c87-44bf-88f4-790830fff541 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:42.050799 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3a476e-0c87-44bf-88f4-790830fff541 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:42.088046 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46dca9a-38f2-4e1f-bb9a-82f205a18840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:42.088699 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46dca9a-38f2-4e1f-bb9a-82f205a18840 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:42.088984 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46dca9a-38f2-4e1f-bb9a-82f205a18840 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:42.089252 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46dca9a-38f2-4e1f-bb9a-82f205a18840 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:42.167672 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46dca9a-38f2-4e1f-bb9a-82f205a18840 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:42.169202 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46dca9a-38f2-4e1f-bb9a-82f205a18840 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:42.267049 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 90/186] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 9 20:10:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 20:10:42.272743 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26f84c9-1c5a-4f82-992e-1609997f91d8 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:42.306649 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f827f0a-0a54-4dc7-baf6-9c3f50f2310d None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:42.306954 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f827f0a-0a54-4dc7-baf6-9c3f50f2310d None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:42.307194 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f827f0a-0a54-4dc7-baf6-9c3f50f2310d None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:42.308605 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 91/187] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:10:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 20:10:42.313521 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f508bc12-2adc-479d-a67c-5b451fb46282 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:42.313802 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f508bc12-2adc-479d-a67c-5b451fb46282 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:42.314069 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f508bc12-2adc-479d-a67c-5b451fb46282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:42.334286 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-f508bc12-2adc-479d-a67c-5b451fb46282 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:10:42.335490 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-f508bc12-2adc-479d-a67c-5b451fb46282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:10:42.385409 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26f84c9-1c5a-4f82-992e-1609997f91d8 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:42.406148 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 92/188] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:10:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 20:10:42.423938 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072023c7-8b91-4414-8eec-20f5afc4d824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:42.424796 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072023c7-8b91-4414-8eec-20f5afc4d824 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:42.425072 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072023c7-8b91-4414-8eec-20f5afc4d824 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:42.425540 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072023c7-8b91-4414-8eec-20f5afc4d824 None admin] PATH_INFO: `/v3/projects/45776741808d4cd98d7420b62d06836d` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:42.426560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072023c7-8b91-4414-8eec-20f5afc4d824 None admin] RBAC: Authorizing `identity:get_project(project_id=45776741808d4cd98d7420b62d06836d)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:42.428068 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072023c7-8b91-4414-8eec-20f5afc4d824 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:42.429776 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 97/189] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 9 20:10:42 2022] GET /identity/v3/projects/45776741808d4cd98d7420b62d06836d => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:42.433767 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f508bc12-2adc-479d-a67c-5b451fb46282 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:42.435363 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072023c7-8b91-4414-8eec-20f5afc4d824 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:42.538086 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f508bc12-2adc-479d-a67c-5b451fb46282 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:42.573125 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072023c7-8b91-4414-8eec-20f5afc4d824 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:42.580554 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002221e8-0a78-44ae-a01e-7175732dbf59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:42.580554 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002221e8-0a78-44ae-a01e-7175732dbf59 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:42.580554 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002221e8-0a78-44ae-a01e-7175732dbf59 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:42.580554 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002221e8-0a78-44ae-a01e-7175732dbf59 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:42.582702 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002221e8-0a78-44ae-a01e-7175732dbf59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:42.587418 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002221e8-0a78-44ae-a01e-7175732dbf59 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:42.589356 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 93/190] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:10:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:42.590309 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002221e8-0a78-44ae-a01e-7175732dbf59 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:42.606424 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7416a30f-f89d-4a69-9d29-eb3acf814ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:42.607416 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7416a30f-f89d-4a69-9d29-eb3acf814ef5 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:42.607708 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7416a30f-f89d-4a69-9d29-eb3acf814ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:42.607979 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7416a30f-f89d-4a69-9d29-eb3acf814ef5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:42.609271 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7416a30f-f89d-4a69-9d29-eb3acf814ef5 None admin] RBAC: Adding query filter params (role.id=274130b78e304bb88789c1b349263f3c, scope.project.id=45776741808d4cd98d7420b62d06836d, user.id=947758f7ba33471b95545fb857af3369) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:10:42.609582 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7416a30f-f89d-4a69-9d29-eb3acf814ef5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:42.611102 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7416a30f-f89d-4a69-9d29-eb3acf814ef5 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:42.619540 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 98/191] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 9 20:10:42 2022] GET /identity/v3/role_assignments?user.id=947758f7ba33471b95545fb857af3369&scope.project.id=45776741808d4cd98d7420b62d06836d&role.id=274130b78e304bb88789c1b349263f3c => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:10:42.645643 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e25273-556b-45aa-ab48-c8ed1b4f0564 None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:42.645973 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e25273-556b-45aa-ab48-c8ed1b4f0564 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:42.646187 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e25273-556b-45aa-ab48-c8ed1b4f0564 None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:42.647950 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 99/192] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:10:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:10:42.661763 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0044f9b-fb30-447d-8744-136495134c37 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:42.662076 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0044f9b-fb30-447d-8744-136495134c37 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:42.662307 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0044f9b-fb30-447d-8744-136495134c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:42.679813 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-a0044f9b-fb30-447d-8744-136495134c37 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:10:42.681029 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-a0044f9b-fb30-447d-8744-136495134c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:10:42.710277 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002221e8-0a78-44ae-a01e-7175732dbf59 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:42.748064 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884be021-9cb7-42fa-ad37-607b3786c5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:42.749178 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884be021-9cb7-42fa-ad37-607b3786c5a5 None admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:42.749665 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884be021-9cb7-42fa-ad37-607b3786c5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:42.750142 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884be021-9cb7-42fa-ad37-607b3786c5a5 None admin] PATH_INFO: `/v3/users` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:42.751324 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884be021-9cb7-42fa-ad37-607b3786c5a5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:42.753030 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 100/193] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:10:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 20:10:42.754255 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884be021-9cb7-42fa-ad37-607b3786c5a5 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:42.776550 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0044f9b-fb30-447d-8744-136495134c37 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:42.777116 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 94/194] 10.222.0.44 () {60 vars in 1132 bytes} [Mon May 9 20:10:42 2022] POST /identity/v3/users => generated 297 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 20:10:42.888882 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0044f9b-fb30-447d-8744-136495134c37 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:42.925863 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b7c249-b8df-4219-a906-c95251f911f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:42.926763 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b7c249-b8df-4219-a906-c95251f911f7 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:42.927043 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b7c249-b8df-4219-a906-c95251f911f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:42.927308 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b7c249-b8df-4219-a906-c95251f911f7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:42.938867 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b7c249-b8df-4219-a906-c95251f911f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:10:42.947657 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-21b7c249-b8df-4219-a906-c95251f911f7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 20:10:42.947657 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:10:42.947657 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:10:42.947657 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:10:42.947657 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:10:42.947657 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:10:42.947657 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:10:42.947657 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:10:42.947657 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:10:42.947657 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:10:42.947657 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:10:42.947657 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:10:42.947657 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:10:42.947657 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:10:42.947657 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:10:42.947657 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:10:42.948623 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:10:42.948623 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:10:42.948623 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:10:42.948623 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:10:42.948623 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:10:42.948623 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:10:42.948623 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:10:42.948623 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:10:42.948623 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:10:42.948623 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:10:42.948623 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:10:42.948623 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:10:42.948623 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:10:42.948623 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:10:42.948623 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:10:42.948623 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:10:42.949922 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:10:42.949922 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:10:42.949922 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:10:42.949922 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:10:42.949922 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:10:42.949922 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:10:42.949922 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:10:42.949922 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:10:42.949922 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:10:42.949922 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:10:42.949922 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 20:10:42.949922 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:10:42.949922 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 101/195] 10.222.0.44 () {56 vars in 1114 bytes} [Mon May 9 20:10:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 20:10:42.955263 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884be021-9cb7-42fa-ad37-607b3786c5a5 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:43.058497 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884be021-9cb7-42fa-ad37-607b3786c5a5 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:43.091787 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c2d602-5607-4aea-8a98-e431df5c00d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:43.092456 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c2d602-5607-4aea-8a98-e431df5c00d8 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:43.092738 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c2d602-5607-4aea-8a98-e431df5c00d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:43.093011 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c2d602-5607-4aea-8a98-e431df5c00d8 None admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:43.093760 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c2d602-5607-4aea-8a98-e431df5c00d8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:10:43.094069 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c2d602-5607-4aea-8a98-e431df5c00d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:43.095469 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c2d602-5607-4aea-8a98-e431df5c00d8 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:43.103844 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 95/196] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 9 20:10:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:43.109344 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b7c249-b8df-4219-a906-c95251f911f7 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:43.156197 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0638429b-488b-400e-abc5-4482242d6f11 None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:43.156443 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0638429b-488b-400e-abc5-4482242d6f11 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:43.156658 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0638429b-488b-400e-abc5-4482242d6f11 None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:43.158289 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 96/197] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:10:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:10:43.164646 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999b019-7183-469c-b4c6-419c058b7d56 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:43.164922 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999b019-7183-469c-b4c6-419c058b7d56 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:43.165188 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999b019-7183-469c-b4c6-419c058b7d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:43.185913 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-a999b019-7183-469c-b4c6-419c058b7d56 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:10:43.187109 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-a999b019-7183-469c-b4c6-419c058b7d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:10:43.226977 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b7c249-b8df-4219-a906-c95251f911f7 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:43.264984 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855b2b0c-5687-4611-80aa-47eb9c1fc898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:43.265856 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855b2b0c-5687-4611-80aa-47eb9c1fc898 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:43.266134 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855b2b0c-5687-4611-80aa-47eb9c1fc898 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:43.266411 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855b2b0c-5687-4611-80aa-47eb9c1fc898 None admin] PATH_INFO: `/v3/users/947758f7ba33471b95545fb857af3369` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:43.267641 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855b2b0c-5687-4611-80aa-47eb9c1fc898 None admin] RBAC: Authorizing `identity:get_user(user_id=947758f7ba33471b95545fb857af3369)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:43.268852 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 97/198] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:10:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 20:10:43.269731 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855b2b0c-5687-4611-80aa-47eb9c1fc898 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:43.270804 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 102/199] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 9 20:10:43 2022] GET /identity/v3/users/947758f7ba33471b95545fb857af3369 => generated 283 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:43.279437 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a999b019-7183-469c-b4c6-419c058b7d56 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:43.300910 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855b2b0c-5687-4611-80aa-47eb9c1fc898 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:43.414019 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a999b019-7183-469c-b4c6-419c058b7d56 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:43.441241 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855b2b0c-5687-4611-80aa-47eb9c1fc898 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:43.448531 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea609e72-a1d2-43f2-b7fb-cff34405270e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:43.449180 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea609e72-a1d2-43f2-b7fb-cff34405270e None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:43.449459 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea609e72-a1d2-43f2-b7fb-cff34405270e None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:43.449729 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea609e72-a1d2-43f2-b7fb-cff34405270e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:43.474983 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fe3343-1df2-42c4-8279-c613693c85e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:43.475830 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe3343-1df2-42c4-8279-c613693c85e4 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:43.476107 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe3343-1df2-42c4-8279-c613693c85e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:43.476378 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe3343-1df2-42c4-8279-c613693c85e4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:43.486860 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fe3343-1df2-42c4-8279-c613693c85e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:10:43.494799 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-74fe3343-1df2-42c4-8279-c613693c85e4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 09 20:10:43.494799 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:10:43.494799 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:10:43.494799 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:10:43.494799 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:10:43.494799 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:10:43.494799 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:10:43.494799 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:10:43.494799 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:10:43.494799 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:10:43.494799 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:10:43.494799 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:10:43.494799 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:10:43.494799 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:10:43.494799 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:10:43.494799 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:10:43.495743 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:10:43.495743 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:10:43.495743 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:10:43.495743 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:10:43.495743 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:10:43.495743 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:10:43.495743 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:10:43.495743 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:10:43.495743 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:10:43.495743 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:10:43.495743 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:10:43.495743 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:10:43.495743 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:10:43.495743 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:10:43.495743 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:10:43.495743 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:10:43.497130 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:10:43.497130 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:10:43.497130 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:10:43.497130 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:10:43.497130 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:10:43.497130 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:10:43.497130 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:10:43.497130 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:10:43.497130 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:10:43.497130 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:10:43.497130 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 09 20:10:43.497130 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:10:43.497130 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 103/200] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 9 20:10:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 20:10:43.501742 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fe3343-1df2-42c4-8279-c613693c85e4 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:43.518620 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea609e72-a1d2-43f2-b7fb-cff34405270e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:43.520265 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea609e72-a1d2-43f2-b7fb-cff34405270e None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:43.611962 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fe3343-1df2-42c4-8279-c613693c85e4 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:43.644769 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 98/201] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 9 20:10:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 09 20:10:43.652390 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea609e72-a1d2-43f2-b7fb-cff34405270e None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:43.667475 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e00986a-5618-4a23-9346-2d7956771e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:43.668927 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e00986a-5618-4a23-9346-2d7956771e25 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:43.669652 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e00986a-5618-4a23-9346-2d7956771e25 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:43.670365 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e00986a-5618-4a23-9346-2d7956771e25 None admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:43.672041 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e00986a-5618-4a23-9346-2d7956771e25 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:10:43.672828 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e00986a-5618-4a23-9346-2d7956771e25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:43.675655 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e00986a-5618-4a23-9346-2d7956771e25 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:43.690491 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 104/202] 10.222.0.44 () {56 vars in 1101 bytes} [Mon May 9 20:10:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:10:43.700033 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e00986a-5618-4a23-9346-2d7956771e25 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:43.803820 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea609e72-a1d2-43f2-b7fb-cff34405270e None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:43.838191 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d8bd93-b3a6-4b7e-9cc5-29d5b33034ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:43.839056 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8bd93-b3a6-4b7e-9cc5-29d5b33034ca None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:43.839339 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8bd93-b3a6-4b7e-9cc5-29d5b33034ca None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:43.839687 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8bd93-b3a6-4b7e-9cc5-29d5b33034ca None admin] PATH_INFO: `/v3/projects/45776741808d4cd98d7420b62d06836d` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:43.841189 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d8bd93-b3a6-4b7e-9cc5-29d5b33034ca None admin] RBAC: Authorizing `identity:get_project(project_id=45776741808d4cd98d7420b62d06836d)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:43.842645 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d8bd93-b3a6-4b7e-9cc5-29d5b33034ca None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:43.844532 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 99/203] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 9 20:10:43 2022] GET /identity/v3/projects/45776741808d4cd98d7420b62d06836d => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:43.850875 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d8bd93-b3a6-4b7e-9cc5-29d5b33034ca None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:43.881593 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e00986a-5618-4a23-9346-2d7956771e25 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:43.957889 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d8bd93-b3a6-4b7e-9cc5-29d5b33034ca None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:43.968183 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae8ed7f-66b1-44d0-8e67-e8bfa00f82ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:43.969070 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8ed7f-66b1-44d0-8e67-e8bfa00f82ff None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:43.969339 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8ed7f-66b1-44d0-8e67-e8bfa00f82ff None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:43.969612 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8ed7f-66b1-44d0-8e67-e8bfa00f82ff None admin] PATH_INFO: `/v3/users/e24f61c5e1bf4dc5aee55d87a45b67dc` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:43.970863 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae8ed7f-66b1-44d0-8e67-e8bfa00f82ff None admin] RBAC: Authorizing `identity:get_user(user_id=e24f61c5e1bf4dc5aee55d87a45b67dc)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:43.972412 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae8ed7f-66b1-44d0-8e67-e8bfa00f82ff None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:43.978020 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 105/204] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 9 20:10:43 2022] GET /identity/v3/users/e24f61c5e1bf4dc5aee55d87a45b67dc => generated 289 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:10:43.982087 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae8ed7f-66b1-44d0-8e67-e8bfa00f82ff None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:44.030451 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8afffd-08e7-4772-bc91-de6e4e26b89b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:44.032038 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8afffd-08e7-4772-bc91-de6e4e26b89b None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:44.032792 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8afffd-08e7-4772-bc91-de6e4e26b89b None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:44.033549 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8afffd-08e7-4772-bc91-de6e4e26b89b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:44.035492 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8afffd-08e7-4772-bc91-de6e4e26b89b None admin] RBAC: Adding query filter params (role.id=52c0c2910c294965839ef51e91b156a1, scope.project.id=45776741808d4cd98d7420b62d06836d, user.id=947758f7ba33471b95545fb857af3369) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:10:44.036324 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8afffd-08e7-4772-bc91-de6e4e26b89b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:44.047420 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8afffd-08e7-4772-bc91-de6e4e26b89b None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:44.060509 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 100/205] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 9 20:10:43 2022] GET /identity/v3/role_assignments?user.id=947758f7ba33471b95545fb857af3369&scope.project.id=45776741808d4cd98d7420b62d06836d&role.id=52c0c2910c294965839ef51e91b156a1 => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:44.096945 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae8ed7f-66b1-44d0-8e67-e8bfa00f82ff None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:44.137679 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe409c15-59dc-411e-8918-aa8d00383acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:44.138326 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe409c15-59dc-411e-8918-aa8d00383acf None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:44.138611 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe409c15-59dc-411e-8918-aa8d00383acf None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:44.138880 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe409c15-59dc-411e-8918-aa8d00383acf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:44.210761 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe409c15-59dc-411e-8918-aa8d00383acf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:44.212193 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe409c15-59dc-411e-8918-aa8d00383acf None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:44.317794 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 106/206] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 9 20:10:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 20:10:44.326474 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8afffd-08e7-4772-bc91-de6e4e26b89b None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:44.472005 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8afffd-08e7-4772-bc91-de6e4e26b89b None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:44.507836 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07b84ba-d631-4a57-814d-49413212ab60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:44.508699 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b84ba-d631-4a57-814d-49413212ab60 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:44.508988 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b84ba-d631-4a57-814d-49413212ab60 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:44.509248 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b84ba-d631-4a57-814d-49413212ab60 None admin] PATH_INFO: `/v3/projects/2019f358cc3841408e7d4693c6b8133a` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:44.510466 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07b84ba-d631-4a57-814d-49413212ab60 None admin] RBAC: Authorizing `identity:get_project(project_id=2019f358cc3841408e7d4693c6b8133a)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:44.511944 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07b84ba-d631-4a57-814d-49413212ab60 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:44.514013 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 101/207] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 9 20:10:44 2022] GET /identity/v3/projects/2019f358cc3841408e7d4693c6b8133a => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:44.522688 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe409c15-59dc-411e-8918-aa8d00383acf None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:44.631720 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe409c15-59dc-411e-8918-aa8d00383acf None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:44.670928 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23386823-bf0e-4e21-acfa-f4efb815cb92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:44.671606 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23386823-bf0e-4e21-acfa-f4efb815cb92 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:44.671877 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23386823-bf0e-4e21-acfa-f4efb815cb92 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:44.672148 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23386823-bf0e-4e21-acfa-f4efb815cb92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:44.672973 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23386823-bf0e-4e21-acfa-f4efb815cb92 None admin] RBAC: Adding query filter params (role.id=8957f6409fdf419abdc10d421c213a32, scope.project.id=2019f358cc3841408e7d4693c6b8133a, user.id=e24f61c5e1bf4dc5aee55d87a45b67dc) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:10:44.673275 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23386823-bf0e-4e21-acfa-f4efb815cb92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:44.674721 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23386823-bf0e-4e21-acfa-f4efb815cb92 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:44.681329 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 107/208] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 9 20:10:44 2022] GET /identity/v3/role_assignments?user.id=e24f61c5e1bf4dc5aee55d87a45b67dc&scope.project.id=2019f358cc3841408e7d4693c6b8133a&role.id=8957f6409fdf419abdc10d421c213a32 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:45.887216 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f471a-ee53-4de7-8ba0-88f66e9febe9 None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:45.887736 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f471a-ee53-4de7-8ba0-88f66e9febe9 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:45.887736 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f471a-ee53-4de7-8ba0-88f66e9febe9 None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:45.889200 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 102/209] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:10:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:10:45.895059 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439d620-88c4-4855-92ee-db18a025b04c None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:45.895491 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439d620-88c4-4855-92ee-db18a025b04c None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:45.895659 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439d620-88c4-4855-92ee-db18a025b04c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:45.912058 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-5439d620-88c4-4855-92ee-db18a025b04c None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:10:45.913235 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-5439d620-88c4-4855-92ee-db18a025b04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:10:45.977224 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d28e9f-a505-4de3-b83c-d163bfeb16a1 None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:45.977526 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d28e9f-a505-4de3-b83c-d163bfeb16a1 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:45.977775 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d28e9f-a505-4de3-b83c-d163bfeb16a1 None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:45.979758 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 103/210] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:10:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:10:45.989955 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15540262-e570-483e-a84c-d07046fe5ddc None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:45.990253 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15540262-e570-483e-a84c-d07046fe5ddc None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:45.990525 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15540262-e570-483e-a84c-d07046fe5ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:45.992995 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 108/211] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:10:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 20:10:46.012691 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-15540262-e570-483e-a84c-d07046fe5ddc None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:10:46.014220 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-15540262-e570-483e-a84c-d07046fe5ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:10:46.021262 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5439d620-88c4-4855-92ee-db18a025b04c None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:46.137904 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5439d620-88c4-4855-92ee-db18a025b04c None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:46.177388 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f614d522-5a80-4b1c-98d1-ca2b3885bb03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:46.178945 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f614d522-5a80-4b1c-98d1-ca2b3885bb03 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:46.180016 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f614d522-5a80-4b1c-98d1-ca2b3885bb03 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:46.181834 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f614d522-5a80-4b1c-98d1-ca2b3885bb03 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:46.184242 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 104/212] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:10:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 20:10:46.193501 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f614d522-5a80-4b1c-98d1-ca2b3885bb03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:10:46.201309 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-f614d522-5a80-4b1c-98d1-ca2b3885bb03 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 20:10:46.201309 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:10:46.201309 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:10:46.201309 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:10:46.201309 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:10:46.201309 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:10:46.201309 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:10:46.201309 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:10:46.201309 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:10:46.201309 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:10:46.201309 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:10:46.201309 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:10:46.201309 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:10:46.201309 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:10:46.201309 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:10:46.201309 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:10:46.202195 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:10:46.202195 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:10:46.202195 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:10:46.202195 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:10:46.202195 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:10:46.202195 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:10:46.202195 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:10:46.202195 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:10:46.202195 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:10:46.202195 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:10:46.202195 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:10:46.202195 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:10:46.202195 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:10:46.202195 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:10:46.202195 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:10:46.202195 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:10:46.202990 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:10:46.202990 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:10:46.202990 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:10:46.202990 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:10:46.202990 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:10:46.202990 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:10:46.202990 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:10:46.202990 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:10:46.202990 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:10:46.202990 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:10:46.202990 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 20:10:46.202990 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:10:46.205332 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 109/213] 10.222.0.44 () {56 vars in 1096 bytes} [Mon May 9 20:10:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 20:10:46.216735 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15540262-e570-483e-a84c-d07046fe5ddc None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:46.221262 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f614d522-5a80-4b1c-98d1-ca2b3885bb03 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:46.336483 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15540262-e570-483e-a84c-d07046fe5ddc None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:46.380860 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d884236b-be3d-40dd-8775-146cbc86ab8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:46.381681 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d884236b-be3d-40dd-8775-146cbc86ab8b None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:46.381962 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d884236b-be3d-40dd-8775-146cbc86ab8b None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:46.382294 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d884236b-be3d-40dd-8775-146cbc86ab8b None admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:46.383314 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d884236b-be3d-40dd-8775-146cbc86ab8b None admin] RBAC: Adding query filter params (name=admin) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:10:46.383670 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d884236b-be3d-40dd-8775-146cbc86ab8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:46.385046 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d884236b-be3d-40dd-8775-146cbc86ab8b None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:46.392028 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f614d522-5a80-4b1c-98d1-ca2b3885bb03 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:46.397076 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 105/214] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 9 20:10:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:46.398352 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6d88a-8b13-49df-a22c-8f93c0f91a4e None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:46.398638 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6d88a-8b13-49df-a22c-8f93c0f91a4e None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:46.398915 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6d88a-8b13-49df-a22c-8f93c0f91a4e None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:46.400618 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 106/215] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:10:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:10:46.404066 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a6d88a-8b13-49df-a22c-8f93c0f91a4e None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:46.427709 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c282eb3-d4c1-4f6d-85f5-65319ba09f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:46.428483 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c282eb3-d4c1-4f6d-85f5-65319ba09f3d None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:46.428762 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c282eb3-d4c1-4f6d-85f5-65319ba09f3d None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:46.429025 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c282eb3-d4c1-4f6d-85f5-65319ba09f3d None admin] PATH_INFO: `/v3/domains/default` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:46.430189 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c282eb3-d4c1-4f6d-85f5-65319ba09f3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:46.431740 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c282eb3-d4c1-4f6d-85f5-65319ba09f3d None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:46.433347 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 110/216] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:10:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:10:46.438966 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e100f5-d86f-4306-ba42-b3fa9fefcb94 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:46.439252 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e100f5-d86f-4306-ba42-b3fa9fefcb94 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:46.439847 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e100f5-d86f-4306-ba42-b3fa9fefcb94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:46.462980 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-c2e100f5-d86f-4306-ba42-b3fa9fefcb94 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:10:46.464579 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-c2e100f5-d86f-4306-ba42-b3fa9fefcb94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:10:46.544197 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a6d88a-8b13-49df-a22c-8f93c0f91a4e None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:46.546064 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 111/217] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:10:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 20:10:46.546717 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e100f5-d86f-4306-ba42-b3fa9fefcb94 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:46.590289 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf98522-d958-49d7-a083-867146c4a3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:46.591156 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf98522-d958-49d7-a083-867146c4a3c4 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:46.591456 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf98522-d958-49d7-a083-867146c4a3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:46.591732 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf98522-d958-49d7-a083-867146c4a3c4 None admin] PATH_INFO: `/v3/users/947758f7ba33471b95545fb857af3369` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:46.592924 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf98522-d958-49d7-a083-867146c4a3c4 None admin] RBAC: Authorizing `identity:get_user(user_id=947758f7ba33471b95545fb857af3369)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:46.594366 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf98522-d958-49d7-a083-867146c4a3c4 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:46.596192 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 107/218] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 9 20:10:46 2022] GET /identity/v3/users/947758f7ba33471b95545fb857af3369 => generated 283 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:46.596788 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf98522-d958-49d7-a083-867146c4a3c4 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:46.663944 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e100f5-d86f-4306-ba42-b3fa9fefcb94 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:46.697635 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dd2165-05ae-4618-a649-3732ae373338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:46.698304 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd2165-05ae-4618-a649-3732ae373338 None admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:46.698584 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd2165-05ae-4618-a649-3732ae373338 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:46.698856 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd2165-05ae-4618-a649-3732ae373338 None admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:46.699585 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dd2165-05ae-4618-a649-3732ae373338 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:46.701028 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dd2165-05ae-4618-a649-3732ae373338 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:46.702947 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf98522-d958-49d7-a083-867146c4a3c4 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:46.721575 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 112/219] 10.222.0.44 () {60 vars in 1132 bytes} [Mon May 9 20:10:46 2022] POST /identity/v3/users => generated 297 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:10:46.722900 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dd2165-05ae-4618-a649-3732ae373338 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:46.760527 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d72d3a9-6955-4a67-a8df-250b46d8b81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:46.761897 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72d3a9-6955-4a67-a8df-250b46d8b81e None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:46.762509 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72d3a9-6955-4a67-a8df-250b46d8b81e None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:46.763343 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72d3a9-6955-4a67-a8df-250b46d8b81e None admin] PATH_INFO: `/v3/roles/member` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:46.778738 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d72d3a9-6955-4a67-a8df-250b46d8b81e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:10:46.790454 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-6d72d3a9-6955-4a67-a8df-250b46d8b81e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 20:10:46.790454 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:10:46.790454 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:10:46.790454 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:10:46.790454 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:10:46.790454 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:10:46.790454 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:10:46.790454 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:10:46.790454 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:10:46.790454 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:10:46.790454 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:10:46.790454 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:10:46.790454 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:10:46.790454 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:10:46.790454 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:10:46.790454 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:10:46.791463 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:10:46.791463 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:10:46.791463 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:10:46.791463 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:10:46.791463 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:10:46.791463 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:10:46.791463 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:10:46.791463 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:10:46.791463 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:10:46.791463 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:10:46.791463 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:10:46.791463 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:10:46.791463 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:10:46.791463 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:10:46.791463 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:10:46.791463 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:10:46.792258 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:10:46.792258 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:10:46.792258 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:10:46.792258 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:10:46.792258 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:10:46.792258 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:10:46.792258 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:10:46.792258 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:10:46.792258 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:10:46.792258 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:10:46.792258 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 20:10:46.792258 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:10:46.794769 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 108/220] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 9 20:10:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:10:46.803918 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d72d3a9-6955-4a67-a8df-250b46d8b81e None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:46.864034 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dd2165-05ae-4618-a649-3732ae373338 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:46.904015 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459b906d-e754-43c1-b50c-e666ed49880c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:46.906021 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b906d-e754-43c1-b50c-e666ed49880c None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:46.906488 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b906d-e754-43c1-b50c-e666ed49880c None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:46.907199 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b906d-e754-43c1-b50c-e666ed49880c None admin] PATH_INFO: `/v3/projects/45776741808d4cd98d7420b62d06836d` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:46.908998 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459b906d-e754-43c1-b50c-e666ed49880c None admin] RBAC: Authorizing `identity:get_project(project_id=45776741808d4cd98d7420b62d06836d)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:46.911895 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459b906d-e754-43c1-b50c-e666ed49880c None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:46.914655 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 113/221] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 9 20:10:46 2022] GET /identity/v3/projects/45776741808d4cd98d7420b62d06836d => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:46.924026 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459b906d-e754-43c1-b50c-e666ed49880c None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:46.936285 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d72d3a9-6955-4a67-a8df-250b46d8b81e None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:46.976477 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadaeedf-ca7f-46e5-8c70-ad38e9540f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:46.977161 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadaeedf-ca7f-46e5-8c70-ad38e9540f66 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:46.977499 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadaeedf-ca7f-46e5-8c70-ad38e9540f66 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:46.977782 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadaeedf-ca7f-46e5-8c70-ad38e9540f66 None admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:46.978538 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadaeedf-ca7f-46e5-8c70-ad38e9540f66 None admin] RBAC: Adding query filter params (name=member) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:10:46.978848 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadaeedf-ca7f-46e5-8c70-ad38e9540f66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:46.980265 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadaeedf-ca7f-46e5-8c70-ad38e9540f66 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:46.990634 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 109/222] 10.222.0.44 () {56 vars in 1101 bytes} [Mon May 9 20:10:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:46.996102 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadaeedf-ca7f-46e5-8c70-ad38e9540f66 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:47.063910 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459b906d-e754-43c1-b50c-e666ed49880c None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:47.112412 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b33939a-3e68-4148-87a3-4275fbf2983c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:47.113830 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33939a-3e68-4148-87a3-4275fbf2983c None admin] REQUEST_METHOD: `PUT` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:47.114117 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33939a-3e68-4148-87a3-4275fbf2983c None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:47.114389 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33939a-3e68-4148-87a3-4275fbf2983c None admin] PATH_INFO: `/v3/projects/45776741808d4cd98d7420b62d06836d/users/947758f7ba33471b95545fb857af3369/roles/274130b78e304bb88789c1b349263f3c` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:47.116429 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b33939a-3e68-4148-87a3-4275fbf2983c None admin] RBAC: Authorizing `identity:create_grant(project_id=45776741808d4cd98d7420b62d06836d, user_id=947758f7ba33471b95545fb857af3369, role_id=274130b78e304bb88789c1b349263f3c)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:47.117888 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b33939a-3e68-4148-87a3-4275fbf2983c None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:47.120213 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadaeedf-ca7f-46e5-8c70-ad38e9540f66 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:47.139538 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 114/223] 10.222.0.44 () {58 vars in 1439 bytes} [Mon May 9 20:10:46 2022] PUT /identity/v3/projects/45776741808d4cd98d7420b62d06836d/users/947758f7ba33471b95545fb857af3369/roles/274130b78e304bb88789c1b349263f3c => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:10:47.167082 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebda4d3-190a-43b5-8e81-d1834338488b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:47.168408 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebda4d3-190a-43b5-8e81-d1834338488b None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:47.168845 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebda4d3-190a-43b5-8e81-d1834338488b None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:47.169266 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebda4d3-190a-43b5-8e81-d1834338488b None admin] PATH_INFO: `/v3/users/50fc3eb69ed848a185235415605df687` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:47.190262 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebda4d3-190a-43b5-8e81-d1834338488b None admin] RBAC: Authorizing `identity:get_user(user_id=50fc3eb69ed848a185235415605df687)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:47.192640 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebda4d3-190a-43b5-8e81-d1834338488b None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:47.194785 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 110/224] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 9 20:10:46 2022] GET /identity/v3/users/50fc3eb69ed848a185235415605df687 => generated 297 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:10:47.200211 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b33939a-3e68-4148-87a3-4275fbf2983c None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:47.257331 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea84c8-d00c-48a9-b6fc-48447c2c280e None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:47.257644 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea84c8-d00c-48a9-b6fc-48447c2c280e None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:47.257887 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea84c8-d00c-48a9-b6fc-48447c2c280e None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:47.259606 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 111/225] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:10:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:10:47.265113 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa356ca-9e22-43a9-bb64-eb14175114ce None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:47.265411 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa356ca-9e22-43a9-bb64-eb14175114ce None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:47.265641 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa356ca-9e22-43a9-bb64-eb14175114ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:47.283037 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-8fa356ca-9e22-43a9-bb64-eb14175114ce None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:10:47.284269 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-8fa356ca-9e22-43a9-bb64-eb14175114ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:10:47.345075 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b33939a-3e68-4148-87a3-4275fbf2983c None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:47.382617 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 112/226] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:10:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 20:10:47.385877 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cbbf04-3dd3-4e5b-aa56-853e17e2dbe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:47.386525 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cbbf04-3dd3-4e5b-aa56-853e17e2dbe9 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:47.386803 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cbbf04-3dd3-4e5b-aa56-853e17e2dbe9 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:47.387070 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cbbf04-3dd3-4e5b-aa56-853e17e2dbe9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:47.412223 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa356ca-9e22-43a9-bb64-eb14175114ce None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:47.458095 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cbbf04-3dd3-4e5b-aa56-853e17e2dbe9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:47.459603 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cbbf04-3dd3-4e5b-aa56-853e17e2dbe9 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:47.533481 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa356ca-9e22-43a9-bb64-eb14175114ce None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:47.562195 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 115/227] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 9 20:10:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 20:10:47.568142 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cbbf04-3dd3-4e5b-aa56-853e17e2dbe9 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:47.621457 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64553259-f733-444d-bddb-fe7f7e1aa2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:47.622269 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64553259-f733-444d-bddb-fe7f7e1aa2d8 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:47.622543 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64553259-f733-444d-bddb-fe7f7e1aa2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:47.622812 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64553259-f733-444d-bddb-fe7f7e1aa2d8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:47.650980 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64553259-f733-444d-bddb-fe7f7e1aa2d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:10:47.663792 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-64553259-f733-444d-bddb-fe7f7e1aa2d8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 20:10:47.663792 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:10:47.663792 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:10:47.663792 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:10:47.663792 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:10:47.663792 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:10:47.663792 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:10:47.663792 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:10:47.663792 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:10:47.663792 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:10:47.663792 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:10:47.663792 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:10:47.663792 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:10:47.663792 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:10:47.663792 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:10:47.663792 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:10:47.664691 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:10:47.664691 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:10:47.664691 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:10:47.664691 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:10:47.664691 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:10:47.664691 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:10:47.664691 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:10:47.664691 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:10:47.664691 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:10:47.664691 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:10:47.664691 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:10:47.664691 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:10:47.664691 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:10:47.664691 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:10:47.664691 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:10:47.664691 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:10:47.665521 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:10:47.665521 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:10:47.665521 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:10:47.665521 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:10:47.665521 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:10:47.665521 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:10:47.665521 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:10:47.665521 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:10:47.665521 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:10:47.665521 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:10:47.665521 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 20:10:47.665521 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:10:47.668105 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 113/228] 10.222.0.44 () {56 vars in 1114 bytes} [Mon May 9 20:10:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 20:10:47.673136 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cbbf04-3dd3-4e5b-aa56-853e17e2dbe9 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:47.674263 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64553259-f733-444d-bddb-fe7f7e1aa2d8 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:47.704194 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0feabfe-869e-46fe-95f0-70e7f9b8aa8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:47.705096 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0feabfe-869e-46fe-95f0-70e7f9b8aa8a None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:47.705374 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0feabfe-869e-46fe-95f0-70e7f9b8aa8a None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:47.705672 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0feabfe-869e-46fe-95f0-70e7f9b8aa8a None admin] PATH_INFO: `/v3/projects/45776741808d4cd98d7420b62d06836d` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:47.712337 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0feabfe-869e-46fe-95f0-70e7f9b8aa8a None admin] RBAC: Authorizing `identity:get_project(project_id=45776741808d4cd98d7420b62d06836d)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:47.713749 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0feabfe-869e-46fe-95f0-70e7f9b8aa8a None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:47.715718 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 116/229] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 9 20:10:47 2022] GET /identity/v3/projects/45776741808d4cd98d7420b62d06836d => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:10:47.724230 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0feabfe-869e-46fe-95f0-70e7f9b8aa8a None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:47.826773 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0feabfe-869e-46fe-95f0-70e7f9b8aa8a None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:47.888660 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aca236-2bec-4a34-9cda-b7fcf7a9d6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:47.889706 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aca236-2bec-4a34-9cda-b7fcf7a9d6f1 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:47.890060 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64553259-f733-444d-bddb-fe7f7e1aa2d8 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:47.890402 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aca236-2bec-4a34-9cda-b7fcf7a9d6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:47.890865 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aca236-2bec-4a34-9cda-b7fcf7a9d6f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:47.891918 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aca236-2bec-4a34-9cda-b7fcf7a9d6f1 None admin] RBAC: Adding query filter params (role.id=79f90a0bf6ea43d0b3c434e31556253a, scope.project.id=45776741808d4cd98d7420b62d06836d, user.id=50fc3eb69ed848a185235415605df687) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:10:47.892442 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aca236-2bec-4a34-9cda-b7fcf7a9d6f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:47.894696 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aca236-2bec-4a34-9cda-b7fcf7a9d6f1 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:47.905394 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 117/230] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 9 20:10:47 2022] GET /identity/v3/role_assignments?user.id=50fc3eb69ed848a185235415605df687&scope.project.id=45776741808d4cd98d7420b62d06836d&role.id=79f90a0bf6ea43d0b3c434e31556253a => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:47.934357 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3c40fd-5fe2-4db6-a470-a368febff1e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:47.935491 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c40fd-5fe2-4db6-a470-a368febff1e0 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:47.936137 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c40fd-5fe2-4db6-a470-a368febff1e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:47.936618 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c40fd-5fe2-4db6-a470-a368febff1e0 None admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:47.938085 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3c40fd-5fe2-4db6-a470-a368febff1e0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:10:47.938603 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3c40fd-5fe2-4db6-a470-a368febff1e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:47.940302 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3c40fd-5fe2-4db6-a470-a368febff1e0 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:47.950064 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 114/231] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 9 20:10:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:47.956608 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aca236-2bec-4a34-9cda-b7fcf7a9d6f1 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:48.111066 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aca236-2bec-4a34-9cda-b7fcf7a9d6f1 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:48.156371 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aeda18-862f-4aeb-9050-9d0d610dbe7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:48.157240 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aeda18-862f-4aeb-9050-9d0d610dbe7a None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:48.157523 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aeda18-862f-4aeb-9050-9d0d610dbe7a None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:48.157797 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aeda18-862f-4aeb-9050-9d0d610dbe7a None admin] PATH_INFO: `/v3/users/947758f7ba33471b95545fb857af3369` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:48.158991 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aeda18-862f-4aeb-9050-9d0d610dbe7a None admin] RBAC: Authorizing `identity:get_user(user_id=947758f7ba33471b95545fb857af3369)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:48.161279 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aeda18-862f-4aeb-9050-9d0d610dbe7a None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:48.162930 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 118/232] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 9 20:10:47 2022] GET /identity/v3/users/947758f7ba33471b95545fb857af3369 => generated 283 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:48.168571 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3c40fd-5fe2-4db6-a470-a368febff1e0 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:48.269513 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3c40fd-5fe2-4db6-a470-a368febff1e0 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:48.305678 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cf7894-4e39-4e24-89e0-544720e4e1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:48.306543 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf7894-4e39-4e24-89e0-544720e4e1bb None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:48.306826 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf7894-4e39-4e24-89e0-544720e4e1bb None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:48.307101 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf7894-4e39-4e24-89e0-544720e4e1bb None admin] PATH_INFO: `/v3/projects/45776741808d4cd98d7420b62d06836d` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:48.308342 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cf7894-4e39-4e24-89e0-544720e4e1bb None admin] RBAC: Authorizing `identity:get_project(project_id=45776741808d4cd98d7420b62d06836d)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:48.309780 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cf7894-4e39-4e24-89e0-544720e4e1bb None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:48.311498 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 115/233] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 9 20:10:48 2022] GET /identity/v3/projects/45776741808d4cd98d7420b62d06836d => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:48.317507 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aeda18-862f-4aeb-9050-9d0d610dbe7a None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:48.449612 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aeda18-862f-4aeb-9050-9d0d610dbe7a None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:48.496997 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eb274f-e81a-41fa-aaf5-b7a07a3e0298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:48.497880 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb274f-e81a-41fa-aaf5-b7a07a3e0298 None admin] REQUEST_METHOD: `PUT` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:48.498161 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb274f-e81a-41fa-aaf5-b7a07a3e0298 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:48.498428 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb274f-e81a-41fa-aaf5-b7a07a3e0298 None admin] PATH_INFO: `/v3/projects/45776741808d4cd98d7420b62d06836d/users/947758f7ba33471b95545fb857af3369/roles/52c0c2910c294965839ef51e91b156a1` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:48.500670 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eb274f-e81a-41fa-aaf5-b7a07a3e0298 None admin] RBAC: Authorizing `identity:create_grant(project_id=45776741808d4cd98d7420b62d06836d, user_id=947758f7ba33471b95545fb857af3369, role_id=52c0c2910c294965839ef51e91b156a1)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:48.502120 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eb274f-e81a-41fa-aaf5-b7a07a3e0298 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:48.527016 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 119/234] 10.222.0.44 () {58 vars in 1439 bytes} [Mon May 9 20:10:48 2022] PUT /identity/v3/projects/45776741808d4cd98d7420b62d06836d/users/947758f7ba33471b95545fb857af3369/roles/52c0c2910c294965839ef51e91b156a1 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:10:49.870396 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae788bb-9a39-44da-ade6-6e54806fabbe None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:49.870906 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae788bb-9a39-44da-ade6-6e54806fabbe None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:49.870906 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae788bb-9a39-44da-ade6-6e54806fabbe None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:49.872482 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 116/235] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:10:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:10:49.889382 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e53102-72a3-4828-b5ee-4ec6d0766df5 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:49.889858 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e53102-72a3-4828-b5ee-4ec6d0766df5 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:49.889958 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e53102-72a3-4828-b5ee-4ec6d0766df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:49.898449 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc44184-f40a-4ba4-aa3c-db0bafa69586 None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:49.899022 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc44184-f40a-4ba4-aa3c-db0bafa69586 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:49.899573 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc44184-f40a-4ba4-aa3c-db0bafa69586 None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:49.901131 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 117/236] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:10:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 20:10:49.906359 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301f1a3-2268-4ca8-ad15-2bf3b21ace02 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:49.906876 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301f1a3-2268-4ca8-ad15-2bf3b21ace02 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:49.907348 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301f1a3-2268-4ca8-ad15-2bf3b21ace02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:49.911356 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-26e53102-72a3-4828-b5ee-4ec6d0766df5 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:10:49.912819 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-26e53102-72a3-4828-b5ee-4ec6d0766df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:10:49.924741 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-7301f1a3-2268-4ca8-ad15-2bf3b21ace02 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:10:49.926733 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-7301f1a3-2268-4ca8-ad15-2bf3b21ace02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:10:49.986575 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 120/237] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:10:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 20:10:49.988323 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31abdc3a-7cc5-48c1-aa7e-9342c586ce73 None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:49.988838 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31abdc3a-7cc5-48c1-aa7e-9342c586ce73 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:49.989307 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31abdc3a-7cc5-48c1-aa7e-9342c586ce73 None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:49.990784 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 121/238] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:10:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:10:49.999418 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c931dd-3a1c-46f4-8aac-12d9be236d4a None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:49.999418 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c931dd-3a1c-46f4-8aac-12d9be236d4a None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:49.999418 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c931dd-3a1c-46f4-8aac-12d9be236d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:50.002533 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 118/239] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:10:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 20:10:50.018014 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7301f1a3-2268-4ca8-ad15-2bf3b21ace02 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:50.028597 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-a1c931dd-3a1c-46f4-8aac-12d9be236d4a None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:10:50.030187 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-a1c931dd-3a1c-46f4-8aac-12d9be236d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:10:50.107658 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 122/240] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:10:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 20:10:50.108894 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c931dd-3a1c-46f4-8aac-12d9be236d4a None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:50.129751 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7301f1a3-2268-4ca8-ad15-2bf3b21ace02 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:50.170107 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f08edbf-5989-45f7-8e27-b5281d851e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:50.170894 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08edbf-5989-45f7-8e27-b5281d851e18 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:50.171162 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08edbf-5989-45f7-8e27-b5281d851e18 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:50.171454 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08edbf-5989-45f7-8e27-b5281d851e18 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:50.182013 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f08edbf-5989-45f7-8e27-b5281d851e18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:10:50.189550 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-4f08edbf-5989-45f7-8e27-b5281d851e18 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 09 20:10:50.189550 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:10:50.189550 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:10:50.189550 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:10:50.189550 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:10:50.189550 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:10:50.189550 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:10:50.189550 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:10:50.189550 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:10:50.189550 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:10:50.189550 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:10:50.189550 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:10:50.189550 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:10:50.189550 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:10:50.189550 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:10:50.189550 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:10:50.190433 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:10:50.190433 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:10:50.190433 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:10:50.190433 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:10:50.190433 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:10:50.190433 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:10:50.190433 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:10:50.190433 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:10:50.190433 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:10:50.190433 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:10:50.190433 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:10:50.190433 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:10:50.190433 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:10:50.190433 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:10:50.190433 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:10:50.190433 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:10:50.191276 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:10:50.191276 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:10:50.191276 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:10:50.191276 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:10:50.191276 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:10:50.191276 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:10:50.191276 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:10:50.191276 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:10:50.191276 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:10:50.191276 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:10:50.191276 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 09 20:10:50.191276 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:10:50.191276 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 119/241] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 9 20:10:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 20:10:50.192114 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f08edbf-5989-45f7-8e27-b5281d851e18 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:50.227290 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c931dd-3a1c-46f4-8aac-12d9be236d4a None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:50.269629 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41030898-8140-4700-9536-9f580271c427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:50.270761 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41030898-8140-4700-9536-9f580271c427 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:50.271335 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41030898-8140-4700-9536-9f580271c427 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:50.272268 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41030898-8140-4700-9536-9f580271c427 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:50.285434 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41030898-8140-4700-9536-9f580271c427 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:10:50.296440 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-41030898-8140-4700-9536-9f580271c427 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 20:10:50.296440 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:10:50.296440 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:10:50.296440 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:10:50.296440 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:10:50.296440 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:10:50.296440 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:10:50.296440 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:10:50.296440 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:10:50.296440 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:10:50.296440 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:10:50.296440 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:10:50.296440 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:10:50.296440 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:10:50.296440 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:10:50.296440 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:10:50.297318 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:10:50.297318 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:10:50.297318 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:10:50.297318 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:10:50.297318 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:10:50.297318 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:10:50.297318 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:10:50.297318 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:10:50.297318 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:10:50.297318 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:10:50.297318 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:10:50.297318 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:10:50.297318 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:10:50.297318 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:10:50.297318 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:10:50.297318 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:10:50.298104 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:10:50.298104 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:10:50.298104 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:10:50.298104 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:10:50.298104 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:10:50.298104 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:10:50.298104 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:10:50.298104 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:10:50.298104 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:10:50.298104 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:10:50.298104 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 20:10:50.298104 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:10:50.298715 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f08edbf-5989-45f7-8e27-b5281d851e18 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:50.301713 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 123/242] 10.222.0.44 () {56 vars in 1096 bytes} [Mon May 9 20:10:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:10:50.307679 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41030898-8140-4700-9536-9f580271c427 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:50.334106 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c25e79-47b2-4816-94f3-83cea2e77bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:50.335201 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c25e79-47b2-4816-94f3-83cea2e77bf4 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:50.335548 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c25e79-47b2-4816-94f3-83cea2e77bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:50.335821 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c25e79-47b2-4816-94f3-83cea2e77bf4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:50.336998 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c25e79-47b2-4816-94f3-83cea2e77bf4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:50.338445 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c25e79-47b2-4816-94f3-83cea2e77bf4 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:50.343439 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 120/243] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:10:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:50.345303 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c25e79-47b2-4816-94f3-83cea2e77bf4 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:50.431377 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41030898-8140-4700-9536-9f580271c427 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:50.471688 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34284bfd-2fe1-4df5-a892-d8d7609d2056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:50.473045 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34284bfd-2fe1-4df5-a892-d8d7609d2056 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:50.473328 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34284bfd-2fe1-4df5-a892-d8d7609d2056 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:50.473587 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34284bfd-2fe1-4df5-a892-d8d7609d2056 None admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:50.474000 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c25e79-47b2-4816-94f3-83cea2e77bf4 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:50.474331 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34284bfd-2fe1-4df5-a892-d8d7609d2056 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:10:50.474629 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34284bfd-2fe1-4df5-a892-d8d7609d2056 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:50.476241 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34284bfd-2fe1-4df5-a892-d8d7609d2056 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:50.486948 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 124/244] 10.222.0.44 () {56 vars in 1101 bytes} [Mon May 9 20:10:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:50.488647 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34284bfd-2fe1-4df5-a892-d8d7609d2056 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:50.517457 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb9fe8-1489-4125-8a4a-29d79e44dcb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:50.518883 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb9fe8-1489-4125-8a4a-29d79e44dcb3 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:50.519340 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb9fe8-1489-4125-8a4a-29d79e44dcb3 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:50.520071 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb9fe8-1489-4125-8a4a-29d79e44dcb3 None admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:50.521113 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fb9fe8-1489-4125-8a4a-29d79e44dcb3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:10:50.521571 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fb9fe8-1489-4125-8a4a-29d79e44dcb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:50.523700 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fb9fe8-1489-4125-8a4a-29d79e44dcb3 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:50.534919 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 121/245] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 9 20:10:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:50.536044 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb9fe8-1489-4125-8a4a-29d79e44dcb3 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:50.613371 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34284bfd-2fe1-4df5-a892-d8d7609d2056 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:50.645930 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb9fe8-1489-4125-8a4a-29d79e44dcb3 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:50.647372 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5069d3b3-ae82-433f-8de4-fca1228fa35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:50.648095 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069d3b3-ae82-433f-8de4-fca1228fa35d None admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:50.648369 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069d3b3-ae82-433f-8de4-fca1228fa35d None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:50.648687 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069d3b3-ae82-433f-8de4-fca1228fa35d None admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:50.650273 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5069d3b3-ae82-433f-8de4-fca1228fa35d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:50.651014 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5069d3b3-ae82-433f-8de4-fca1228fa35d None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:50.671324 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 125/246] 10.222.0.44 () {60 vars in 1132 bytes} [Mon May 9 20:10:50 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:10:50.672084 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5069d3b3-ae82-433f-8de4-fca1228fa35d None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:50.694338 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b399a7-e5f9-4238-b325-9fdd9d3d5356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:50.695655 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b399a7-e5f9-4238-b325-9fdd9d3d5356 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:50.696789 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b399a7-e5f9-4238-b325-9fdd9d3d5356 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:50.697320 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b399a7-e5f9-4238-b325-9fdd9d3d5356 None admin] PATH_INFO: `/v3/users/e4a8b9c6b1e0452a9227e332a7f24751` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:50.724304 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b399a7-e5f9-4238-b325-9fdd9d3d5356 None admin] RBAC: Authorizing `identity:get_user(user_id=e4a8b9c6b1e0452a9227e332a7f24751)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:50.727005 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b399a7-e5f9-4238-b325-9fdd9d3d5356 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:50.729774 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 122/247] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 9 20:10:50 2022] GET /identity/v3/users/e4a8b9c6b1e0452a9227e332a7f24751 => generated 297 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:50.731726 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e079b3-afd0-4e6c-b0ed-ffbbc4585b9f None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:50.732287 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e079b3-afd0-4e6c-b0ed-ffbbc4585b9f None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:50.732694 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e079b3-afd0-4e6c-b0ed-ffbbc4585b9f None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:50.734753 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 123/248] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:10:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:10:50.743266 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e079b3-afd0-4e6c-b0ed-ffbbc4585b9f None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:50.793576 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5069d3b3-ae82-433f-8de4-fca1228fa35d None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:50.833139 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cd155d-81c8-4c0e-a9a8-a3dae7cd4035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:50.834102 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd155d-81c8-4c0e-a9a8-a3dae7cd4035 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:50.834447 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd155d-81c8-4c0e-a9a8-a3dae7cd4035 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:50.834778 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd155d-81c8-4c0e-a9a8-a3dae7cd4035 None admin] PATH_INFO: `/v3/users/947758f7ba33471b95545fb857af3369` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:50.836169 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cd155d-81c8-4c0e-a9a8-a3dae7cd4035 None admin] RBAC: Authorizing `identity:get_user(user_id=947758f7ba33471b95545fb857af3369)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:50.837819 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cd155d-81c8-4c0e-a9a8-a3dae7cd4035 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:50.839779 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 126/249] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 9 20:10:50 2022] GET /identity/v3/users/947758f7ba33471b95545fb857af3369 => generated 283 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:50.841097 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ac4d5-76a2-4d6a-a7d8-d4ff76cc470c None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:50.841373 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ac4d5-76a2-4d6a-a7d8-d4ff76cc470c None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:50.841642 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ac4d5-76a2-4d6a-a7d8-d4ff76cc470c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:50.863349 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-f02ac4d5-76a2-4d6a-a7d8-d4ff76cc470c None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:10:50.864750 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-f02ac4d5-76a2-4d6a-a7d8-d4ff76cc470c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:10:50.881627 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e079b3-afd0-4e6c-b0ed-ffbbc4585b9f None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:50.921911 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac65686-cce4-4deb-8cf3-3cb465aefd95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:50.922830 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac65686-cce4-4deb-8cf3-3cb465aefd95 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:50.923106 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac65686-cce4-4deb-8cf3-3cb465aefd95 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:50.923621 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac65686-cce4-4deb-8cf3-3cb465aefd95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:50.945640 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 127/250] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:10:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 20:10:50.947041 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ac4d5-76a2-4d6a-a7d8-d4ff76cc470c None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:51.035344 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac65686-cce4-4deb-8cf3-3cb465aefd95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:51.036981 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac65686-cce4-4deb-8cf3-3cb465aefd95 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:51.078425 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ac4d5-76a2-4d6a-a7d8-d4ff76cc470c None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:51.125479 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e9a1f6-6cb1-4b2d-aaf8-4c10046ce565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:51.126130 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9a1f6-6cb1-4b2d-aaf8-4c10046ce565 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:51.126408 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9a1f6-6cb1-4b2d-aaf8-4c10046ce565 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:51.126678 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9a1f6-6cb1-4b2d-aaf8-4c10046ce565 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:51.155264 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 124/251] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 9 20:10:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 20:10:51.156499 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac65686-cce4-4deb-8cf3-3cb465aefd95 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:51.212989 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e9a1f6-6cb1-4b2d-aaf8-4c10046ce565 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:51.215592 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e9a1f6-6cb1-4b2d-aaf8-4c10046ce565 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:51.260339 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac65686-cce4-4deb-8cf3-3cb465aefd95 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:51.306614 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95806a9-ae8e-4760-93fe-d2fc2c744af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:51.307886 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95806a9-ae8e-4760-93fe-d2fc2c744af3 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:51.308857 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95806a9-ae8e-4760-93fe-d2fc2c744af3 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:51.309358 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95806a9-ae8e-4760-93fe-d2fc2c744af3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:51.323633 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95806a9-ae8e-4760-93fe-d2fc2c744af3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:10:51.334847 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-b95806a9-ae8e-4760-93fe-d2fc2c744af3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 20:10:51.334847 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:10:51.334847 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:10:51.334847 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:10:51.334847 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:10:51.334847 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:10:51.334847 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:10:51.334847 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:10:51.334847 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:10:51.334847 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:10:51.334847 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:10:51.334847 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:10:51.334847 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:10:51.334847 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:10:51.334847 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:10:51.334847 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:10:51.335814 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:10:51.335814 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:10:51.335814 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:10:51.335814 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:10:51.335814 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:10:51.335814 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:10:51.335814 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:10:51.335814 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:10:51.335814 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:10:51.335814 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:10:51.335814 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:10:51.335814 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:10:51.335814 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:10:51.335814 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:10:51.335814 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:10:51.335814 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:10:51.336615 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:10:51.336615 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:10:51.336615 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:10:51.336615 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:10:51.336615 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:10:51.336615 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:10:51.336615 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:10:51.336615 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:10:51.336615 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:10:51.336615 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:10:51.336615 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 20:10:51.336615 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:10:51.338979 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 125/253] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 9 20:10:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:10:51.340004 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95806a9-ae8e-4760-93fe-d2fc2c744af3 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:51.343531 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 128/253] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 9 20:10:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 20:10:51.345004 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732ae2e-1b22-4eb6-a653-96e38a4785dc None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:51.345287 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732ae2e-1b22-4eb6-a653-96e38a4785dc None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:51.345559 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732ae2e-1b22-4eb6-a653-96e38a4785dc None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:51.346992 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 129/254] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:10:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:10:51.348152 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3732ae2e-1b22-4eb6-a653-96e38a4785dc None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:51.452644 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3732ae2e-1b22-4eb6-a653-96e38a4785dc None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:51.474369 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95806a9-ae8e-4760-93fe-d2fc2c744af3 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:51.497837 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc5d09a-ecbf-4ca4-88d8-74de4f45e29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:51.499324 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5d09a-ecbf-4ca4-88d8-74de4f45e29e None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:51.500026 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5d09a-ecbf-4ca4-88d8-74de4f45e29e None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:51.500826 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5d09a-ecbf-4ca4-88d8-74de4f45e29e None admin] PATH_INFO: `/v3/projects/45776741808d4cd98d7420b62d06836d` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:51.502668 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc5d09a-ecbf-4ca4-88d8-74de4f45e29e None admin] RBAC: Authorizing `identity:get_project(project_id=45776741808d4cd98d7420b62d06836d)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:51.505346 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc5d09a-ecbf-4ca4-88d8-74de4f45e29e None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:51.508418 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 130/255] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 9 20:10:51 2022] GET /identity/v3/projects/45776741808d4cd98d7420b62d06836d => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:51.510088 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888969f3-5814-4a7a-af2c-c8d47c5847bc None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:51.510574 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888969f3-5814-4a7a-af2c-c8d47c5847bc None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:51.511047 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888969f3-5814-4a7a-af2c-c8d47c5847bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:51.511151 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211a8548-08a2-4f74-b669-c1e88e6fc065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:51.512032 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a8548-08a2-4f74-b669-c1e88e6fc065 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:51.512312 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a8548-08a2-4f74-b669-c1e88e6fc065 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:51.512582 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a8548-08a2-4f74-b669-c1e88e6fc065 None admin] PATH_INFO: `/v3/projects/45776741808d4cd98d7420b62d06836d` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:51.513773 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211a8548-08a2-4f74-b669-c1e88e6fc065 None admin] RBAC: Authorizing `identity:get_project(project_id=45776741808d4cd98d7420b62d06836d)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:51.515220 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211a8548-08a2-4f74-b669-c1e88e6fc065 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:51.517079 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 126/256] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 9 20:10:51 2022] GET /identity/v3/projects/45776741808d4cd98d7420b62d06836d => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:51.517698 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211a8548-08a2-4f74-b669-c1e88e6fc065 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:51.533595 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-888969f3-5814-4a7a-af2c-c8d47c5847bc None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:10:51.535647 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-888969f3-5814-4a7a-af2c-c8d47c5847bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:10:51.624781 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211a8548-08a2-4f74-b669-c1e88e6fc065 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:51.630012 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 131/257] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:10:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 20:10:51.631865 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888969f3-5814-4a7a-af2c-c8d47c5847bc None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:51.684979 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48168ec7-13de-40b5-b7b5-e6f2a513fa0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:51.685647 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48168ec7-13de-40b5-b7b5-e6f2a513fa0f None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:51.686007 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48168ec7-13de-40b5-b7b5-e6f2a513fa0f None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:51.686203 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48168ec7-13de-40b5-b7b5-e6f2a513fa0f None admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:51.686951 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48168ec7-13de-40b5-b7b5-e6f2a513fa0f None admin] RBAC: Adding query filter params (name=member) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:10:51.687262 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48168ec7-13de-40b5-b7b5-e6f2a513fa0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:51.688727 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48168ec7-13de-40b5-b7b5-e6f2a513fa0f None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:51.697276 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 127/258] 10.222.0.44 () {56 vars in 1101 bytes} [Mon May 9 20:10:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:51.698158 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48168ec7-13de-40b5-b7b5-e6f2a513fa0f None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:51.738033 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888969f3-5814-4a7a-af2c-c8d47c5847bc None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:51.772996 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8c0554-3f4a-4544-bb0e-e1d10fd3f158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:51.773994 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c0554-3f4a-4544-bb0e-e1d10fd3f158 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:51.774504 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c0554-3f4a-4544-bb0e-e1d10fd3f158 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:51.775047 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c0554-3f4a-4544-bb0e-e1d10fd3f158 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:51.776111 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8c0554-3f4a-4544-bb0e-e1d10fd3f158 None admin] RBAC: Adding query filter params (role.id=274130b78e304bb88789c1b349263f3c, scope.project.id=45776741808d4cd98d7420b62d06836d, user.id=947758f7ba33471b95545fb857af3369) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:10:51.776619 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8c0554-3f4a-4544-bb0e-e1d10fd3f158 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:51.778270 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8c0554-3f4a-4544-bb0e-e1d10fd3f158 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:51.785450 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 132/259] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 9 20:10:51 2022] GET /identity/v3/role_assignments?user.id=947758f7ba33471b95545fb857af3369&scope.project.id=45776741808d4cd98d7420b62d06836d&role.id=274130b78e304bb88789c1b349263f3c => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:51.786664 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8c0554-3f4a-4544-bb0e-e1d10fd3f158 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:51.799111 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48168ec7-13de-40b5-b7b5-e6f2a513fa0f None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:51.835431 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a1d626-e189-4115-ace0-095c688dd88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:51.836168 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1d626-e189-4115-ace0-095c688dd88c None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:51.836451 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1d626-e189-4115-ace0-095c688dd88c None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:51.837184 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1d626-e189-4115-ace0-095c688dd88c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:51.837653 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a1d626-e189-4115-ace0-095c688dd88c None admin] RBAC: Adding query filter params (role.id=8957f6409fdf419abdc10d421c213a32, scope.project.id=45776741808d4cd98d7420b62d06836d, user.id=e4a8b9c6b1e0452a9227e332a7f24751) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:10:51.837965 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a1d626-e189-4115-ace0-095c688dd88c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:51.839500 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a1d626-e189-4115-ace0-095c688dd88c None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:51.845514 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 128/260] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 9 20:10:51 2022] GET /identity/v3/role_assignments?user.id=e4a8b9c6b1e0452a9227e332a7f24751&scope.project.id=45776741808d4cd98d7420b62d06836d&role.id=8957f6409fdf419abdc10d421c213a32 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:51.846328 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a1d626-e189-4115-ace0-095c688dd88c None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:51.896826 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8c0554-3f4a-4544-bb0e-e1d10fd3f158 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:51.937278 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70016557-836b-41ff-99c5-3a5847867061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:51.938430 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70016557-836b-41ff-99c5-3a5847867061 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:51.938939 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70016557-836b-41ff-99c5-3a5847867061 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:51.939454 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70016557-836b-41ff-99c5-3a5847867061 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:51.952262 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70016557-836b-41ff-99c5-3a5847867061 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:10:51.955698 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a1d626-e189-4115-ace0-095c688dd88c None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:51.962114 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-70016557-836b-41ff-99c5-3a5847867061 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 20:10:51.962114 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:10:51.962114 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:10:51.962114 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:10:51.962114 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:10:51.962114 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:10:51.962114 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:10:51.962114 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:10:51.962114 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:10:51.962114 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:10:51.962114 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:10:51.962114 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:10:51.962114 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:10:51.962114 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:10:51.962114 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:10:51.962114 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:10:51.963023 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:10:51.963023 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:10:51.963023 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:10:51.963023 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:10:51.963023 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:10:51.963023 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:10:51.963023 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:10:51.963023 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:10:51.963023 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:10:51.963023 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:10:51.963023 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:10:51.963023 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:10:51.963023 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:10:51.963023 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:10:51.963023 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:10:51.963023 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:10:51.963869 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:10:51.963869 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:10:51.963869 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:10:51.963869 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:10:51.963869 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:10:51.963869 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:10:51.963869 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:10:51.963869 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:10:51.963869 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:10:51.963869 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:10:51.963869 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 20:10:51.963869 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:10:51.966236 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 133/261] 10.222.0.44 () {56 vars in 1114 bytes} [Mon May 9 20:10:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:10:51.973164 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70016557-836b-41ff-99c5-3a5847867061 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:51.993055 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4482a978-527d-4dee-9f30-1f945bad3649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:51.993904 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482a978-527d-4dee-9f30-1f945bad3649 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:51.994188 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482a978-527d-4dee-9f30-1f945bad3649 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:51.994459 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482a978-527d-4dee-9f30-1f945bad3649 None admin] PATH_INFO: `/v3/users/50fc3eb69ed848a185235415605df687` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:51.995742 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4482a978-527d-4dee-9f30-1f945bad3649 None admin] RBAC: Authorizing `identity:get_user(user_id=50fc3eb69ed848a185235415605df687)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:51.997280 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4482a978-527d-4dee-9f30-1f945bad3649 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:51.999025 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 129/262] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 9 20:10:51 2022] GET /identity/v3/users/50fc3eb69ed848a185235415605df687 => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:52.005293 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4482a978-527d-4dee-9f30-1f945bad3649 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:52.085006 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70016557-836b-41ff-99c5-3a5847867061 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:52.110254 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4482a978-527d-4dee-9f30-1f945bad3649 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:52.121354 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff42da7-a3da-4b0e-aa56-f227e79ad86f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:52.122461 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff42da7-a3da-4b0e-aa56-f227e79ad86f None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:52.122974 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff42da7-a3da-4b0e-aa56-f227e79ad86f None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:52.123481 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff42da7-a3da-4b0e-aa56-f227e79ad86f None admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:52.124497 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff42da7-a3da-4b0e-aa56-f227e79ad86f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:10:52.125027 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff42da7-a3da-4b0e-aa56-f227e79ad86f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:52.126791 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff42da7-a3da-4b0e-aa56-f227e79ad86f None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:52.136727 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 134/263] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 9 20:10:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:52.142425 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff42da7-a3da-4b0e-aa56-f227e79ad86f None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:52.148187 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda5f6c-772e-49ef-9801-77902deebad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:52.149106 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda5f6c-772e-49ef-9801-77902deebad2 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:52.149387 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda5f6c-772e-49ef-9801-77902deebad2 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:52.149658 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda5f6c-772e-49ef-9801-77902deebad2 None admin] PATH_INFO: `/v3/projects/45776741808d4cd98d7420b62d06836d` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:52.150940 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beda5f6c-772e-49ef-9801-77902deebad2 None admin] RBAC: Authorizing `identity:get_project(project_id=45776741808d4cd98d7420b62d06836d)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:52.152512 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beda5f6c-772e-49ef-9801-77902deebad2 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:52.155193 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 130/264] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 9 20:10:52 2022] GET /identity/v3/projects/45776741808d4cd98d7420b62d06836d => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:10:52.160635 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda5f6c-772e-49ef-9801-77902deebad2 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:52.251322 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff42da7-a3da-4b0e-aa56-f227e79ad86f None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:52.262824 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda5f6c-772e-49ef-9801-77902deebad2 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:52.289099 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89efb9e-3c9e-4b18-8a5d-80edcfd3057a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:52.290329 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89efb9e-3c9e-4b18-8a5d-80edcfd3057a None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:52.290831 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89efb9e-3c9e-4b18-8a5d-80edcfd3057a None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:52.291297 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89efb9e-3c9e-4b18-8a5d-80edcfd3057a None admin] PATH_INFO: `/v3/users/947758f7ba33471b95545fb857af3369` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:52.292715 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89efb9e-3c9e-4b18-8a5d-80edcfd3057a None admin] RBAC: Authorizing `identity:get_user(user_id=947758f7ba33471b95545fb857af3369)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:52.294378 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89efb9e-3c9e-4b18-8a5d-80edcfd3057a None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:52.296335 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 135/265] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 9 20:10:52 2022] GET /identity/v3/users/947758f7ba33471b95545fb857af3369 => generated 283 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:10:52.301604 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def131a3-6b62-43ee-bb80-ee33f2408289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:52.302577 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def131a3-6b62-43ee-bb80-ee33f2408289 None admin] REQUEST_METHOD: `PUT` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:52.302860 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def131a3-6b62-43ee-bb80-ee33f2408289 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:52.303131 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def131a3-6b62-43ee-bb80-ee33f2408289 None admin] PATH_INFO: `/v3/projects/45776741808d4cd98d7420b62d06836d/users/50fc3eb69ed848a185235415605df687/roles/79f90a0bf6ea43d0b3c434e31556253a` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:52.303940 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89efb9e-3c9e-4b18-8a5d-80edcfd3057a None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:52.305256 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def131a3-6b62-43ee-bb80-ee33f2408289 None admin] RBAC: Authorizing `identity:create_grant(project_id=45776741808d4cd98d7420b62d06836d, user_id=50fc3eb69ed848a185235415605df687, role_id=79f90a0bf6ea43d0b3c434e31556253a)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:52.306722 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def131a3-6b62-43ee-bb80-ee33f2408289 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:52.333412 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 131/266] 10.222.0.44 () {58 vars in 1439 bytes} [Mon May 9 20:10:52 2022] PUT /identity/v3/projects/45776741808d4cd98d7420b62d06836d/users/50fc3eb69ed848a185235415605df687/roles/79f90a0bf6ea43d0b3c434e31556253a => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:10:52.416515 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89efb9e-3c9e-4b18-8a5d-80edcfd3057a None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:52.452562 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d59aa6-bab7-4d70-8a3f-f17d9aafd41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:52.453606 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d59aa6-bab7-4d70-8a3f-f17d9aafd41d None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:52.454090 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d59aa6-bab7-4d70-8a3f-f17d9aafd41d None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:52.454567 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d59aa6-bab7-4d70-8a3f-f17d9aafd41d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:52.529723 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d59aa6-bab7-4d70-8a3f-f17d9aafd41d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:52.531589 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d59aa6-bab7-4d70-8a3f-f17d9aafd41d None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:52.640553 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 136/267] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 9 20:10:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 09 20:10:52.646327 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def131a3-6b62-43ee-bb80-ee33f2408289 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:52.755172 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def131a3-6b62-43ee-bb80-ee33f2408289 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:52.794394 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ccd1f-313e-4b33-9e1f-58177a2ca7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:52.795687 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ccd1f-313e-4b33-9e1f-58177a2ca7f8 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:52.796164 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ccd1f-313e-4b33-9e1f-58177a2ca7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:52.796627 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ccd1f-313e-4b33-9e1f-58177a2ca7f8 None admin] PATH_INFO: `/v3/projects/45776741808d4cd98d7420b62d06836d` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:52.798008 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81ccd1f-313e-4b33-9e1f-58177a2ca7f8 None admin] RBAC: Authorizing `identity:get_project(project_id=45776741808d4cd98d7420b62d06836d)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:52.799689 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81ccd1f-313e-4b33-9e1f-58177a2ca7f8 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:52.801906 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 132/268] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 9 20:10:52 2022] GET /identity/v3/projects/45776741808d4cd98d7420b62d06836d => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:52.807909 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d59aa6-bab7-4d70-8a3f-f17d9aafd41d None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:52.948872 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d59aa6-bab7-4d70-8a3f-f17d9aafd41d None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:52.996799 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85365485-8816-4141-ae12-e426c7a17414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:52.997448 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85365485-8816-4141-ae12-e426c7a17414 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:52.997724 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85365485-8816-4141-ae12-e426c7a17414 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:52.997998 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85365485-8816-4141-ae12-e426c7a17414 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:52.998837 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85365485-8816-4141-ae12-e426c7a17414 None admin] RBAC: Adding query filter params (role.id=52c0c2910c294965839ef51e91b156a1, scope.project.id=45776741808d4cd98d7420b62d06836d, user.id=947758f7ba33471b95545fb857af3369) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:10:52.999145 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85365485-8816-4141-ae12-e426c7a17414 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:53.000635 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85365485-8816-4141-ae12-e426c7a17414 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:53.008051 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 137/269] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 9 20:10:52 2022] GET /identity/v3/role_assignments?user.id=947758f7ba33471b95545fb857af3369&scope.project.id=45776741808d4cd98d7420b62d06836d&role.id=52c0c2910c294965839ef51e91b156a1 => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:53.710900 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0195dc-05db-4a24-bee2-787e694aec3b None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:53.711908 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0195dc-05db-4a24-bee2-787e694aec3b None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:53.712408 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0195dc-05db-4a24-bee2-787e694aec3b None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:53.714187 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 133/270] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:10:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:10:53.719681 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2eb316-beb1-4b31-994f-869f9e94acf0 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:53.720191 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2eb316-beb1-4b31-994f-869f9e94acf0 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:53.720656 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2eb316-beb1-4b31-994f-869f9e94acf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:53.740095 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-5a2eb316-beb1-4b31-994f-869f9e94acf0 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:10:53.741669 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-5a2eb316-beb1-4b31-994f-869f9e94acf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:10:53.811520 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 138/271] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:10:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 20:10:53.837065 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0195dc-05db-4a24-bee2-787e694aec3b None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:53.849001 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa1ca8-c1f1-4ed9-b71d-db5b640a0139 None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:53.849724 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa1ca8-c1f1-4ed9-b71d-db5b640a0139 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:53.850460 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa1ca8-c1f1-4ed9-b71d-db5b640a0139 None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:53.852313 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 139/272] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:10:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:10:53.859511 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f74ea35-ac6a-4180-97a5-08764199fa58 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:53.859798 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f74ea35-ac6a-4180-97a5-08764199fa58 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:53.860077 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f74ea35-ac6a-4180-97a5-08764199fa58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:53.880108 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-6f74ea35-ac6a-4180-97a5-08764199fa58 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:10:53.881549 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-6f74ea35-ac6a-4180-97a5-08764199fa58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:10:53.942683 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0195dc-05db-4a24-bee2-787e694aec3b None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:53.967483 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 140/273] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:10:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 20:10:53.980710 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f375102-9949-40e5-9408-87e16f62149e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:53.981964 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f375102-9949-40e5-9408-87e16f62149e None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:53.982526 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f375102-9949-40e5-9408-87e16f62149e None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:53.983042 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f375102-9949-40e5-9408-87e16f62149e None admin] PATH_INFO: `/v3/domains/default` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:53.984477 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f375102-9949-40e5-9408-87e16f62149e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:53.986098 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f375102-9949-40e5-9408-87e16f62149e None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:53.988352 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 134/274] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:10:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:53.996445 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f375102-9949-40e5-9408-87e16f62149e None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:53.996725 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f74ea35-ac6a-4180-97a5-08764199fa58 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:54.104826 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f375102-9949-40e5-9408-87e16f62149e None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:54.104997 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f74ea35-ac6a-4180-97a5-08764199fa58 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:54.144953 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f4ac40-2e69-4786-8a7a-d23032034a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:54.145961 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f4ac40-2e69-4786-8a7a-d23032034a74 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:54.146335 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f4ac40-2e69-4786-8a7a-d23032034a74 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:54.146674 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f4ac40-2e69-4786-8a7a-d23032034a74 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:54.148162 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c44f21-5895-4ccc-b4da-c6d9c4a6e602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:54.148986 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c44f21-5895-4ccc-b4da-c6d9c4a6e602 None admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:54.149542 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c44f21-5895-4ccc-b4da-c6d9c4a6e602 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:54.149820 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c44f21-5895-4ccc-b4da-c6d9c4a6e602 None admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:54.150516 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c44f21-5895-4ccc-b4da-c6d9c4a6e602 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:54.152318 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c44f21-5895-4ccc-b4da-c6d9c4a6e602 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:54.157183 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f4ac40-2e69-4786-8a7a-d23032034a74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:10:54.168670 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-e4f4ac40-2e69-4786-8a7a-d23032034a74 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 20:10:54.168670 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:10:54.168670 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:10:54.168670 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:10:54.168670 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:10:54.168670 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:10:54.168670 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:10:54.168670 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:10:54.168670 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:10:54.168670 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:10:54.168670 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:10:54.168670 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:10:54.168670 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:10:54.168670 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:10:54.168670 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:10:54.168670 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:10:54.169811 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:10:54.169811 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:10:54.169811 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:10:54.169811 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:10:54.169811 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:10:54.169811 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:10:54.169811 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:10:54.169811 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:10:54.169811 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:10:54.169811 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:10:54.169811 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:10:54.169811 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:10:54.169811 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:10:54.169811 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:10:54.169811 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:10:54.169811 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:10:54.170771 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:10:54.170771 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:10:54.170771 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:10:54.170771 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:10:54.170771 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:10:54.170771 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:10:54.170771 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:10:54.170771 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:10:54.170771 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:10:54.170771 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:10:54.170771 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 20:10:54.170771 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:10:54.172693 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 135/275] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 9 20:10:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:10:54.174387 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 141/276] 10.222.0.44 () {60 vars in 1132 bytes} [Mon May 9 20:10:53 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:10:54.180635 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f4ac40-2e69-4786-8a7a-d23032034a74 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:54.303244 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f4ac40-2e69-4786-8a7a-d23032034a74 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:54.340287 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39651e8-0f80-4645-9978-2badf5db9fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:54.341053 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39651e8-0f80-4645-9978-2badf5db9fa3 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:54.341332 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39651e8-0f80-4645-9978-2badf5db9fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:54.341600 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39651e8-0f80-4645-9978-2badf5db9fa3 None admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:54.342361 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39651e8-0f80-4645-9978-2badf5db9fa3 None admin] RBAC: Adding query filter params (name=member) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:10:54.342660 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39651e8-0f80-4645-9978-2badf5db9fa3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:54.344147 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39651e8-0f80-4645-9978-2badf5db9fa3 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:54.354719 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 136/277] 10.222.0.44 () {56 vars in 1101 bytes} [Mon May 9 20:10:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:54.360660 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c44f21-5895-4ccc-b4da-c6d9c4a6e602 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:54.466760 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c44f21-5895-4ccc-b4da-c6d9c4a6e602 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:54.504813 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a294b9f-6de2-4d4c-ac03-fd60a5061d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:54.505939 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a294b9f-6de2-4d4c-ac03-fd60a5061d1d None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:54.506208 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a294b9f-6de2-4d4c-ac03-fd60a5061d1d None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:54.506473 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a294b9f-6de2-4d4c-ac03-fd60a5061d1d None admin] PATH_INFO: `/v3/users/29d29b3e8b194d3b8ad8bacbef7b11ac` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:54.520761 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a294b9f-6de2-4d4c-ac03-fd60a5061d1d None admin] RBAC: Authorizing `identity:get_user(user_id=29d29b3e8b194d3b8ad8bacbef7b11ac)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:54.522216 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a294b9f-6de2-4d4c-ac03-fd60a5061d1d None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:54.524125 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 142/278] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 9 20:10:54 2022] GET /identity/v3/users/29d29b3e8b194d3b8ad8bacbef7b11ac => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:54.529836 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39651e8-0f80-4645-9978-2badf5db9fa3 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:54.641201 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34842fb5-46e7-4e7f-8123-660a932b2fed None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:54.641496 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34842fb5-46e7-4e7f-8123-660a932b2fed None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:54.641662 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34842fb5-46e7-4e7f-8123-660a932b2fed None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:54.643168 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 143/279] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:10:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:10:54.648995 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f66129e-369f-4da1-bb0d-f1dc542b31c8 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:54.649280 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f66129e-369f-4da1-bb0d-f1dc542b31c8 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:54.649552 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f66129e-369f-4da1-bb0d-f1dc542b31c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:54.670544 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-8f66129e-369f-4da1-bb0d-f1dc542b31c8 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:10:54.672341 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39651e8-0f80-4645-9978-2badf5db9fa3 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:54.673821 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-8f66129e-369f-4da1-bb0d-f1dc542b31c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:10:54.707099 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abf6640-f85b-4d03-a886-f9089e5f728a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:54.707789 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf6640-f85b-4d03-a886-f9089e5f728a None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:54.708066 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf6640-f85b-4d03-a886-f9089e5f728a None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:54.708330 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf6640-f85b-4d03-a886-f9089e5f728a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:54.709155 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abf6640-f85b-4d03-a886-f9089e5f728a None admin] RBAC: Adding query filter params (role.id=79f90a0bf6ea43d0b3c434e31556253a, user.id=29d29b3e8b194d3b8ad8bacbef7b11ac, scope.system=all) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:10:54.709458 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abf6640-f85b-4d03-a886-f9089e5f728a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:54.710901 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abf6640-f85b-4d03-a886-f9089e5f728a None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:54.719519 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 137/280] 10.222.0.44 () {56 vars in 1308 bytes} [Mon May 9 20:10:54 2022] GET /identity/v3/role_assignments?user.id=29d29b3e8b194d3b8ad8bacbef7b11ac&scope.system=all&role.id=79f90a0bf6ea43d0b3c434e31556253a => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:54.754971 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 144/281] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:10:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 20:10:54.778616 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abf6640-f85b-4d03-a886-f9089e5f728a None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:54.893276 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abf6640-f85b-4d03-a886-f9089e5f728a None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:54.932292 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfac718-42f2-4fa4-9c7a-8ad6fb732676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:54.933112 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfac718-42f2-4fa4-9c7a-8ad6fb732676 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:54.933397 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfac718-42f2-4fa4-9c7a-8ad6fb732676 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:54.933671 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfac718-42f2-4fa4-9c7a-8ad6fb732676 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:54.950129 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfac718-42f2-4fa4-9c7a-8ad6fb732676 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:10:54.958289 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-1bfac718-42f2-4fa4-9c7a-8ad6fb732676 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 09 20:10:54.958289 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:10:54.958289 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:10:54.958289 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:10:54.958289 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:10:54.958289 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:10:54.958289 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:10:54.958289 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:10:54.958289 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:10:54.958289 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:10:54.958289 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:10:54.958289 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:10:54.958289 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:10:54.958289 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:10:54.958289 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:10:54.958289 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:10:54.959182 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:10:54.959182 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:10:54.959182 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:10:54.959182 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:10:54.959182 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:10:54.959182 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:10:54.959182 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:10:54.959182 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:10:54.959182 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:10:54.959182 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:10:54.959182 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:10:54.959182 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:10:54.959182 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:10:54.959182 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:10:54.959182 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:10:54.959182 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:10:54.960006 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:10:54.960006 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:10:54.960006 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:10:54.960006 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:10:54.960006 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:10:54.960006 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:10:54.960006 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:10:54.960006 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:10:54.960006 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:10:54.960006 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:10:54.960006 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 09 20:10:54.960006 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:10:54.962722 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 138/282] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 9 20:10:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:10:54.968146 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f66129e-369f-4da1-bb0d-f1dc542b31c8 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:54.968813 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51258a4a-df38-4d01-ada6-2d28d3ff3a92 None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:54.969098 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51258a4a-df38-4d01-ada6-2d28d3ff3a92 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:54.969372 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51258a4a-df38-4d01-ada6-2d28d3ff3a92 None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:54.970914 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 139/283] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:10:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 20:10:54.978426 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a7f4e-7c7d-4e2c-a50f-bda61a434956 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:54.979053 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a7f4e-7c7d-4e2c-a50f-bda61a434956 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:54.979585 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a7f4e-7c7d-4e2c-a50f-bda61a434956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:54.998985 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-8e6a7f4e-7c7d-4e2c-a50f-bda61a434956 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:10:55.000546 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-8e6a7f4e-7c7d-4e2c-a50f-bda61a434956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:10:55.106078 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f66129e-369f-4da1-bb0d-f1dc542b31c8 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:55.147067 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa95f21-eef5-42d0-8724-f5be238a0788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:55.148217 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa95f21-eef5-42d0-8724-f5be238a0788 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:55.148495 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa95f21-eef5-42d0-8724-f5be238a0788 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:55.148763 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa95f21-eef5-42d0-8724-f5be238a0788 None admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:55.149499 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa95f21-eef5-42d0-8724-f5be238a0788 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:10:55.149798 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa95f21-eef5-42d0-8724-f5be238a0788 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:55.151166 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa95f21-eef5-42d0-8724-f5be238a0788 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:55.153044 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 140/284] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:10:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 20:10:55.161885 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 145/285] 10.222.0.44 () {56 vars in 1101 bytes} [Mon May 9 20:10:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:55.167466 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6a7f4e-7c7d-4e2c-a50f-bda61a434956 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:55.196961 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa95f21-eef5-42d0-8724-f5be238a0788 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:55.271838 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6a7f4e-7c7d-4e2c-a50f-bda61a434956 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:55.310138 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec3ef1b-aa60-404f-8913-bde68e649ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:55.311011 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec3ef1b-aa60-404f-8913-bde68e649ce6 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:55.311291 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec3ef1b-aa60-404f-8913-bde68e649ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:55.311588 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec3ef1b-aa60-404f-8913-bde68e649ce6 None admin] PATH_INFO: `/v3/users/e4a8b9c6b1e0452a9227e332a7f24751` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:55.316284 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec3ef1b-aa60-404f-8913-bde68e649ce6 None admin] RBAC: Authorizing `identity:get_user(user_id=e4a8b9c6b1e0452a9227e332a7f24751)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:55.317742 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec3ef1b-aa60-404f-8913-bde68e649ce6 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:55.319579 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 141/286] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 9 20:10:55 2022] GET /identity/v3/users/e4a8b9c6b1e0452a9227e332a7f24751 => generated 297 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:55.325177 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec3ef1b-aa60-404f-8913-bde68e649ce6 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:55.373475 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa95f21-eef5-42d0-8724-f5be238a0788 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:55.412749 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557b3f2e-770d-4425-bb7e-bdd656dbd542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:55.413467 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b3f2e-770d-4425-bb7e-bdd656dbd542 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:55.413743 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b3f2e-770d-4425-bb7e-bdd656dbd542 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:55.414002 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b3f2e-770d-4425-bb7e-bdd656dbd542 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:55.436318 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557b3f2e-770d-4425-bb7e-bdd656dbd542 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:10:55.444250 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-557b3f2e-770d-4425-bb7e-bdd656dbd542 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 20:10:55.444250 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:10:55.444250 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:10:55.444250 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:10:55.444250 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:10:55.444250 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:10:55.444250 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:10:55.444250 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:10:55.444250 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:10:55.444250 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:10:55.444250 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:10:55.444250 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:10:55.444250 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:10:55.444250 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:10:55.444250 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:10:55.444250 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:10:55.445123 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:10:55.445123 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:10:55.445123 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:10:55.445123 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:10:55.445123 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:10:55.445123 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:10:55.445123 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:10:55.445123 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:10:55.445123 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:10:55.445123 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:10:55.445123 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:10:55.445123 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:10:55.445123 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:10:55.445123 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:10:55.445123 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:10:55.445123 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:10:55.445910 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:10:55.445910 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:10:55.445910 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:10:55.445910 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:10:55.445910 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:10:55.445910 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:10:55.445910 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:10:55.445910 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:10:55.445910 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:10:55.445910 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:10:55.445910 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 20:10:55.445910 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:10:55.445910 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 146/287] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 9 20:10:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:10:55.458489 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557b3f2e-770d-4425-bb7e-bdd656dbd542 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:55.541015 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec3ef1b-aa60-404f-8913-bde68e649ce6 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:55.585798 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3a9fac-576d-4d17-a036-43cbba766af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:55.586657 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a9fac-576d-4d17-a036-43cbba766af2 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:55.586927 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a9fac-576d-4d17-a036-43cbba766af2 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:55.587190 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a9fac-576d-4d17-a036-43cbba766af2 None admin] PATH_INFO: `/v3/projects/45776741808d4cd98d7420b62d06836d` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:55.589635 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3a9fac-576d-4d17-a036-43cbba766af2 None admin] RBAC: Authorizing `identity:get_project(project_id=45776741808d4cd98d7420b62d06836d)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:55.591074 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3a9fac-576d-4d17-a036-43cbba766af2 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:55.592969 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 142/288] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 9 20:10:55 2022] GET /identity/v3/projects/45776741808d4cd98d7420b62d06836d => generated 302 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:55.599246 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3a9fac-576d-4d17-a036-43cbba766af2 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:55.657919 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557b3f2e-770d-4425-bb7e-bdd656dbd542 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:55.738126 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3a9fac-576d-4d17-a036-43cbba766af2 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:55.740443 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3d0d89-174f-4dfc-bfb1-edcf8a171476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:55.741123 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3d0d89-174f-4dfc-bfb1-edcf8a171476 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:55.741465 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3d0d89-174f-4dfc-bfb1-edcf8a171476 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:55.741738 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3d0d89-174f-4dfc-bfb1-edcf8a171476 None admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:55.742487 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3d0d89-174f-4dfc-bfb1-edcf8a171476 None admin] RBAC: Adding query filter params (name=member) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:10:55.742790 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3d0d89-174f-4dfc-bfb1-edcf8a171476 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:55.748425 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3d0d89-174f-4dfc-bfb1-edcf8a171476 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:55.766633 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 147/289] 10.222.0.44 () {56 vars in 1101 bytes} [Mon May 9 20:10:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:55.772994 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3d0d89-174f-4dfc-bfb1-edcf8a171476 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:55.785562 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8a2dd7-8025-405c-b411-641794e9ff3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:55.786779 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a2dd7-8025-405c-b411-641794e9ff3b None admin] REQUEST_METHOD: `PUT` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:55.787058 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a2dd7-8025-405c-b411-641794e9ff3b None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:55.787634 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a2dd7-8025-405c-b411-641794e9ff3b None admin] PATH_INFO: `/v3/projects/45776741808d4cd98d7420b62d06836d/users/e4a8b9c6b1e0452a9227e332a7f24751/roles/8957f6409fdf419abdc10d421c213a32` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:55.794943 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8a2dd7-8025-405c-b411-641794e9ff3b None admin] RBAC: Authorizing `identity:create_grant(project_id=45776741808d4cd98d7420b62d06836d, user_id=e4a8b9c6b1e0452a9227e332a7f24751, role_id=8957f6409fdf419abdc10d421c213a32)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:55.796446 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8a2dd7-8025-405c-b411-641794e9ff3b None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:55.823064 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 143/290] 10.222.0.44 () {58 vars in 1439 bytes} [Mon May 9 20:10:55 2022] PUT /identity/v3/projects/45776741808d4cd98d7420b62d06836d/users/e4a8b9c6b1e0452a9227e332a7f24751/roles/8957f6409fdf419abdc10d421c213a32 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:10:55.893256 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3d0d89-174f-4dfc-bfb1-edcf8a171476 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:55.935246 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c487300-e5c9-4fdf-945b-3257b6bd6293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:55.936554 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c487300-e5c9-4fdf-945b-3257b6bd6293 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:55.937045 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c487300-e5c9-4fdf-945b-3257b6bd6293 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:55.937520 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c487300-e5c9-4fdf-945b-3257b6bd6293 None admin] PATH_INFO: `/v3/users/50fc3eb69ed848a185235415605df687` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:55.944322 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c487300-e5c9-4fdf-945b-3257b6bd6293 None admin] RBAC: Authorizing `identity:get_user(user_id=50fc3eb69ed848a185235415605df687)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:55.946141 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c487300-e5c9-4fdf-945b-3257b6bd6293 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:55.948532 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 148/291] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 9 20:10:55 2022] GET /identity/v3/users/50fc3eb69ed848a185235415605df687 => generated 297 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:10:55.953757 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8a2dd7-8025-405c-b411-641794e9ff3b None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:56.107585 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8a2dd7-8025-405c-b411-641794e9ff3b None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:56.145491 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d080f22-ec6b-4d7f-86f3-f40350ef56d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:56.146153 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d080f22-ec6b-4d7f-86f3-f40350ef56d2 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:56.146432 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d080f22-ec6b-4d7f-86f3-f40350ef56d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:56.146703 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d080f22-ec6b-4d7f-86f3-f40350ef56d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:56.214937 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d080f22-ec6b-4d7f-86f3-f40350ef56d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:56.216450 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d080f22-ec6b-4d7f-86f3-f40350ef56d2 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:56.317150 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 144/292] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 9 20:10:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 20:10:56.324440 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c487300-e5c9-4fdf-945b-3257b6bd6293 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:56.475612 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c487300-e5c9-4fdf-945b-3257b6bd6293 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:56.526760 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92287fa8-51c2-4a0d-8e91-0d1d00c328ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:56.527911 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92287fa8-51c2-4a0d-8e91-0d1d00c328ef None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:56.528336 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92287fa8-51c2-4a0d-8e91-0d1d00c328ef None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:56.528751 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92287fa8-51c2-4a0d-8e91-0d1d00c328ef None admin] PATH_INFO: `/v3/projects/45776741808d4cd98d7420b62d06836d` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:56.534929 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92287fa8-51c2-4a0d-8e91-0d1d00c328ef None admin] RBAC: Authorizing `identity:get_project(project_id=45776741808d4cd98d7420b62d06836d)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:56.536596 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92287fa8-51c2-4a0d-8e91-0d1d00c328ef None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:56.538794 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 149/293] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 9 20:10:56 2022] GET /identity/v3/projects/45776741808d4cd98d7420b62d06836d => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:56.544327 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d080f22-ec6b-4d7f-86f3-f40350ef56d2 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:56.693358 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d080f22-ec6b-4d7f-86f3-f40350ef56d2 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:56.746299 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a13827-db39-49a9-92c6-2af04343914d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:56.747673 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a13827-db39-49a9-92c6-2af04343914d None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:56.748096 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a13827-db39-49a9-92c6-2af04343914d None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:56.748524 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a13827-db39-49a9-92c6-2af04343914d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:56.749512 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a13827-db39-49a9-92c6-2af04343914d None admin] RBAC: Adding query filter params (role.id=79f90a0bf6ea43d0b3c434e31556253a, scope.project.id=45776741808d4cd98d7420b62d06836d, user.id=50fc3eb69ed848a185235415605df687) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:10:56.749962 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a13827-db39-49a9-92c6-2af04343914d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:56.751588 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a13827-db39-49a9-92c6-2af04343914d None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:56.764380 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 145/294] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 9 20:10:56 2022] GET /identity/v3/role_assignments?user.id=50fc3eb69ed848a185235415605df687&scope.project.id=45776741808d4cd98d7420b62d06836d&role.id=79f90a0bf6ea43d0b3c434e31556253a => generated 608 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:56.961304 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323738d0-f264-4440-92eb-5b5e7e9670ce None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:56.961304 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323738d0-f264-4440-92eb-5b5e7e9670ce None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:56.961304 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323738d0-f264-4440-92eb-5b5e7e9670ce None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:56.961304 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 150/295] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:10:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:10:56.977828 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4040cb01-fefa-450e-82de-9a7293481fa8 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:56.978443 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4040cb01-fefa-450e-82de-9a7293481fa8 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:56.978918 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4040cb01-fefa-450e-82de-9a7293481fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:56.997501 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-4040cb01-fefa-450e-82de-9a7293481fa8 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:10:56.999027 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-4040cb01-fefa-450e-82de-9a7293481fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:10:57.069030 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 146/296] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:10:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 20:10:57.094439 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323738d0-f264-4440-92eb-5b5e7e9670ce None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:57.211031 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323738d0-f264-4440-92eb-5b5e7e9670ce None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:57.257720 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db9d29-f8ae-4575-863d-60fd8fb68904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:57.258454 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db9d29-f8ae-4575-863d-60fd8fb68904 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:57.258733 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db9d29-f8ae-4575-863d-60fd8fb68904 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:57.259002 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db9d29-f8ae-4575-863d-60fd8fb68904 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:57.273381 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1db9d29-f8ae-4575-863d-60fd8fb68904 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:10:57.279856 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f06bd3-dea7-4e16-9443-925e4589b3e2 None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:57.280485 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f06bd3-dea7-4e16-9443-925e4589b3e2 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:57.280960 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f06bd3-dea7-4e16-9443-925e4589b3e2 None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:57.281179 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-a1db9d29-f8ae-4575-863d-60fd8fb68904 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 09 20:10:57.281179 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:10:57.281179 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:10:57.281179 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:10:57.281179 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:10:57.281179 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:10:57.281179 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:10:57.281179 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:10:57.281179 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:10:57.281179 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:10:57.281179 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:10:57.281179 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:10:57.281179 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:10:57.281179 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:10:57.281179 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:10:57.281179 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:10:57.282041 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:10:57.282041 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:10:57.282041 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:10:57.282041 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:10:57.282041 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:10:57.282041 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:10:57.282041 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:10:57.282041 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:10:57.282041 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:10:57.282041 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:10:57.282041 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:10:57.282041 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:10:57.282041 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:10:57.282041 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:10:57.282041 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:10:57.282041 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:10:57.282822 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:10:57.282822 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:10:57.282822 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:10:57.282822 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:10:57.282822 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:10:57.282822 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:10:57.282822 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:10:57.282822 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:10:57.282822 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:10:57.282822 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:10:57.282822 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 09 20:10:57.282822 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:10:57.282822 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 151/297] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 9 20:10:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:10:57.287078 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 147/298] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:10:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 20:10:57.288118 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db9d29-f8ae-4575-863d-60fd8fb68904 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:57.290972 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ffd989-a5c3-4bd9-9e1a-1fa4dbeb0094 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:57.291258 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ffd989-a5c3-4bd9-9e1a-1fa4dbeb0094 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:57.291562 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ffd989-a5c3-4bd9-9e1a-1fa4dbeb0094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:57.327204 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-17ffd989-a5c3-4bd9-9e1a-1fa4dbeb0094 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:10:57.328662 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-17ffd989-a5c3-4bd9-9e1a-1fa4dbeb0094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:10:57.403054 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db9d29-f8ae-4575-863d-60fd8fb68904 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:57.407719 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 148/299] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:10:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 20:10:57.430011 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ffd989-a5c3-4bd9-9e1a-1fa4dbeb0094 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:57.439121 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0cdc1c-1810-4694-ae40-8329850786c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:57.440111 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0cdc1c-1810-4694-ae40-8329850786c3 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:57.440493 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0cdc1c-1810-4694-ae40-8329850786c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:57.440885 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0cdc1c-1810-4694-ae40-8329850786c3 None admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:57.441855 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0cdc1c-1810-4694-ae40-8329850786c3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:10:57.442229 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0cdc1c-1810-4694-ae40-8329850786c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:57.443719 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0cdc1c-1810-4694-ae40-8329850786c3 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:57.452234 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 152/300] 10.222.0.44 () {56 vars in 1101 bytes} [Mon May 9 20:10:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:10:57.460065 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0cdc1c-1810-4694-ae40-8329850786c3 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:57.542665 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ffd989-a5c3-4bd9-9e1a-1fa4dbeb0094 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:57.575024 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0cdc1c-1810-4694-ae40-8329850786c3 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:57.583540 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1ebb86-1d70-4a6c-9f4d-b3dc5b3bc5b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:57.584331 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1ebb86-1d70-4a6c-9f4d-b3dc5b3bc5b6 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:57.584630 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1ebb86-1d70-4a6c-9f4d-b3dc5b3bc5b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:57.584893 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1ebb86-1d70-4a6c-9f4d-b3dc5b3bc5b6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:57.586021 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1ebb86-1d70-4a6c-9f4d-b3dc5b3bc5b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:57.587480 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1ebb86-1d70-4a6c-9f4d-b3dc5b3bc5b6 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:57.589287 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 149/301] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:10:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:10:57.590227 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293e539a-65df-4735-ad35-8fd48c0d3dbd None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:57.590503 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293e539a-65df-4735-ad35-8fd48c0d3dbd None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:57.590770 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293e539a-65df-4735-ad35-8fd48c0d3dbd None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:57.591984 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 150/302] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:10:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:10:57.595985 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293e539a-65df-4735-ad35-8fd48c0d3dbd None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:57.610304 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75fb39e-232b-4649-9bb5-91dfa0b3204e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:57.611167 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75fb39e-232b-4649-9bb5-91dfa0b3204e None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:57.611480 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75fb39e-232b-4649-9bb5-91dfa0b3204e None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:57.611756 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75fb39e-232b-4649-9bb5-91dfa0b3204e None admin] PATH_INFO: `/v3/users/937b5c3519044bd5ba73e11dc3bdb468` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:57.626668 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75fb39e-232b-4649-9bb5-91dfa0b3204e None admin] RBAC: Authorizing `identity:get_user(user_id=937b5c3519044bd5ba73e11dc3bdb468)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:57.628986 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75fb39e-232b-4649-9bb5-91dfa0b3204e None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:57.631191 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 153/303] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 9 20:10:57 2022] GET /identity/v3/users/937b5c3519044bd5ba73e11dc3bdb468 => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:10:57.632636 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d336f2-09ce-4ad2-a21b-8ce1eb0c41af None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:57.632911 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d336f2-09ce-4ad2-a21b-8ce1eb0c41af None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:57.633187 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d336f2-09ce-4ad2-a21b-8ce1eb0c41af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:57.649126 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-63d336f2-09ce-4ad2-a21b-8ce1eb0c41af None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:10:57.650306 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-63d336f2-09ce-4ad2-a21b-8ce1eb0c41af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:10:57.703249 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293e539a-65df-4735-ad35-8fd48c0d3dbd None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:57.713668 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 154/304] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:10:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 20:10:57.714678 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d336f2-09ce-4ad2-a21b-8ce1eb0c41af None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:57.745919 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf852d01-c632-4bd8-b82e-50579889d7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:57.746828 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf852d01-c632-4bd8-b82e-50579889d7f7 None admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:57.747710 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf852d01-c632-4bd8-b82e-50579889d7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:57.748125 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf852d01-c632-4bd8-b82e-50579889d7f7 None admin] PATH_INFO: `/v3/groups` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:57.748943 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf852d01-c632-4bd8-b82e-50579889d7f7 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:57.750512 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf852d01-c632-4bd8-b82e-50579889d7f7 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:57.775851 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 151/305] 10.222.0.44 () {60 vars in 1134 bytes} [Mon May 9 20:10:57 2022] POST /identity/v3/groups => generated 229 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:10:57.777103 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf852d01-c632-4bd8-b82e-50579889d7f7 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:57.830398 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d336f2-09ce-4ad2-a21b-8ce1eb0c41af None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:57.868965 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c9b3aa-2d8e-4fea-8325-66cba3b3e034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:57.869878 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c9b3aa-2d8e-4fea-8325-66cba3b3e034 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:57.870325 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c9b3aa-2d8e-4fea-8325-66cba3b3e034 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:57.870745 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c9b3aa-2d8e-4fea-8325-66cba3b3e034 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:57.871782 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c9b3aa-2d8e-4fea-8325-66cba3b3e034 None admin] RBAC: Adding query filter params (role.id=8957f6409fdf419abdc10d421c213a32, user.id=937b5c3519044bd5ba73e11dc3bdb468, scope.system=all) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:10:57.872240 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c9b3aa-2d8e-4fea-8325-66cba3b3e034 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:57.873871 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c9b3aa-2d8e-4fea-8325-66cba3b3e034 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:57.880597 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 155/306] 10.222.0.44 () {56 vars in 1308 bytes} [Mon May 9 20:10:57 2022] GET /identity/v3/role_assignments?user.id=937b5c3519044bd5ba73e11dc3bdb468&scope.system=all&role.id=8957f6409fdf419abdc10d421c213a32 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:57.888852 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf852d01-c632-4bd8-b82e-50579889d7f7 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:57.929776 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78583fe-f6b7-4d0d-98b6-f53aac171417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:57.930866 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78583fe-f6b7-4d0d-98b6-f53aac171417 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:57.931300 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78583fe-f6b7-4d0d-98b6-f53aac171417 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:57.931783 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78583fe-f6b7-4d0d-98b6-f53aac171417 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:57.945657 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78583fe-f6b7-4d0d-98b6-f53aac171417 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:10:57.953910 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-b78583fe-f6b7-4d0d-98b6-f53aac171417 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 20:10:57.953910 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:10:57.953910 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:10:57.953910 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:10:57.953910 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:10:57.953910 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:10:57.953910 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:10:57.953910 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:10:57.953910 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:10:57.953910 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:10:57.953910 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:10:57.953910 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:10:57.953910 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:10:57.953910 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:10:57.953910 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:10:57.953910 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:10:57.955061 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:10:57.955061 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:10:57.955061 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:10:57.955061 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:10:57.955061 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:10:57.955061 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:10:57.955061 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:10:57.955061 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:10:57.955061 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:10:57.955061 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:10:57.955061 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:10:57.955061 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:10:57.955061 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:10:57.955061 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:10:57.955061 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:10:57.955061 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:10:57.956120 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:10:57.956120 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:10:57.956120 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:10:57.956120 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:10:57.956120 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:10:57.956120 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:10:57.956120 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:10:57.956120 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:10:57.956120 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:10:57.956120 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:10:57.956120 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 20:10:57.956120 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:10:57.959145 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 152/307] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 9 20:10:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:10:57.964936 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c9b3aa-2d8e-4fea-8325-66cba3b3e034 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:58.078736 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c9b3aa-2d8e-4fea-8325-66cba3b3e034 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:58.115187 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454ff302-7062-4af7-a6a6-4a6c2692268a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:58.115860 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ff302-7062-4af7-a6a6-4a6c2692268a None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:58.116136 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ff302-7062-4af7-a6a6-4a6c2692268a None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:58.116454 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ff302-7062-4af7-a6a6-4a6c2692268a None admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:58.117204 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454ff302-7062-4af7-a6a6-4a6c2692268a None admin] RBAC: Adding query filter params (name=member) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:10:58.117503 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454ff302-7062-4af7-a6a6-4a6c2692268a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:58.118877 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454ff302-7062-4af7-a6a6-4a6c2692268a None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:58.127606 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 156/308] 10.222.0.44 () {56 vars in 1101 bytes} [Mon May 9 20:10:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:58.133417 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78583fe-f6b7-4d0d-98b6-f53aac171417 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:58.234939 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78583fe-f6b7-4d0d-98b6-f53aac171417 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:58.270633 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf5d0c0-ac6e-419a-85c1-a224cc2f8583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:58.271886 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5d0c0-ac6e-419a-85c1-a224cc2f8583 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:58.272369 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5d0c0-ac6e-419a-85c1-a224cc2f8583 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:58.272867 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5d0c0-ac6e-419a-85c1-a224cc2f8583 None admin] PATH_INFO: `/v3/users/29d29b3e8b194d3b8ad8bacbef7b11ac` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:58.274262 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf5d0c0-ac6e-419a-85c1-a224cc2f8583 None admin] RBAC: Authorizing `identity:get_user(user_id=29d29b3e8b194d3b8ad8bacbef7b11ac)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:58.275940 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf5d0c0-ac6e-419a-85c1-a224cc2f8583 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:58.277767 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 153/309] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 9 20:10:58 2022] GET /identity/v3/users/29d29b3e8b194d3b8ad8bacbef7b11ac => generated 293 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:10:58.283205 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454ff302-7062-4af7-a6a6-4a6c2692268a None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:58.386767 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454ff302-7062-4af7-a6a6-4a6c2692268a None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:58.426529 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b6085-bda9-49ed-940b-abea9553fcdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:58.427405 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b6085-bda9-49ed-940b-abea9553fcdc None admin] REQUEST_METHOD: `PUT` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:58.427694 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b6085-bda9-49ed-940b-abea9553fcdc None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:58.427967 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b6085-bda9-49ed-940b-abea9553fcdc None admin] PATH_INFO: `/v3/system/users/29d29b3e8b194d3b8ad8bacbef7b11ac/roles/79f90a0bf6ea43d0b3c434e31556253a` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:58.429469 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76b6085-bda9-49ed-940b-abea9553fcdc None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=29d29b3e8b194d3b8ad8bacbef7b11ac, role_id=79f90a0bf6ea43d0b3c434e31556253a)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:58.430846 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76b6085-bda9-49ed-940b-abea9553fcdc None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:58.443184 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 157/310] 10.222.0.44 () {58 vars in 1334 bytes} [Mon May 9 20:10:58 2022] PUT /identity/v3/system/users/29d29b3e8b194d3b8ad8bacbef7b11ac/roles/79f90a0bf6ea43d0b3c434e31556253a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:10:58.524851 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95870c9-e643-4a68-a1ab-0676a42d5803 None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:58.525218 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95870c9-e643-4a68-a1ab-0676a42d5803 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:58.525411 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95870c9-e643-4a68-a1ab-0676a42d5803 None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:58.527141 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 154/311] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:10:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:10:58.533069 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34fd52-bcb2-44de-9daf-a4956512e4fb None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:58.533352 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34fd52-bcb2-44de-9daf-a4956512e4fb None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:58.533636 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34fd52-bcb2-44de-9daf-a4956512e4fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:58.553186 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-3c34fd52-bcb2-44de-9daf-a4956512e4fb None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:10:58.554406 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-3c34fd52-bcb2-44de-9daf-a4956512e4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:10:58.633487 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 158/312] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:10:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 20:10:58.656694 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95870c9-e643-4a68-a1ab-0676a42d5803 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:58.758546 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95870c9-e643-4a68-a1ab-0676a42d5803 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:58.791518 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24bcb21-57b2-40c3-baa6-b403f7c6ddc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:58.792355 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24bcb21-57b2-40c3-baa6-b403f7c6ddc6 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:58.792636 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24bcb21-57b2-40c3-baa6-b403f7c6ddc6 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:58.792906 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24bcb21-57b2-40c3-baa6-b403f7c6ddc6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:58.803830 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24bcb21-57b2-40c3-baa6-b403f7c6ddc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:10:58.811474 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-f24bcb21-57b2-40c3-baa6-b403f7c6ddc6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 09 20:10:58.811474 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:10:58.811474 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:10:58.811474 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:10:58.811474 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:10:58.811474 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:10:58.811474 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:10:58.811474 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:10:58.811474 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:10:58.811474 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:10:58.811474 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:10:58.811474 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:10:58.811474 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:10:58.811474 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:10:58.811474 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:10:58.811474 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:10:58.812367 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:10:58.812367 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:10:58.812367 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:10:58.812367 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:10:58.812367 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:10:58.812367 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:10:58.812367 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:10:58.812367 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:10:58.812367 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:10:58.812367 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:10:58.812367 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:10:58.812367 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:10:58.812367 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:10:58.812367 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:10:58.812367 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:10:58.812367 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:10:58.813154 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:10:58.813154 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:10:58.813154 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:10:58.813154 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:10:58.813154 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:10:58.813154 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:10:58.813154 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:10:58.813154 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:10:58.813154 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:10:58.813154 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:10:58.813154 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 09 20:10:58.813154 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:10:58.813154 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 155/313] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 9 20:10:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:10:58.819957 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c34fd52-bcb2-44de-9daf-a4956512e4fb None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:58.918091 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c34fd52-bcb2-44de-9daf-a4956512e4fb None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:58.952644 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e540c1-1f24-4fcd-90c8-8ea5b9ff45c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:58.953318 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e540c1-1f24-4fcd-90c8-8ea5b9ff45c2 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:58.953596 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e540c1-1f24-4fcd-90c8-8ea5b9ff45c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:58.953861 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e540c1-1f24-4fcd-90c8-8ea5b9ff45c2 None admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:58.954599 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e540c1-1f24-4fcd-90c8-8ea5b9ff45c2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:10:58.954898 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e540c1-1f24-4fcd-90c8-8ea5b9ff45c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:58.956962 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e540c1-1f24-4fcd-90c8-8ea5b9ff45c2 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:58.965785 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 159/314] 10.222.0.44 () {56 vars in 1101 bytes} [Mon May 9 20:10:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:58.971415 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24bcb21-57b2-40c3-baa6-b403f7c6ddc6 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:59.074420 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24bcb21-57b2-40c3-baa6-b403f7c6ddc6 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:59.108374 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a224290b-511a-47ad-bc21-3547bfd30ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:59.109234 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224290b-511a-47ad-bc21-3547bfd30ade None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:59.109509 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224290b-511a-47ad-bc21-3547bfd30ade None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:59.109780 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224290b-511a-47ad-bc21-3547bfd30ade None admin] PATH_INFO: `/v3/users/e4a8b9c6b1e0452a9227e332a7f24751` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:59.110972 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a224290b-511a-47ad-bc21-3547bfd30ade None admin] RBAC: Authorizing `identity:get_user(user_id=e4a8b9c6b1e0452a9227e332a7f24751)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:59.113062 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a224290b-511a-47ad-bc21-3547bfd30ade None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:59.114693 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 156/315] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 9 20:10:58 2022] GET /identity/v3/users/e4a8b9c6b1e0452a9227e332a7f24751 => generated 297 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:59.120400 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e540c1-1f24-4fcd-90c8-8ea5b9ff45c2 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:59.221169 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e540c1-1f24-4fcd-90c8-8ea5b9ff45c2 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:59.254912 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9cdc00-e69d-47e8-83c6-15afd10815bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:59.255584 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9cdc00-e69d-47e8-83c6-15afd10815bb None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:59.256115 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9cdc00-e69d-47e8-83c6-15afd10815bb None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:59.256385 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9cdc00-e69d-47e8-83c6-15afd10815bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:59.321068 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9cdc00-e69d-47e8-83c6-15afd10815bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:59.322519 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9cdc00-e69d-47e8-83c6-15afd10815bb None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:59.421453 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 160/316] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 9 20:10:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 20:10:59.428472 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a224290b-511a-47ad-bc21-3547bfd30ade None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:59.524949 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a224290b-511a-47ad-bc21-3547bfd30ade None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:59.558194 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75712ed1-65fc-4353-b5f7-23416a2b8910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:59.559049 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75712ed1-65fc-4353-b5f7-23416a2b8910 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:59.559324 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75712ed1-65fc-4353-b5f7-23416a2b8910 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:59.559626 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75712ed1-65fc-4353-b5f7-23416a2b8910 None admin] PATH_INFO: `/v3/projects/45776741808d4cd98d7420b62d06836d` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:59.560823 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75712ed1-65fc-4353-b5f7-23416a2b8910 None admin] RBAC: Authorizing `identity:get_project(project_id=45776741808d4cd98d7420b62d06836d)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:59.562251 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75712ed1-65fc-4353-b5f7-23416a2b8910 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:59.564145 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 157/317] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 9 20:10:59 2022] GET /identity/v3/projects/45776741808d4cd98d7420b62d06836d => generated 302 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:10:59.571650 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9cdc00-e69d-47e8-83c6-15afd10815bb None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:10:59.672976 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9cdc00-e69d-47e8-83c6-15afd10815bb None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:10:59.710234 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b90b488-7dba-47db-8cf3-241655589c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:10:59.710946 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b90b488-7dba-47db-8cf3-241655589c90 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:10:59.711225 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b90b488-7dba-47db-8cf3-241655589c90 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:10:59.711565 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b90b488-7dba-47db-8cf3-241655589c90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:10:59.712407 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b90b488-7dba-47db-8cf3-241655589c90 None admin] RBAC: Adding query filter params (role.id=8957f6409fdf419abdc10d421c213a32, scope.project.id=45776741808d4cd98d7420b62d06836d, user.id=e4a8b9c6b1e0452a9227e332a7f24751) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:10:59.712711 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b90b488-7dba-47db-8cf3-241655589c90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:10:59.714148 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b90b488-7dba-47db-8cf3-241655589c90 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:10:59.720327 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 161/318] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 9 20:10:59 2022] GET /identity/v3/role_assignments?user.id=e4a8b9c6b1e0452a9227e332a7f24751&scope.project.id=45776741808d4cd98d7420b62d06836d&role.id=8957f6409fdf419abdc10d421c213a32 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:00.178511 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e982c-b57b-4b52-a46f-2c235c5324dc None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:00.179030 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e982c-b57b-4b52-a46f-2c235c5324dc None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:00.179136 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e982c-b57b-4b52-a46f-2c235c5324dc None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:00.180562 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 158/319] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:11:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:11:00.181861 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34371260-457c-41bb-a7a0-caf04d1cad31 None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:00.182145 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34371260-457c-41bb-a7a0-caf04d1cad31 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:00.182417 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34371260-457c-41bb-a7a0-caf04d1cad31 None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:00.183806 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 162/320] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:11:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:11:00.185686 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291fa577-a5a0-4d60-8cb3-af0d5f433e14 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:00.185964 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291fa577-a5a0-4d60-8cb3-af0d5f433e14 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:00.186234 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291fa577-a5a0-4d60-8cb3-af0d5f433e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:00.188677 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f2404e-26dd-41bf-8338-ba6a352772d1 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:00.188964 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f2404e-26dd-41bf-8338-ba6a352772d1 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:00.189241 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f2404e-26dd-41bf-8338-ba6a352772d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:00.202648 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-291fa577-a5a0-4d60-8cb3-af0d5f433e14 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:11:00.203840 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-291fa577-a5a0-4d60-8cb3-af0d5f433e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:11:00.205372 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-92f2404e-26dd-41bf-8338-ba6a352772d1 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:11:00.207270 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-92f2404e-26dd-41bf-8338-ba6a352772d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:11:00.268156 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 159/321] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:11:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 20:11:00.276394 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 163/322] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:11:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 20:11:00.290867 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291fa577-a5a0-4d60-8cb3-af0d5f433e14 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:00.298535 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f2404e-26dd-41bf-8338-ba6a352772d1 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:00.386920 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291fa577-a5a0-4d60-8cb3-af0d5f433e14 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:00.399127 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f2404e-26dd-41bf-8338-ba6a352772d1 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:00.420397 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f7003d-e291-42af-8e7e-6b3630440ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:00.421182 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f7003d-e291-42af-8e7e-6b3630440ea1 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:00.421460 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f7003d-e291-42af-8e7e-6b3630440ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:00.421740 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f7003d-e291-42af-8e7e-6b3630440ea1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:00.431814 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f7003d-e291-42af-8e7e-6b3630440ea1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:11:00.433534 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24783dd7-a3f0-4737-9869-5134b66bc9ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:00.434316 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24783dd7-a3f0-4737-9869-5134b66bc9ef None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:00.434595 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24783dd7-a3f0-4737-9869-5134b66bc9ef None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:00.434865 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24783dd7-a3f0-4737-9869-5134b66bc9ef None admin] PATH_INFO: `/v3/domains/default` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:00.436042 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24783dd7-a3f0-4737-9869-5134b66bc9ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:00.437523 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24783dd7-a3f0-4737-9869-5134b66bc9ef None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:00.439300 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 164/323] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:11:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:11:00.439422 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-b9f7003d-e291-42af-8e7e-6b3630440ea1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 09 20:11:00.439422 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:00.439422 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:00.439422 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:00.439422 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:00.439422 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:00.439422 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:00.439422 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:00.439422 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:00.439422 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:00.439422 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:00.439422 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:00.439422 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:11:00.439422 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:11:00.439422 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:11:00.439422 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:11:00.440268 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:11:00.440268 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:11:00.440268 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:11:00.440268 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:11:00.440268 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:00.440268 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:00.440268 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:00.440268 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:00.440268 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:00.440268 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:00.440268 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:00.440268 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:11:00.440268 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:00.440268 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:00.440268 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:00.440268 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:00.441499 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:00.441499 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:00.441499 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:00.441499 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:00.441499 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:11:00.441499 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:11:00.441499 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:11:00.441499 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:11:00.441499 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:11:00.441499 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:11:00.441499 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 09 20:11:00.441499 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:00.441499 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 160/324] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 9 20:11:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:00.446277 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24783dd7-a3f0-4737-9869-5134b66bc9ef None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:00.447585 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f7003d-e291-42af-8e7e-6b3630440ea1 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:00.546308 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f7003d-e291-42af-8e7e-6b3630440ea1 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:00.550338 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24783dd7-a3f0-4737-9869-5134b66bc9ef None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:00.584683 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535eaeb7-b0a2-4256-b0c0-dfe1336556f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:00.585345 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535eaeb7-b0a2-4256-b0c0-dfe1336556f9 None admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:00.585619 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535eaeb7-b0a2-4256-b0c0-dfe1336556f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:00.586045 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535eaeb7-b0a2-4256-b0c0-dfe1336556f9 None admin] PATH_INFO: `/v3/groups` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:00.586725 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535eaeb7-b0a2-4256-b0c0-dfe1336556f9 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:00.588204 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535eaeb7-b0a2-4256-b0c0-dfe1336556f9 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:00.592601 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e4e31-acdc-4d62-b44b-24a6e1b7fe89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:00.593577 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e4e31-acdc-4d62-b44b-24a6e1b7fe89 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:00.593818 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e4e31-acdc-4d62-b44b-24a6e1b7fe89 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:00.594484 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e4e31-acdc-4d62-b44b-24a6e1b7fe89 None admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:00.595553 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56e4e31-acdc-4d62-b44b-24a6e1b7fe89 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:00.596101 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56e4e31-acdc-4d62-b44b-24a6e1b7fe89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:00.598487 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56e4e31-acdc-4d62-b44b-24a6e1b7fe89 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:00.602544 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 161/325] 10.222.0.44 () {60 vars in 1134 bytes} [Mon May 9 20:11:00 2022] POST /identity/v3/groups => generated 226 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:11:00.607228 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 165/326] 10.222.0.44 () {56 vars in 1101 bytes} [Mon May 9 20:11:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:00.614680 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535eaeb7-b0a2-4256-b0c0-dfe1336556f9 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:00.728145 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535eaeb7-b0a2-4256-b0c0-dfe1336556f9 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:00.764218 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b384b89b-7a4c-4662-9667-2a5b5580dc9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:00.765109 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b384b89b-7a4c-4662-9667-2a5b5580dc9b None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:00.765392 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b384b89b-7a4c-4662-9667-2a5b5580dc9b None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:00.765668 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b384b89b-7a4c-4662-9667-2a5b5580dc9b None admin] PATH_INFO: `/v3/users/937b5c3519044bd5ba73e11dc3bdb468` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:00.766895 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b384b89b-7a4c-4662-9667-2a5b5580dc9b None admin] RBAC: Authorizing `identity:get_user(user_id=937b5c3519044bd5ba73e11dc3bdb468)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:00.768456 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b384b89b-7a4c-4662-9667-2a5b5580dc9b None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:00.771213 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 162/327] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 9 20:11:00 2022] GET /identity/v3/users/937b5c3519044bd5ba73e11dc3bdb468 => generated 293 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:11:00.776888 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e4e31-acdc-4d62-b44b-24a6e1b7fe89 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:00.814499 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bab43e-0486-441c-b4e5-2f5ec81af036 None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:00.814815 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bab43e-0486-441c-b4e5-2f5ec81af036 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:00.815057 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bab43e-0486-441c-b4e5-2f5ec81af036 None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:00.816881 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 163/328] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:11:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:11:00.822284 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67a314-1878-406f-9586-d3b3f0dfcad5 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:00.822563 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67a314-1878-406f-9586-d3b3f0dfcad5 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:00.822838 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67a314-1878-406f-9586-d3b3f0dfcad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:00.839222 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-2d67a314-1878-406f-9586-d3b3f0dfcad5 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:11:00.840447 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-2d67a314-1878-406f-9586-d3b3f0dfcad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:11:00.897149 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e4e31-acdc-4d62-b44b-24a6e1b7fe89 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:00.917674 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 164/329] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:11:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 20:11:00.938276 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d3c12a-20ef-4694-8f40-adfd355192f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:00.939136 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d3c12a-20ef-4694-8f40-adfd355192f4 None admin] REQUEST_METHOD: `PUT` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:00.939452 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d3c12a-20ef-4694-8f40-adfd355192f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:00.939730 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d3c12a-20ef-4694-8f40-adfd355192f4 None admin] PATH_INFO: `/v3/system/users/937b5c3519044bd5ba73e11dc3bdb468/roles/8957f6409fdf419abdc10d421c213a32` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:00.941571 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d3c12a-20ef-4694-8f40-adfd355192f4 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=937b5c3519044bd5ba73e11dc3bdb468, role_id=8957f6409fdf419abdc10d421c213a32)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:00.942089 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d67a314-1878-406f-9586-d3b3f0dfcad5 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:00.942967 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d3c12a-20ef-4694-8f40-adfd355192f4 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:00.953492 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 166/330] 10.222.0.44 () {58 vars in 1334 bytes} [Mon May 9 20:11:00 2022] PUT /identity/v3/system/users/937b5c3519044bd5ba73e11dc3bdb468/roles/8957f6409fdf419abdc10d421c213a32 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:11:01.058624 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d67a314-1878-406f-9586-d3b3f0dfcad5 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:01.097263 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcfad72-6453-4c1b-902a-6cbe2cce67d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:01.098444 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcfad72-6453-4c1b-902a-6cbe2cce67d1 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:01.098871 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcfad72-6453-4c1b-902a-6cbe2cce67d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:01.099310 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcfad72-6453-4c1b-902a-6cbe2cce67d1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:01.111653 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcfad72-6453-4c1b-902a-6cbe2cce67d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:11:01.120718 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-0bcfad72-6453-4c1b-902a-6cbe2cce67d1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 20:11:01.120718 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:01.120718 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:01.120718 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:01.120718 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:01.120718 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:01.120718 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:01.120718 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:01.120718 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:01.120718 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:01.120718 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:01.120718 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:01.120718 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:11:01.120718 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:11:01.120718 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:11:01.120718 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:11:01.121848 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:11:01.121848 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:11:01.121848 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:11:01.121848 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:11:01.121848 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:01.121848 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:01.121848 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:01.121848 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:01.121848 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:01.121848 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:01.121848 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:01.121848 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:11:01.121848 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:01.121848 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:01.121848 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:01.121848 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:01.122822 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:01.122822 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:01.122822 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:01.122822 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:01.122822 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:11:01.122822 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:11:01.122822 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:11:01.122822 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:11:01.122822 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:11:01.122822 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:11:01.122822 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 20:11:01.122822 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:01.124984 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 165/331] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 9 20:11:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 20:11:01.132209 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d3c12a-20ef-4694-8f40-adfd355192f4 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:01.246074 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d3c12a-20ef-4694-8f40-adfd355192f4 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:01.284685 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d242374-0e56-481d-a7a0-4e70b01fc2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:01.285452 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d242374-0e56-481d-a7a0-4e70b01fc2af None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:01.285735 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d242374-0e56-481d-a7a0-4e70b01fc2af None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:01.286005 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d242374-0e56-481d-a7a0-4e70b01fc2af None admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:01.286754 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d242374-0e56-481d-a7a0-4e70b01fc2af None admin] RBAC: Adding query filter params (name=member) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:01.287056 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d242374-0e56-481d-a7a0-4e70b01fc2af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:01.288476 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d242374-0e56-481d-a7a0-4e70b01fc2af None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:01.297490 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 167/332] 10.222.0.44 () {56 vars in 1101 bytes} [Mon May 9 20:11:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:01.304699 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcfad72-6453-4c1b-902a-6cbe2cce67d1 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:01.422990 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcfad72-6453-4c1b-902a-6cbe2cce67d1 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:01.461615 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc420ff-0f7f-437a-95e6-0544ef3959c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:01.462486 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc420ff-0f7f-437a-95e6-0544ef3959c7 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:01.462767 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc420ff-0f7f-437a-95e6-0544ef3959c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:01.463039 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc420ff-0f7f-437a-95e6-0544ef3959c7 None admin] PATH_INFO: `/v3/users/29d29b3e8b194d3b8ad8bacbef7b11ac` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:01.464274 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc420ff-0f7f-437a-95e6-0544ef3959c7 None admin] RBAC: Authorizing `identity:get_user(user_id=29d29b3e8b194d3b8ad8bacbef7b11ac)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:01.465708 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc420ff-0f7f-437a-95e6-0544ef3959c7 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:01.467661 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 166/333] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 9 20:11:01 2022] GET /identity/v3/users/29d29b3e8b194d3b8ad8bacbef7b11ac => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:01.476619 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d242374-0e56-481d-a7a0-4e70b01fc2af None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:01.586712 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d242374-0e56-481d-a7a0-4e70b01fc2af None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:01.621958 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0672ca6-90ba-4f16-ad96-b055121073cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:01.622717 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0672ca6-90ba-4f16-ad96-b055121073cb None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:01.622883 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0672ca6-90ba-4f16-ad96-b055121073cb None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:01.623146 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0672ca6-90ba-4f16-ad96-b055121073cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:01.624007 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0672ca6-90ba-4f16-ad96-b055121073cb None admin] RBAC: Adding query filter params (role.id=79f90a0bf6ea43d0b3c434e31556253a, user.id=29d29b3e8b194d3b8ad8bacbef7b11ac, scope.system=all) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:01.624315 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0672ca6-90ba-4f16-ad96-b055121073cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:01.625888 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0672ca6-90ba-4f16-ad96-b055121073cb None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:01.638623 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 168/334] 10.222.0.44 () {56 vars in 1308 bytes} [Mon May 9 20:11:01 2022] GET /identity/v3/role_assignments?user.id=29d29b3e8b194d3b8ad8bacbef7b11ac&scope.system=all&role.id=79f90a0bf6ea43d0b3c434e31556253a => generated 510 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:03.798115 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa45bb7-3e71-4a51-bb51-18b5b3d4a179 None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:03.798659 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa45bb7-3e71-4a51-bb51-18b5b3d4a179 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:03.798760 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa45bb7-3e71-4a51-bb51-18b5b3d4a179 None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:03.800985 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 167/335] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:11:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:11:03.807746 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e56a49-44a1-45de-a90e-4081014f5bfb None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:03.808576 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e56a49-44a1-45de-a90e-4081014f5bfb None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:03.809024 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e56a49-44a1-45de-a90e-4081014f5bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:03.832860 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-94e56a49-44a1-45de-a90e-4081014f5bfb None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:11:03.834314 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-94e56a49-44a1-45de-a90e-4081014f5bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:11:03.912665 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 169/336] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:11:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 20:11:03.926428 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b464bad-1346-41f6-a5a0-3e7ef825f60a None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:03.927001 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b464bad-1346-41f6-a5a0-3e7ef825f60a None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:03.927488 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b464bad-1346-41f6-a5a0-3e7ef825f60a None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:03.929332 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 168/337] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:11:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:11:03.934506 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67eba4-fefb-4c03-bddb-2388be5672d2 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:03.934793 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67eba4-fefb-4c03-bddb-2388be5672d2 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:03.935070 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67eba4-fefb-4c03-bddb-2388be5672d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:03.950278 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b464bad-1346-41f6-a5a0-3e7ef825f60a None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:03.960743 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-3f67eba4-fefb-4c03-bddb-2388be5672d2 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:11:03.961655 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-3f67eba4-fefb-4c03-bddb-2388be5672d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:11:04.054014 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 170/338] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:11:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 20:11:04.093497 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f67eba4-fefb-4c03-bddb-2388be5672d2 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:04.132422 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b464bad-1346-41f6-a5a0-3e7ef825f60a None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:04.185404 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a0ceee-cff5-45c5-acb2-716172265073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:04.186572 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a0ceee-cff5-45c5-acb2-716172265073 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:04.187053 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a0ceee-cff5-45c5-acb2-716172265073 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:04.187568 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a0ceee-cff5-45c5-acb2-716172265073 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:04.209395 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a0ceee-cff5-45c5-acb2-716172265073 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:11:04.217089 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-33a0ceee-cff5-45c5-acb2-716172265073 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 20:11:04.217089 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:04.217089 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:04.217089 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:04.217089 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:04.217089 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:04.217089 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:04.217089 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:04.217089 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:04.217089 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:04.217089 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:04.217089 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:04.217089 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:11:04.217089 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:11:04.217089 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:11:04.217089 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:11:04.217963 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:11:04.217963 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:11:04.217963 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:11:04.217963 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:11:04.217963 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:04.217963 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:04.217963 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:04.217963 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:04.217963 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:04.217963 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:04.217963 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:04.217963 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:11:04.217963 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:04.217963 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:04.217963 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:04.217963 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:04.218750 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:04.218750 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:04.218750 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:04.218750 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:04.218750 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:11:04.218750 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:11:04.218750 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:11:04.218750 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:11:04.218750 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:11:04.218750 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:11:04.218750 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 20:11:04.218750 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:04.218750 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 169/339] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 9 20:11:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:04.222824 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6513bf-339b-497d-820a-6cf59a2755d8 None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:04.224153 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6513bf-339b-497d-820a-6cf59a2755d8 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:04.226411 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6513bf-339b-497d-820a-6cf59a2755d8 None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:04.232881 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 170/340] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:11:04 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:11:04.233517 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6513bf-339b-497d-820a-6cf59a2755d8 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:04.236579 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f67eba4-fefb-4c03-bddb-2388be5672d2 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:04.308052 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f30a84-7ef6-4545-a89e-c020e5f31616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:04.308853 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f30a84-7ef6-4545-a89e-c020e5f31616 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:04.309133 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f30a84-7ef6-4545-a89e-c020e5f31616 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:04.309405 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f30a84-7ef6-4545-a89e-c020e5f31616 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:04.334047 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f30a84-7ef6-4545-a89e-c020e5f31616 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:11:04.345150 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-14f30a84-7ef6-4545-a89e-c020e5f31616 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 09 20:11:04.345150 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:04.345150 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:04.345150 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:04.345150 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:04.345150 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:04.345150 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:04.345150 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:04.345150 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:04.345150 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:04.345150 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:04.345150 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:04.345150 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:11:04.345150 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:11:04.345150 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:11:04.345150 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:11:04.347426 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:11:04.347426 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:11:04.347426 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:11:04.347426 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:11:04.347426 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:04.347426 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:04.347426 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:04.347426 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:04.347426 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:04.347426 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:04.347426 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:04.347426 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:11:04.347426 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:04.347426 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:04.347426 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:04.347426 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:04.349322 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:04.349322 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:04.349322 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:04.349322 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:04.349322 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:11:04.349322 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:11:04.349322 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:11:04.349322 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:11:04.349322 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:11:04.349322 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:11:04.349322 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 09 20:11:04.349322 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:11:04.349322 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 171/341] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 9 20:11:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 20:11:04.349322 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23063d1a-7ba9-4ff4-9da2-e4a2d6eea3f3 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:04.351109 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23063d1a-7ba9-4ff4-9da2-e4a2d6eea3f3 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:04.351109 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23063d1a-7ba9-4ff4-9da2-e4a2d6eea3f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:04.384253 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-23063d1a-7ba9-4ff4-9da2-e4a2d6eea3f3 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:11:04.385434 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-23063d1a-7ba9-4ff4-9da2-e4a2d6eea3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:11:04.474091 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 172/342] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:11:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 20:11:04.475965 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23063d1a-7ba9-4ff4-9da2-e4a2d6eea3f3 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:04.488796 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6513bf-339b-497d-820a-6cf59a2755d8 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:04.536599 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcac210-e024-4956-885d-d218fe310e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:04.536963 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcac210-e024-4956-885d-d218fe310e89 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:04.536963 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcac210-e024-4956-885d-d218fe310e89 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:04.537273 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcac210-e024-4956-885d-d218fe310e89 None admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:04.537929 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcac210-e024-4956-885d-d218fe310e89 None admin] RBAC: Adding query filter params (name=member) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:04.538237 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcac210-e024-4956-885d-d218fe310e89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:04.543416 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcac210-e024-4956-885d-d218fe310e89 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:04.549144 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 171/343] 10.222.0.44 () {56 vars in 1101 bytes} [Mon May 9 20:11:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:04.549845 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcac210-e024-4956-885d-d218fe310e89 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:04.670946 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcac210-e024-4956-885d-d218fe310e89 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:04.679341 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23063d1a-7ba9-4ff4-9da2-e4a2d6eea3f3 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:04.710113 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72daea9c-06f9-4155-b00d-3e27b41fa664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:04.710927 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72daea9c-06f9-4155-b00d-3e27b41fa664 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:04.711208 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72daea9c-06f9-4155-b00d-3e27b41fa664 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:04.711506 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72daea9c-06f9-4155-b00d-3e27b41fa664 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:04.722667 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72daea9c-06f9-4155-b00d-3e27b41fa664 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:11:04.731003 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-72daea9c-06f9-4155-b00d-3e27b41fa664 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 20:11:04.731003 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:04.731003 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:04.731003 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:04.731003 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:04.731003 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:04.731003 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:04.731003 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:04.731003 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:04.731003 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:04.731003 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:04.731003 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:04.731003 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:11:04.731003 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:11:04.731003 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:11:04.731003 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:11:04.732063 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:11:04.732063 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:11:04.732063 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:11:04.732063 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:11:04.732063 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:04.732063 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:04.732063 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:04.732063 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:04.732063 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:04.732063 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:04.732063 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:04.732063 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:11:04.732063 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:04.732063 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:04.732063 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:04.732063 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:04.732896 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:04.732896 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:04.732896 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:04.732896 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:04.732896 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:11:04.732896 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:11:04.732896 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:11:04.732896 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:11:04.732896 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:11:04.732896 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:11:04.732896 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 20:11:04.732896 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:04.732896 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 172/344] 10.222.0.44 () {56 vars in 1114 bytes} [Mon May 9 20:11:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:04.734225 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72daea9c-06f9-4155-b00d-3e27b41fa664 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:04.742419 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ede40-0d73-4c0d-ade9-0178373be7af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:04.743193 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ede40-0d73-4c0d-ade9-0178373be7af None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:04.743506 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ede40-0d73-4c0d-ade9-0178373be7af None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:04.743783 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ede40-0d73-4c0d-ade9-0178373be7af None admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:04.744538 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84ede40-0d73-4c0d-ade9-0178373be7af None admin] RBAC: Adding query filter params (name=reader) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:04.744843 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84ede40-0d73-4c0d-ade9-0178373be7af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:04.746402 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84ede40-0d73-4c0d-ade9-0178373be7af None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:04.762475 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 173/345] 10.222.0.44 () {56 vars in 1101 bytes} [Mon May 9 20:11:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:04.764138 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c7cff6-0045-4929-beeb-28b2294b973d None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:04.764638 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c7cff6-0045-4929-beeb-28b2294b973d None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:04.765116 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c7cff6-0045-4929-beeb-28b2294b973d None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:04.766565 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 174/346] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:11:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:11:04.767522 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c7cff6-0045-4929-beeb-28b2294b973d None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:04.853849 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72daea9c-06f9-4155-b00d-3e27b41fa664 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:04.884846 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c7cff6-0045-4929-beeb-28b2294b973d None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:04.889752 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edfc848-2848-4cd9-b204-5a8aa3a1fbc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:04.890406 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edfc848-2848-4cd9-b204-5a8aa3a1fbc0 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:04.890688 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edfc848-2848-4cd9-b204-5a8aa3a1fbc0 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:04.890966 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edfc848-2848-4cd9-b204-5a8aa3a1fbc0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:04.922524 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9f6f78-d12b-42d2-a6e6-076225998747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:04.923599 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f6f78-d12b-42d2-a6e6-076225998747 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:04.924094 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f6f78-d12b-42d2-a6e6-076225998747 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:04.924562 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f6f78-d12b-42d2-a6e6-076225998747 None admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:04.926044 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9f6f78-d12b-42d2-a6e6-076225998747 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:04.926543 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9f6f78-d12b-42d2-a6e6-076225998747 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:04.928222 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9f6f78-d12b-42d2-a6e6-076225998747 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:04.937781 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 175/347] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 9 20:11:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:04.938893 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9f6f78-d12b-42d2-a6e6-076225998747 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:04.970668 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edfc848-2848-4cd9-b204-5a8aa3a1fbc0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:04.973579 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edfc848-2848-4cd9-b204-5a8aa3a1fbc0 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:05.043718 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9f6f78-d12b-42d2-a6e6-076225998747 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:05.087619 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93038b8-9579-48aa-be9e-bea521c342ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:05.088499 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93038b8-9579-48aa-be9e-bea521c342ea None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:05.088782 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93038b8-9579-48aa-be9e-bea521c342ea None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:05.089056 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93038b8-9579-48aa-be9e-bea521c342ea None admin] PATH_INFO: `/v3/users/937b5c3519044bd5ba73e11dc3bdb468` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:05.089517 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 173/348] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 9 20:11:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 20:11:05.090416 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93038b8-9579-48aa-be9e-bea521c342ea None admin] RBAC: Authorizing `identity:get_user(user_id=937b5c3519044bd5ba73e11dc3bdb468)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:05.090784 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100507f-5cfa-460e-b86f-1ccc0e58bb31 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:05.091073 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100507f-5cfa-460e-b86f-1ccc0e58bb31 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:05.091348 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100507f-5cfa-460e-b86f-1ccc0e58bb31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:05.092239 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93038b8-9579-48aa-be9e-bea521c342ea None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:05.093955 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 176/349] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 9 20:11:04 2022] GET /identity/v3/users/937b5c3519044bd5ba73e11dc3bdb468 => generated 293 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:05.094876 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93038b8-9579-48aa-be9e-bea521c342ea None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:05.109329 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-0100507f-5cfa-460e-b86f-1ccc0e58bb31 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:11:05.110508 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-0100507f-5cfa-460e-b86f-1ccc0e58bb31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:11:05.215824 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 174/350] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:11:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 20:11:05.217170 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ee913-376f-4adf-94a5-d5549e5b15f4 None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:05.217463 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ee913-376f-4adf-94a5-d5549e5b15f4 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:05.217742 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ee913-376f-4adf-94a5-d5549e5b15f4 None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:05.224321 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 175/351] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:11:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:11:05.225053 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93038b8-9579-48aa-be9e-bea521c342ea None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:05.225163 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9ee913-376f-4adf-94a5-d5549e5b15f4 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:05.264298 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dc7bd0-3aca-470c-8c85-0d8f2b455457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:05.264947 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc7bd0-3aca-470c-8c85-0d8f2b455457 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:05.265231 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc7bd0-3aca-470c-8c85-0d8f2b455457 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:05.265512 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc7bd0-3aca-470c-8c85-0d8f2b455457 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:05.351315 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9ee913-376f-4adf-94a5-d5549e5b15f4 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:05.366111 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dc7bd0-3aca-470c-8c85-0d8f2b455457 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:05.367750 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dc7bd0-3aca-470c-8c85-0d8f2b455457 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:05.399498 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c34c5f9-45d1-4ff9-925c-dd90dc82b81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:05.400271 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c34c5f9-45d1-4ff9-925c-dd90dc82b81b None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:05.402107 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c34c5f9-45d1-4ff9-925c-dd90dc82b81b None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:05.402107 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c34c5f9-45d1-4ff9-925c-dd90dc82b81b None admin] PATH_INFO: `/v3/projects/2019f358cc3841408e7d4693c6b8133a` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:05.402107 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c34c5f9-45d1-4ff9-925c-dd90dc82b81b None admin] RBAC: Authorizing `identity:get_project(project_id=2019f358cc3841408e7d4693c6b8133a)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:05.407190 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c34c5f9-45d1-4ff9-925c-dd90dc82b81b None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:05.407190 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 176/352] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 9 20:11:05 2022] GET /identity/v3/projects/2019f358cc3841408e7d4693c6b8133a => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:05.407190 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c34c5f9-45d1-4ff9-925c-dd90dc82b81b None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:05.494734 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 177/353] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 9 20:11:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 20:11:05.495960 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f85641-3b0d-46c0-93ff-9cb7e3415791 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:05.496247 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f85641-3b0d-46c0-93ff-9cb7e3415791 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:05.496516 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f85641-3b0d-46c0-93ff-9cb7e3415791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:05.513867 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-65f85641-3b0d-46c0-93ff-9cb7e3415791 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:11:05.515265 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-65f85641-3b0d-46c0-93ff-9cb7e3415791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:11:05.527510 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c34c5f9-45d1-4ff9-925c-dd90dc82b81b None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:05.565484 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ccb81b-f6cc-439f-86fb-49b6b2d607b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:05.566561 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ccb81b-f6cc-439f-86fb-49b6b2d607b3 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:05.566845 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ccb81b-f6cc-439f-86fb-49b6b2d607b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:05.567120 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ccb81b-f6cc-439f-86fb-49b6b2d607b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:05.568095 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ccb81b-f6cc-439f-86fb-49b6b2d607b3 None admin] RBAC: Adding query filter params (role.id=8957f6409fdf419abdc10d421c213a32, user.id=937b5c3519044bd5ba73e11dc3bdb468, scope.system=all) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:05.569393 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ccb81b-f6cc-439f-86fb-49b6b2d607b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:05.569859 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ccb81b-f6cc-439f-86fb-49b6b2d607b3 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:05.585564 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 177/354] 10.222.0.44 () {56 vars in 1308 bytes} [Mon May 9 20:11:05 2022] GET /identity/v3/role_assignments?user.id=937b5c3519044bd5ba73e11dc3bdb468&scope.system=all&role.id=8957f6409fdf419abdc10d421c213a32 => generated 510 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:05.586699 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ccb81b-f6cc-439f-86fb-49b6b2d607b3 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:05.590474 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 178/355] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:11:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 20:11:05.591728 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f85641-3b0d-46c0-93ff-9cb7e3415791 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:05.719617 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ccb81b-f6cc-439f-86fb-49b6b2d607b3 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:05.734846 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f85641-3b0d-46c0-93ff-9cb7e3415791 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:05.771300 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253da46b-f02a-4816-8b3e-1687610d0b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:05.772066 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253da46b-f02a-4816-8b3e-1687610d0b40 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:05.772346 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253da46b-f02a-4816-8b3e-1687610d0b40 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:05.772618 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253da46b-f02a-4816-8b3e-1687610d0b40 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:05.778042 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2285c2e6-6ca1-4e68-8075-823b245dfa72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:05.779140 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2285c2e6-6ca1-4e68-8075-823b245dfa72 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:05.779432 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2285c2e6-6ca1-4e68-8075-823b245dfa72 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:05.780252 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2285c2e6-6ca1-4e68-8075-823b245dfa72 None admin] PATH_INFO: `/v3/groups/9e5d512ace634db398dc14cdc158344c` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:05.788052 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2285c2e6-6ca1-4e68-8075-823b245dfa72 None admin] RBAC: Authorizing `identity:get_group(group_id=9e5d512ace634db398dc14cdc158344c)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:05.789518 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2285c2e6-6ca1-4e68-8075-823b245dfa72 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:05.790276 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253da46b-f02a-4816-8b3e-1687610d0b40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:11:05.791222 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 179/356] 10.222.0.44 () {56 vars in 1180 bytes} [Mon May 9 20:11:05 2022] GET /identity/v3/groups/9e5d512ace634db398dc14cdc158344c => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:05.793623 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e4e880-38ba-40cf-afbf-b5b809d88d81 None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:05.793902 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e4e880-38ba-40cf-afbf-b5b809d88d81 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:05.794171 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e4e880-38ba-40cf-afbf-b5b809d88d81 None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:05.795552 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 180/357] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:11:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:11:05.798900 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-253da46b-f02a-4816-8b3e-1687610d0b40 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 20:11:05.798900 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:05.798900 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:05.798900 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:05.798900 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:05.798900 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:05.798900 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:05.798900 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:05.798900 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:05.798900 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:05.798900 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:05.798900 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:05.798900 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:11:05.798900 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:11:05.798900 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:11:05.798900 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:11:05.800573 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:11:05.800573 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:11:05.800573 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:11:05.800573 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:11:05.800573 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:05.800573 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:05.800573 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:05.800573 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:05.800573 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:05.800573 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:05.800573 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:05.800573 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:11:05.800573 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:05.800573 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:05.800573 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:05.800573 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:05.801589 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:05.801589 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:05.801589 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:05.801589 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:05.801589 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:11:05.801589 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:11:05.801589 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:11:05.801589 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:11:05.801589 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:11:05.801589 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:11:05.801589 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 20:11:05.801589 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:05.802204 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e4e880-38ba-40cf-afbf-b5b809d88d81 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:05.803927 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 178/358] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 9 20:11:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:05.804408 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253da46b-f02a-4816-8b3e-1687610d0b40 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:05.912174 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253da46b-f02a-4816-8b3e-1687610d0b40 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:05.919449 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e4e880-38ba-40cf-afbf-b5b809d88d81 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:05.946393 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d293b3-e664-488c-94ca-a97a0d169704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:05.947198 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d293b3-e664-488c-94ca-a97a0d169704 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:05.947507 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d293b3-e664-488c-94ca-a97a0d169704 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:05.947932 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d293b3-e664-488c-94ca-a97a0d169704 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:05.958782 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d293b3-e664-488c-94ca-a97a0d169704 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:11:05.961432 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba00b3d-2a1a-4440-8b20-1a2800788d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:05.962284 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba00b3d-2a1a-4440-8b20-1a2800788d1d None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:05.962565 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba00b3d-2a1a-4440-8b20-1a2800788d1d None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:05.962837 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba00b3d-2a1a-4440-8b20-1a2800788d1d None admin] PATH_INFO: `/v3/projects/2019f358cc3841408e7d4693c6b8133a` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:05.964037 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba00b3d-2a1a-4440-8b20-1a2800788d1d None admin] RBAC: Authorizing `identity:get_project(project_id=2019f358cc3841408e7d4693c6b8133a)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:05.965483 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba00b3d-2a1a-4440-8b20-1a2800788d1d None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:05.966800 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-06d293b3-e664-488c-94ca-a97a0d169704 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 20:11:05.966800 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:05.966800 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:05.966800 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:05.966800 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:05.966800 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:05.966800 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:05.966800 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:05.966800 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:05.966800 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:05.966800 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:05.966800 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:05.966800 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:11:05.966800 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:11:05.966800 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:11:05.966800 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:11:05.967817 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:11:05.967817 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:11:05.967817 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:11:05.967817 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:11:05.967817 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:05.967817 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:05.967817 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:05.967817 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:05.967817 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:05.967817 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:05.967817 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:05.967817 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:11:05.967817 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:05.967817 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:05.967817 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:05.967817 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:05.968610 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:05.968610 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:05.968610 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:05.968610 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:05.968610 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:11:05.968610 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:11:05.968610 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:11:05.968610 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:11:05.968610 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:11:05.968610 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:11:05.968610 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 20:11:05.968610 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:05.968610 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 179/359] 10.222.0.44 () {56 vars in 1114 bytes} [Mon May 9 20:11:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:05.969273 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 181/360] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 9 20:11:05 2022] GET /identity/v3/projects/2019f358cc3841408e7d4693c6b8133a => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:05.969339 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d293b3-e664-488c-94ca-a97a0d169704 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:05.969940 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9804347c-fda2-46cd-9b02-b284fda6efe4 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:05.969940 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9804347c-fda2-46cd-9b02-b284fda6efe4 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:05.970107 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9804347c-fda2-46cd-9b02-b284fda6efe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:05.991681 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-9804347c-fda2-46cd-9b02-b284fda6efe4 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:11:05.992869 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-9804347c-fda2-46cd-9b02-b284fda6efe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:11:06.066365 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 182/361] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:11:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 20:11:06.068246 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9804347c-fda2-46cd-9b02-b284fda6efe4 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:06.092048 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d293b3-e664-488c-94ca-a97a0d169704 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:06.133625 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3617e2b-3bcb-4ae2-b52b-ab3f58d507ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:06.134552 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3617e2b-3bcb-4ae2-b52b-ab3f58d507ca None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:06.134831 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3617e2b-3bcb-4ae2-b52b-ab3f58d507ca None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:06.135102 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3617e2b-3bcb-4ae2-b52b-ab3f58d507ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:06.135971 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3617e2b-3bcb-4ae2-b52b-ab3f58d507ca None admin] RBAC: Adding query filter params (group.id=9e5d512ace634db398dc14cdc158344c, role.id=79f90a0bf6ea43d0b3c434e31556253a, scope.project.id=2019f358cc3841408e7d4693c6b8133a) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:06.136279 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3617e2b-3bcb-4ae2-b52b-ab3f58d507ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:06.137713 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3617e2b-3bcb-4ae2-b52b-ab3f58d507ca None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:06.144917 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 180/362] 10.222.0.44 () {56 vars in 1376 bytes} [Mon May 9 20:11:05 2022] GET /identity/v3/role_assignments?group.id=9e5d512ace634db398dc14cdc158344c&scope.project.id=2019f358cc3841408e7d4693c6b8133a&role.id=79f90a0bf6ea43d0b3c434e31556253a => generated 260 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:06.145883 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3617e2b-3bcb-4ae2-b52b-ab3f58d507ca None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:06.190871 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9804347c-fda2-46cd-9b02-b284fda6efe4 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:06.243566 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad87fe4f-3209-40f9-9632-863c54da37fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:06.244260 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad87fe4f-3209-40f9-9632-863c54da37fe None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:06.244542 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad87fe4f-3209-40f9-9632-863c54da37fe None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:06.244809 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad87fe4f-3209-40f9-9632-863c54da37fe None admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:06.245650 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad87fe4f-3209-40f9-9632-863c54da37fe None admin] RBAC: Adding query filter params (name=member) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:06.245956 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad87fe4f-3209-40f9-9632-863c54da37fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:06.247475 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad87fe4f-3209-40f9-9632-863c54da37fe None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:06.259139 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 183/363] 10.222.0.44 () {56 vars in 1101 bytes} [Mon May 9 20:11:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:06.259325 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad87fe4f-3209-40f9-9632-863c54da37fe None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:06.270639 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3617e2b-3bcb-4ae2-b52b-ab3f58d507ca None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:06.320475 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb22c7-47ba-45a0-82c4-b8468fff9fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:06.321082 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb22c7-47ba-45a0-82c4-b8468fff9fa2 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:06.321364 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb22c7-47ba-45a0-82c4-b8468fff9fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:06.321638 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb22c7-47ba-45a0-82c4-b8468fff9fa2 None admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:06.322408 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fb22c7-47ba-45a0-82c4-b8468fff9fa2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:06.322714 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fb22c7-47ba-45a0-82c4-b8468fff9fa2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:06.324175 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fb22c7-47ba-45a0-82c4-b8468fff9fa2 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:06.336041 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 181/364] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 9 20:11:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:06.336708 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb22c7-47ba-45a0-82c4-b8468fff9fa2 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:06.391336 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad87fe4f-3209-40f9-9632-863c54da37fe None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:06.441105 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce08fd9-244f-4eba-9eb3-87b63b8e5191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:06.441105 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce08fd9-244f-4eba-9eb3-87b63b8e5191 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:06.441105 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce08fd9-244f-4eba-9eb3-87b63b8e5191 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:06.441647 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce08fd9-244f-4eba-9eb3-87b63b8e5191 None admin] PATH_INFO: `/v3/groups/9e5d512ace634db398dc14cdc158344c` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:06.442694 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce08fd9-244f-4eba-9eb3-87b63b8e5191 None admin] RBAC: Authorizing `identity:get_group(group_id=9e5d512ace634db398dc14cdc158344c)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:06.444334 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce08fd9-244f-4eba-9eb3-87b63b8e5191 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:06.451882 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 184/365] 10.222.0.44 () {56 vars in 1180 bytes} [Mon May 9 20:11:06 2022] GET /identity/v3/groups/9e5d512ace634db398dc14cdc158344c => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:06.452798 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce08fd9-244f-4eba-9eb3-87b63b8e5191 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:06.471437 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb22c7-47ba-45a0-82c4-b8468fff9fa2 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:06.509148 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b54ce7b-e7e5-45fe-a06d-e5785c1c054c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:06.510065 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54ce7b-e7e5-45fe-a06d-e5785c1c054c None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:06.510279 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54ce7b-e7e5-45fe-a06d-e5785c1c054c None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:06.510493 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54ce7b-e7e5-45fe-a06d-e5785c1c054c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:06.523148 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b54ce7b-e7e5-45fe-a06d-e5785c1c054c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:11:06.532307 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-6b54ce7b-e7e5-45fe-a06d-e5785c1c054c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 20:11:06.532307 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:06.532307 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:06.532307 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:06.532307 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:06.532307 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:06.532307 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:06.532307 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:06.532307 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:06.532307 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:06.532307 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:06.532307 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:06.532307 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:11:06.532307 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:11:06.532307 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:11:06.532307 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:11:06.533241 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:11:06.533241 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:11:06.533241 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:11:06.533241 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:11:06.533241 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:06.533241 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:06.533241 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:06.533241 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:06.533241 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:06.533241 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:06.533241 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:06.533241 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:11:06.533241 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:06.533241 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:06.533241 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:06.533241 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:06.534124 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:06.534124 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:06.534124 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:06.534124 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:06.534124 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:11:06.534124 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:11:06.534124 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:11:06.534124 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:11:06.534124 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:11:06.534124 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:11:06.534124 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 20:11:06.534124 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:06.534124 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 182/366] 10.222.0.44 () {56 vars in 1096 bytes} [Mon May 9 20:11:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:06.534817 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b54ce7b-e7e5-45fe-a06d-e5785c1c054c None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:06.587737 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce08fd9-244f-4eba-9eb3-87b63b8e5191 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:06.628780 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03a82f4-37b7-48b0-8a87-cccf0d444589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:06.629439 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a82f4-37b7-48b0-8a87-cccf0d444589 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:06.629722 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a82f4-37b7-48b0-8a87-cccf0d444589 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:06.629997 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a82f4-37b7-48b0-8a87-cccf0d444589 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:06.666213 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b54ce7b-e7e5-45fe-a06d-e5785c1c054c None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:06.712050 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b4bf50-43dc-465c-9c5e-f4a8e4b49363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:06.713082 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4bf50-43dc-465c-9c5e-f4a8e4b49363 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:06.713575 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4bf50-43dc-465c-9c5e-f4a8e4b49363 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:06.714048 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4bf50-43dc-465c-9c5e-f4a8e4b49363 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:06.724328 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03a82f4-37b7-48b0-8a87-cccf0d444589 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:06.726264 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03a82f4-37b7-48b0-8a87-cccf0d444589 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:06.808663 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b4bf50-43dc-465c-9c5e-f4a8e4b49363 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:06.810138 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b4bf50-43dc-465c-9c5e-f4a8e4b49363 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:06.859213 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 185/367] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 9 20:11:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 20:11:06.860371 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03a82f4-37b7-48b0-8a87-cccf0d444589 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:06.910310 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 183/368] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 9 20:11:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 20:11:06.911192 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b4bf50-43dc-465c-9c5e-f4a8e4b49363 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:06.969974 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03a82f4-37b7-48b0-8a87-cccf0d444589 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:07.013872 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d3370f-74a0-4c4a-8806-a3f7d8a2809f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:07.014681 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d3370f-74a0-4c4a-8806-a3f7d8a2809f None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:07.014962 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d3370f-74a0-4c4a-8806-a3f7d8a2809f None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:07.015232 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d3370f-74a0-4c4a-8806-a3f7d8a2809f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:07.016571 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d3370f-74a0-4c4a-8806-a3f7d8a2809f None admin] RBAC: Adding query filter params (group.id=9e5d512ace634db398dc14cdc158344c, role.id=52c0c2910c294965839ef51e91b156a1, scope.project.id=2019f358cc3841408e7d4693c6b8133a) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:07.017013 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d3370f-74a0-4c4a-8806-a3f7d8a2809f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:07.018911 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d3370f-74a0-4c4a-8806-a3f7d8a2809f None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:07.022951 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b4bf50-43dc-465c-9c5e-f4a8e4b49363 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:07.028796 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 186/369] 10.222.0.44 () {56 vars in 1376 bytes} [Mon May 9 20:11:06 2022] GET /identity/v3/role_assignments?group.id=9e5d512ace634db398dc14cdc158344c&scope.project.id=2019f358cc3841408e7d4693c6b8133a&role.id=52c0c2910c294965839ef51e91b156a1 => generated 260 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:07.029410 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d3370f-74a0-4c4a-8806-a3f7d8a2809f None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:07.066060 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c491d9-c0cf-42f9-abf8-c8812ad6a4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:07.067217 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c491d9-c0cf-42f9-abf8-c8812ad6a4d5 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:07.067696 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c491d9-c0cf-42f9-abf8-c8812ad6a4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:07.067975 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c491d9-c0cf-42f9-abf8-c8812ad6a4d5 None admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:07.068953 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c491d9-c0cf-42f9-abf8-c8812ad6a4d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:07.069348 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c491d9-c0cf-42f9-abf8-c8812ad6a4d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:07.071882 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c491d9-c0cf-42f9-abf8-c8812ad6a4d5 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:07.085973 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 184/370] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 9 20:11:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:07.086915 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c491d9-c0cf-42f9-abf8-c8812ad6a4d5 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:07.166998 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d3370f-74a0-4c4a-8806-a3f7d8a2809f None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:07.202077 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce183ebd-2c7a-4218-92ba-26d209566c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:07.203063 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce183ebd-2c7a-4218-92ba-26d209566c02 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:07.203476 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce183ebd-2c7a-4218-92ba-26d209566c02 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:07.203854 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce183ebd-2c7a-4218-92ba-26d209566c02 None admin] PATH_INFO: `/v3/projects/45776741808d4cd98d7420b62d06836d` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:07.205205 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce183ebd-2c7a-4218-92ba-26d209566c02 None admin] RBAC: Authorizing `identity:get_project(project_id=45776741808d4cd98d7420b62d06836d)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:07.207591 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce183ebd-2c7a-4218-92ba-26d209566c02 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:07.209528 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 187/371] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 9 20:11:07 2022] GET /identity/v3/projects/45776741808d4cd98d7420b62d06836d => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:07.209960 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c491d9-c0cf-42f9-abf8-c8812ad6a4d5 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:07.210544 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce183ebd-2c7a-4218-92ba-26d209566c02 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:07.247716 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb4e262-7aec-4f8b-ad00-8cccfcc2f540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:07.248817 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb4e262-7aec-4f8b-ad00-8cccfcc2f540 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:07.249260 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb4e262-7aec-4f8b-ad00-8cccfcc2f540 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:07.249534 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb4e262-7aec-4f8b-ad00-8cccfcc2f540 None admin] PATH_INFO: `/v3/projects/45776741808d4cd98d7420b62d06836d` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:07.250818 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb4e262-7aec-4f8b-ad00-8cccfcc2f540 None admin] RBAC: Authorizing `identity:get_project(project_id=45776741808d4cd98d7420b62d06836d)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:07.252303 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb4e262-7aec-4f8b-ad00-8cccfcc2f540 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:07.258608 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 185/372] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 9 20:11:07 2022] GET /identity/v3/projects/45776741808d4cd98d7420b62d06836d => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:07.258608 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb4e262-7aec-4f8b-ad00-8cccfcc2f540 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:07.334760 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce183ebd-2c7a-4218-92ba-26d209566c02 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:07.369234 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5facee-efaf-4349-b118-1781e4c46fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:07.370169 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5facee-efaf-4349-b118-1781e4c46fe4 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:07.370627 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5facee-efaf-4349-b118-1781e4c46fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:07.371071 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5facee-efaf-4349-b118-1781e4c46fe4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:07.376098 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb4e262-7aec-4f8b-ad00-8cccfcc2f540 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:07.418454 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91113265-0661-4af7-8db4-642b0fa25de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:07.419316 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91113265-0661-4af7-8db4-642b0fa25de2 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:07.419702 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91113265-0661-4af7-8db4-642b0fa25de2 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:07.420044 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91113265-0661-4af7-8db4-642b0fa25de2 None admin] PATH_INFO: `/v3/groups/9e5d512ace634db398dc14cdc158344c` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:07.421322 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91113265-0661-4af7-8db4-642b0fa25de2 None admin] RBAC: Authorizing `identity:get_group(group_id=9e5d512ace634db398dc14cdc158344c)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:07.422855 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91113265-0661-4af7-8db4-642b0fa25de2 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:07.424634 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 186/373] 10.222.0.44 () {56 vars in 1180 bytes} [Mon May 9 20:11:07 2022] GET /identity/v3/groups/9e5d512ace634db398dc14cdc158344c => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:07.426120 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91113265-0661-4af7-8db4-642b0fa25de2 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:07.439622 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5facee-efaf-4349-b118-1781e4c46fe4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:07.441634 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5facee-efaf-4349-b118-1781e4c46fe4 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:07.527647 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91113265-0661-4af7-8db4-642b0fa25de2 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:07.538735 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 188/374] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 9 20:11:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 20:11:07.539405 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5facee-efaf-4349-b118-1781e4c46fe4 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:07.561569 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ea5173-afb8-45ca-b952-ee5011162f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:07.562426 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea5173-afb8-45ca-b952-ee5011162f44 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:07.562708 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea5173-afb8-45ca-b952-ee5011162f44 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:07.562982 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea5173-afb8-45ca-b952-ee5011162f44 None admin] PATH_INFO: `/v3/groups/9e5d512ace634db398dc14cdc158344c` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:07.564185 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ea5173-afb8-45ca-b952-ee5011162f44 None admin] RBAC: Authorizing `identity:get_group(group_id=9e5d512ace634db398dc14cdc158344c)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:07.568224 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ea5173-afb8-45ca-b952-ee5011162f44 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:07.571010 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 187/375] 10.222.0.44 () {56 vars in 1180 bytes} [Mon May 9 20:11:07 2022] GET /identity/v3/groups/9e5d512ace634db398dc14cdc158344c => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:07.571986 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ea5173-afb8-45ca-b952-ee5011162f44 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:07.650367 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5facee-efaf-4349-b118-1781e4c46fe4 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:07.684189 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37f7ae1-cef2-458e-a3ff-b1baebef2f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:07.684813 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f7ae1-cef2-458e-a3ff-b1baebef2f31 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:07.685100 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f7ae1-cef2-458e-a3ff-b1baebef2f31 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:07.685377 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f7ae1-cef2-458e-a3ff-b1baebef2f31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:07.686201 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37f7ae1-cef2-458e-a3ff-b1baebef2f31 None admin] RBAC: Adding query filter params (group.id=9e5d512ace634db398dc14cdc158344c, role.id=79f90a0bf6ea43d0b3c434e31556253a, scope.project.id=45776741808d4cd98d7420b62d06836d) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:07.686513 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37f7ae1-cef2-458e-a3ff-b1baebef2f31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:07.687996 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37f7ae1-cef2-458e-a3ff-b1baebef2f31 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:07.694424 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 189/376] 10.222.0.44 () {56 vars in 1376 bytes} [Mon May 9 20:11:07 2022] GET /identity/v3/role_assignments?group.id=9e5d512ace634db398dc14cdc158344c&scope.project.id=45776741808d4cd98d7420b62d06836d&role.id=79f90a0bf6ea43d0b3c434e31556253a => generated 260 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:07.694642 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ea5173-afb8-45ca-b952-ee5011162f44 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:07.695133 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37f7ae1-cef2-458e-a3ff-b1baebef2f31 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:07.746778 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff93656-2255-4687-974f-d839b38f2973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:07.747686 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff93656-2255-4687-974f-d839b38f2973 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:07.748213 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff93656-2255-4687-974f-d839b38f2973 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:07.748495 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff93656-2255-4687-974f-d839b38f2973 None admin] PATH_INFO: `/v3/projects/fc21a92582474562a4faafd37e72b6be` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:07.753678 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff93656-2255-4687-974f-d839b38f2973 None admin] RBAC: Authorizing `identity:get_project(project_id=fc21a92582474562a4faafd37e72b6be)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:07.755580 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff93656-2255-4687-974f-d839b38f2973 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:07.759755 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 188/377] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 9 20:11:07 2022] GET /identity/v3/projects/fc21a92582474562a4faafd37e72b6be => generated 344 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:07.763574 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff93656-2255-4687-974f-d839b38f2973 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:07.857313 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37f7ae1-cef2-458e-a3ff-b1baebef2f31 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:07.939817 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff93656-2255-4687-974f-d839b38f2973 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:07.942485 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a5c64-7aa9-43ac-8a05-fe0dfbffc533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:07.943143 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a5c64-7aa9-43ac-8a05-fe0dfbffc533 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:07.943431 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a5c64-7aa9-43ac-8a05-fe0dfbffc533 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:07.943706 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a5c64-7aa9-43ac-8a05-fe0dfbffc533 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:07.944537 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877a5c64-7aa9-43ac-8a05-fe0dfbffc533 None admin] RBAC: Adding query filter params (group.id=9e5d512ace634db398dc14cdc158344c, role.id=52c0c2910c294965839ef51e91b156a1, scope.project.id=45776741808d4cd98d7420b62d06836d) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:07.944841 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877a5c64-7aa9-43ac-8a05-fe0dfbffc533 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:07.946286 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877a5c64-7aa9-43ac-8a05-fe0dfbffc533 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:07.952721 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 190/378] 10.222.0.44 () {56 vars in 1376 bytes} [Mon May 9 20:11:07 2022] GET /identity/v3/role_assignments?group.id=9e5d512ace634db398dc14cdc158344c&scope.project.id=45776741808d4cd98d7420b62d06836d&role.id=52c0c2910c294965839ef51e91b156a1 => generated 260 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:07.982171 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247d57e6-2de3-4e51-9a37-2a89728e68db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:07.983333 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d57e6-2de3-4e51-9a37-2a89728e68db None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:07.983792 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d57e6-2de3-4e51-9a37-2a89728e68db None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:07.984208 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d57e6-2de3-4e51-9a37-2a89728e68db None admin] PATH_INFO: `/v3/groups/97956b19e5d4485ea0c49953ab1c3226` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:07.991765 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247d57e6-2de3-4e51-9a37-2a89728e68db None admin] RBAC: Authorizing `identity:get_group(group_id=97956b19e5d4485ea0c49953ab1c3226)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:07.994240 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247d57e6-2de3-4e51-9a37-2a89728e68db None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:07.996573 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 189/379] 10.222.0.44 () {56 vars in 1180 bytes} [Mon May 9 20:11:07 2022] GET /identity/v3/groups/97956b19e5d4485ea0c49953ab1c3226 => generated 229 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:08.002819 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a5c64-7aa9-43ac-8a05-fe0dfbffc533 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:08.166256 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a5c64-7aa9-43ac-8a05-fe0dfbffc533 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:08.212756 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5203ffa9-a74f-45c5-b941-c95226fd1564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:08.213419 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5203ffa9-a74f-45c5-b941-c95226fd1564 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:08.213696 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5203ffa9-a74f-45c5-b941-c95226fd1564 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:08.213962 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5203ffa9-a74f-45c5-b941-c95226fd1564 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:08.214798 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5203ffa9-a74f-45c5-b941-c95226fd1564 None admin] RBAC: Adding query filter params (group.id=97956b19e5d4485ea0c49953ab1c3226, role.id=274130b78e304bb88789c1b349263f3c, scope.project.id=fc21a92582474562a4faafd37e72b6be) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:08.215101 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5203ffa9-a74f-45c5-b941-c95226fd1564 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:08.216578 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5203ffa9-a74f-45c5-b941-c95226fd1564 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:08.224891 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 191/380] 10.222.0.44 () {56 vars in 1376 bytes} [Mon May 9 20:11:08 2022] GET /identity/v3/role_assignments?group.id=97956b19e5d4485ea0c49953ab1c3226&scope.project.id=fc21a92582474562a4faafd37e72b6be&role.id=274130b78e304bb88789c1b349263f3c => generated 260 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:08.538912 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7faace-32da-4690-9b04-156674fb1c5f None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:08.538912 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7faace-32da-4690-9b04-156674fb1c5f None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:08.538912 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7faace-32da-4690-9b04-156674fb1c5f None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:08.538912 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 190/381] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:11:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 20:11:08.545389 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad729925-2325-464a-b632-bc1f297d6e4f None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:08.545923 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad729925-2325-464a-b632-bc1f297d6e4f None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:08.546392 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad729925-2325-464a-b632-bc1f297d6e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:08.568968 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-ad729925-2325-464a-b632-bc1f297d6e4f None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:11:08.570494 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-ad729925-2325-464a-b632-bc1f297d6e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:11:08.661157 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 192/382] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:11:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 20:11:08.696643 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7faace-32da-4690-9b04-156674fb1c5f None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:08.838692 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7faace-32da-4690-9b04-156674fb1c5f None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:08.882761 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6742b11-d925-44d0-a3a8-cfdda6e68f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:08.883966 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6742b11-d925-44d0-a3a8-cfdda6e68f65 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:08.884485 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6742b11-d925-44d0-a3a8-cfdda6e68f65 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:08.884957 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6742b11-d925-44d0-a3a8-cfdda6e68f65 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:08.903824 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6742b11-d925-44d0-a3a8-cfdda6e68f65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:11:08.911768 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-e6742b11-d925-44d0-a3a8-cfdda6e68f65 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 20:11:08.911768 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:08.911768 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:08.911768 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:08.911768 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:08.911768 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:08.911768 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:08.911768 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:08.911768 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:08.911768 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:08.911768 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:08.911768 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:08.911768 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:11:08.911768 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:11:08.911768 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:11:08.911768 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:11:08.912705 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:11:08.912705 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:11:08.912705 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:11:08.912705 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:11:08.912705 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:08.912705 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:08.912705 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:08.912705 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:08.912705 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:08.912705 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:08.912705 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:08.912705 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:11:08.912705 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:08.912705 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:08.912705 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:08.912705 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:08.913934 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:08.913934 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:08.913934 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:08.913934 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:08.913934 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:11:08.913934 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:11:08.913934 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:11:08.913934 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:11:08.913934 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:11:08.913934 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:11:08.913934 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 20:11:08.913934 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:08.913934 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 191/383] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 9 20:11:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:08.920809 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad729925-2325-464a-b632-bc1f297d6e4f None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:09.043218 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad729925-2325-464a-b632-bc1f297d6e4f None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:09.082600 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7e72c5-3614-402e-b846-376267d7b6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:09.083264 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e72c5-3614-402e-b846-376267d7b6e7 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:09.083574 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e72c5-3614-402e-b846-376267d7b6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:09.083848 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e72c5-3614-402e-b846-376267d7b6e7 None admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:09.084592 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7e72c5-3614-402e-b846-376267d7b6e7 None admin] RBAC: Adding query filter params (name=member) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:09.084895 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7e72c5-3614-402e-b846-376267d7b6e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:09.086264 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7e72c5-3614-402e-b846-376267d7b6e7 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:09.094810 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 193/384] 10.222.0.44 () {56 vars in 1101 bytes} [Mon May 9 20:11:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:09.101317 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6742b11-d925-44d0-a3a8-cfdda6e68f65 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:09.235153 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6742b11-d925-44d0-a3a8-cfdda6e68f65 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:09.275908 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810df82c-6000-41f0-bbf1-efce3441bd9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:09.277045 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810df82c-6000-41f0-bbf1-efce3441bd9c None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:09.277572 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810df82c-6000-41f0-bbf1-efce3441bd9c None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:09.277994 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810df82c-6000-41f0-bbf1-efce3441bd9c None admin] PATH_INFO: `/v3/groups/9e5d512ace634db398dc14cdc158344c` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:09.284418 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810df82c-6000-41f0-bbf1-efce3441bd9c None admin] RBAC: Authorizing `identity:get_group(group_id=9e5d512ace634db398dc14cdc158344c)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:09.286131 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810df82c-6000-41f0-bbf1-efce3441bd9c None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:09.288045 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 192/385] 10.222.0.44 () {56 vars in 1180 bytes} [Mon May 9 20:11:09 2022] GET /identity/v3/groups/9e5d512ace634db398dc14cdc158344c => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:09.294126 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7e72c5-3614-402e-b846-376267d7b6e7 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:09.404884 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7e72c5-3614-402e-b846-376267d7b6e7 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:09.442441 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5575e9-fddc-4659-9a68-bcabf2b7c4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:09.443297 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5575e9-fddc-4659-9a68-bcabf2b7c4f8 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:09.443604 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5575e9-fddc-4659-9a68-bcabf2b7c4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:09.443878 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5575e9-fddc-4659-9a68-bcabf2b7c4f8 None admin] PATH_INFO: `/v3/projects/2019f358cc3841408e7d4693c6b8133a` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:09.445067 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5575e9-fddc-4659-9a68-bcabf2b7c4f8 None admin] RBAC: Authorizing `identity:get_project(project_id=2019f358cc3841408e7d4693c6b8133a)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:09.446500 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5575e9-fddc-4659-9a68-bcabf2b7c4f8 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:09.448390 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 194/386] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 9 20:11:09 2022] GET /identity/v3/projects/2019f358cc3841408e7d4693c6b8133a => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:09.454017 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810df82c-6000-41f0-bbf1-efce3441bd9c None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:09.564406 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f40c2f-b1a3-4397-9155-2f650502d663 None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:09.564729 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f40c2f-b1a3-4397-9155-2f650502d663 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:09.564959 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f40c2f-b1a3-4397-9155-2f650502d663 None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:09.566594 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 195/387] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:11:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:11:09.571835 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33f137e-336d-466e-b660-3b5781aff183 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:09.572119 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33f137e-336d-466e-b660-3b5781aff183 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:09.572393 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33f137e-336d-466e-b660-3b5781aff183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:09.600229 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-c33f137e-336d-466e-b660-3b5781aff183 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:11:09.601434 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-c33f137e-336d-466e-b660-3b5781aff183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:11:09.632239 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810df82c-6000-41f0-bbf1-efce3441bd9c None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:09.693638 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e5dd96-e975-4881-a324-bddd1f2624e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:09.694429 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5dd96-e975-4881-a324-bddd1f2624e2 None admin] REQUEST_METHOD: `PUT` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:09.694705 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5dd96-e975-4881-a324-bddd1f2624e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:09.694972 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5dd96-e975-4881-a324-bddd1f2624e2 None admin] PATH_INFO: `/v3/projects/2019f358cc3841408e7d4693c6b8133a/groups/9e5d512ace634db398dc14cdc158344c/roles/79f90a0bf6ea43d0b3c434e31556253a` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:09.697969 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e5dd96-e975-4881-a324-bddd1f2624e2 None admin] RBAC: Authorizing `identity:create_grant(project_id=2019f358cc3841408e7d4693c6b8133a, group_id=9e5d512ace634db398dc14cdc158344c, role_id=79f90a0bf6ea43d0b3c434e31556253a)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:09.699421 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e5dd96-e975-4881-a324-bddd1f2624e2 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:09.715343 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 193/388] 10.222.0.44 () {58 vars in 1442 bytes} [Mon May 9 20:11:09 2022] PUT /identity/v3/projects/2019f358cc3841408e7d4693c6b8133a/groups/9e5d512ace634db398dc14cdc158344c/roles/79f90a0bf6ea43d0b3c434e31556253a => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:11:09.721113 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 196/389] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:11:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 20:11:09.760588 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e5dd96-e975-4881-a324-bddd1f2624e2 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:09.891663 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e5dd96-e975-4881-a324-bddd1f2624e2 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:09.936436 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dfc3b5-179b-4bd6-8346-189cef7d031a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:09.937263 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dfc3b5-179b-4bd6-8346-189cef7d031a None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:09.937547 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dfc3b5-179b-4bd6-8346-189cef7d031a None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:09.937820 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dfc3b5-179b-4bd6-8346-189cef7d031a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:09.950718 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dfc3b5-179b-4bd6-8346-189cef7d031a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:11:09.959444 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-86dfc3b5-179b-4bd6-8346-189cef7d031a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 20:11:09.959444 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:09.959444 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:09.959444 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:09.959444 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:09.959444 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:09.959444 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:09.959444 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:09.959444 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:09.959444 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:09.959444 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:09.959444 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:09.959444 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:11:09.959444 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:11:09.959444 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:11:09.959444 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:11:09.960345 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:11:09.960345 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:11:09.960345 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:11:09.960345 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:11:09.960345 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:09.960345 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:09.960345 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:09.960345 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:09.960345 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:09.960345 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:09.960345 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:09.960345 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:11:09.960345 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:09.960345 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:09.960345 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:09.960345 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:09.961144 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:09.961144 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:09.961144 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:09.961144 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:09.961144 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:11:09.961144 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:11:09.961144 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:11:09.961144 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:11:09.961144 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:11:09.961144 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:11:09.961144 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 20:11:09.961144 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:09.961741 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 194/390] 10.222.0.44 () {56 vars in 1114 bytes} [Mon May 9 20:11:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:09.967148 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33f137e-336d-466e-b660-3b5781aff183 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:10.069732 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33f137e-336d-466e-b660-3b5781aff183 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:10.106945 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f999203-3822-4c4c-9452-e34751329848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:10.107643 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f999203-3822-4c4c-9452-e34751329848 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:10.107927 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f999203-3822-4c4c-9452-e34751329848 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:10.108196 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f999203-3822-4c4c-9452-e34751329848 None admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:10.108944 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f999203-3822-4c4c-9452-e34751329848 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:10.109243 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f999203-3822-4c4c-9452-e34751329848 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:10.110627 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f999203-3822-4c4c-9452-e34751329848 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:10.123758 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 197/391] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 9 20:11:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:10.125447 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dfc3b5-179b-4bd6-8346-189cef7d031a None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:10.229409 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dfc3b5-179b-4bd6-8346-189cef7d031a None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:10.270597 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1da3e4-439d-4416-a238-1e945a37569f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:10.271466 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1da3e4-439d-4416-a238-1e945a37569f None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:10.271749 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1da3e4-439d-4416-a238-1e945a37569f None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:10.272019 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1da3e4-439d-4416-a238-1e945a37569f None admin] PATH_INFO: `/v3/groups/9e5d512ace634db398dc14cdc158344c` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:10.273203 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1da3e4-439d-4416-a238-1e945a37569f None admin] RBAC: Authorizing `identity:get_group(group_id=9e5d512ace634db398dc14cdc158344c)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:10.274623 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1da3e4-439d-4416-a238-1e945a37569f None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:10.276579 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 195/392] 10.222.0.44 () {56 vars in 1180 bytes} [Mon May 9 20:11:10 2022] GET /identity/v3/groups/9e5d512ace634db398dc14cdc158344c => generated 226 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:10.281808 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f999203-3822-4c4c-9452-e34751329848 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:10.451137 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f999203-3822-4c4c-9452-e34751329848 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:10.496167 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108c5306-5e62-4caa-a35a-9171def05967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:10.497402 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c5306-5e62-4caa-a35a-9171def05967 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:10.497884 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c5306-5e62-4caa-a35a-9171def05967 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:10.498352 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c5306-5e62-4caa-a35a-9171def05967 None admin] PATH_INFO: `/v3/projects/2019f358cc3841408e7d4693c6b8133a` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:10.499807 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108c5306-5e62-4caa-a35a-9171def05967 None admin] RBAC: Authorizing `identity:get_project(project_id=2019f358cc3841408e7d4693c6b8133a)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:10.501469 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108c5306-5e62-4caa-a35a-9171def05967 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:10.504456 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 198/393] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 9 20:11:10 2022] GET /identity/v3/projects/2019f358cc3841408e7d4693c6b8133a => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:10.510027 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1da3e4-439d-4416-a238-1e945a37569f None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:10.558726 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ce748-fdeb-4fb0-8db2-098cc66437c8 None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:10.559375 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ce748-fdeb-4fb0-8db2-098cc66437c8 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:10.559867 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ce748-fdeb-4fb0-8db2-098cc66437c8 None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:10.561440 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 199/394] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:11:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:11:10.573026 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cfc179-371f-444c-9c38-4caafad31d7c None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:10.573615 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cfc179-371f-444c-9c38-4caafad31d7c None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:10.574108 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cfc179-371f-444c-9c38-4caafad31d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:10.597009 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-c4cfc179-371f-444c-9c38-4caafad31d7c None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:11:10.598636 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-c4cfc179-371f-444c-9c38-4caafad31d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:11:10.647584 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1da3e4-439d-4416-a238-1e945a37569f None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:10.689499 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ff71e8-541e-402f-a2a1-4a7059e2d9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:10.690940 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff71e8-541e-402f-a2a1-4a7059e2d9bb None admin] REQUEST_METHOD: `PUT` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:10.691372 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff71e8-541e-402f-a2a1-4a7059e2d9bb None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:10.691684 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff71e8-541e-402f-a2a1-4a7059e2d9bb None admin] PATH_INFO: `/v3/projects/2019f358cc3841408e7d4693c6b8133a/groups/9e5d512ace634db398dc14cdc158344c/roles/52c0c2910c294965839ef51e91b156a1` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:10.696248 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ff71e8-541e-402f-a2a1-4a7059e2d9bb None admin] RBAC: Authorizing `identity:create_grant(project_id=2019f358cc3841408e7d4693c6b8133a, group_id=9e5d512ace634db398dc14cdc158344c, role_id=52c0c2910c294965839ef51e91b156a1)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:10.697726 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ff71e8-541e-402f-a2a1-4a7059e2d9bb None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:10.719204 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 196/395] 10.222.0.44 () {58 vars in 1442 bytes} [Mon May 9 20:11:10 2022] PUT /identity/v3/projects/2019f358cc3841408e7d4693c6b8133a/groups/9e5d512ace634db398dc14cdc158344c/roles/52c0c2910c294965839ef51e91b156a1 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:11:10.736999 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 200/396] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:11:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 20:11:10.760216 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ff71e8-541e-402f-a2a1-4a7059e2d9bb None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:10.879354 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ff71e8-541e-402f-a2a1-4a7059e2d9bb None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:10.903290 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0184dd-9112-496a-b99c-69e9c181da4c None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:10.903599 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0184dd-9112-496a-b99c-69e9c181da4c None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:10.903875 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0184dd-9112-496a-b99c-69e9c181da4c None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:10.905501 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 201/397] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:11:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 20:11:10.910839 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0c551-fc8a-4253-9b0f-4cccc7cca709 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:10.911121 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0c551-fc8a-4253-9b0f-4cccc7cca709 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:10.911564 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0c551-fc8a-4253-9b0f-4cccc7cca709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:10.928182 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5232de-abec-41c3-8418-7a72249b03d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:10.928993 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5232de-abec-41c3-8418-7a72249b03d0 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:10.929377 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5232de-abec-41c3-8418-7a72249b03d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:10.929656 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5232de-abec-41c3-8418-7a72249b03d0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:10.936995 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-5cc0c551-fc8a-4253-9b0f-4cccc7cca709 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:11:10.938234 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-5cc0c551-fc8a-4253-9b0f-4cccc7cca709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:11:10.955625 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5232de-abec-41c3-8418-7a72249b03d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:11:10.966318 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-ae5232de-abec-41c3-8418-7a72249b03d0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 20:11:10.966318 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:10.966318 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:10.966318 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:10.966318 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:10.966318 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:10.966318 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:10.966318 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:10.966318 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:10.966318 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:10.966318 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:10.966318 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:10.966318 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:11:10.966318 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:11:10.966318 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:11:10.966318 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:11:10.967316 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:11:10.967316 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:11:10.967316 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:11:10.967316 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:11:10.967316 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:10.967316 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:10.967316 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:10.967316 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:10.967316 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:10.967316 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:10.967316 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:10.967316 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:11:10.967316 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:10.967316 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:10.967316 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:10.967316 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:10.968134 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:10.968134 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:10.968134 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:10.968134 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:10.968134 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:11:10.968134 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:11:10.968134 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:11:10.968134 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:11:10.968134 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:11:10.968134 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:11:10.968134 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 20:11:10.968134 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:10.970344 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 197/398] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 9 20:11:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:10.977813 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5232de-abec-41c3-8418-7a72249b03d0 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:11.051350 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 202/399] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:11:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 20:11:11.074079 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc0c551-fc8a-4253-9b0f-4cccc7cca709 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:11.141536 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5232de-abec-41c3-8418-7a72249b03d0 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:11.186024 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc0c551-fc8a-4253-9b0f-4cccc7cca709 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:11.186254 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ee234-39e1-46e2-a369-99a191b4be87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:11.186901 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ee234-39e1-46e2-a369-99a191b4be87 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:11.187182 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ee234-39e1-46e2-a369-99a191b4be87 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:11.187482 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ee234-39e1-46e2-a369-99a191b4be87 None admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:11.188392 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54ee234-39e1-46e2-a369-99a191b4be87 None admin] RBAC: Adding query filter params (name=member) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:11.188704 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54ee234-39e1-46e2-a369-99a191b4be87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:11.191428 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54ee234-39e1-46e2-a369-99a191b4be87 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:11.201696 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 198/400] 10.222.0.44 () {56 vars in 1101 bytes} [Mon May 9 20:11:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:11.203955 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08797fda-c799-4adb-bc1a-662571e3ed6e None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:11.204382 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08797fda-c799-4adb-bc1a-662571e3ed6e None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:11.204815 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08797fda-c799-4adb-bc1a-662571e3ed6e None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:11.209880 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 199/401] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:11:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:11:11.210807 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08797fda-c799-4adb-bc1a-662571e3ed6e None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:11.229524 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480af0e8-7e6a-4908-bd32-a7829a594843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:11.230965 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480af0e8-7e6a-4908-bd32-a7829a594843 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:11.231735 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480af0e8-7e6a-4908-bd32-a7829a594843 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:11.232152 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480af0e8-7e6a-4908-bd32-a7829a594843 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:11.245437 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480af0e8-7e6a-4908-bd32-a7829a594843 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:11:11.257023 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-480af0e8-7e6a-4908-bd32-a7829a594843 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 20:11:11.257023 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:11.257023 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:11.257023 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:11.257023 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:11.257023 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:11.257023 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:11.257023 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:11.257023 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:11.257023 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:11.257023 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:11.257023 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:11.257023 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:11:11.257023 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:11:11.257023 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:11:11.257023 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:11:11.257928 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:11:11.257928 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:11:11.257928 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:11:11.257928 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:11:11.257928 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:11.257928 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:11.257928 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:11.257928 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:11.257928 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:11.257928 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:11.257928 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:11.257928 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:11:11.257928 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:11.257928 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:11.257928 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:11.257928 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:11.258717 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:11.258717 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:11.258717 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:11.258717 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:11.258717 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:11:11.258717 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:11:11.258717 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:11:11.258717 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:11:11.258717 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:11:11.258717 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:11:11.258717 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 20:11:11.258717 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:11:11.260883 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 203/402] 10.222.0.44 () {56 vars in 1114 bytes} [Mon May 9 20:11:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:11.265880 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc40e9e-2316-4f09-ba8a-c24b0ef396c2 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:11.265880 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc40e9e-2316-4f09-ba8a-c24b0ef396c2 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:11.265880 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc40e9e-2316-4f09-ba8a-c24b0ef396c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:11.287960 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-5fc40e9e-2316-4f09-ba8a-c24b0ef396c2 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:11:11.289909 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-5fc40e9e-2316-4f09-ba8a-c24b0ef396c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:11:11.334758 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08797fda-c799-4adb-bc1a-662571e3ed6e None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:11.374435 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 204/403] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:11:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 20:11:11.374934 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a9b941-72c5-4d0e-9e21-e427a470ab53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:11.375890 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a9b941-72c5-4d0e-9e21-e427a470ab53 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:11.376168 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a9b941-72c5-4d0e-9e21-e427a470ab53 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:11.376382 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc40e9e-2316-4f09-ba8a-c24b0ef396c2 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:11.376477 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a9b941-72c5-4d0e-9e21-e427a470ab53 None admin] PATH_INFO: `/v3/groups/9e5d512ace634db398dc14cdc158344c` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:11.378168 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a9b941-72c5-4d0e-9e21-e427a470ab53 None admin] RBAC: Authorizing `identity:get_group(group_id=9e5d512ace634db398dc14cdc158344c)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:11.379840 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a9b941-72c5-4d0e-9e21-e427a470ab53 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:11.382916 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 200/404] 10.222.0.44 () {56 vars in 1180 bytes} [Mon May 9 20:11:11 2022] GET /identity/v3/groups/9e5d512ace634db398dc14cdc158344c => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:11.387845 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a9b941-72c5-4d0e-9e21-e427a470ab53 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:11.500549 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a9b941-72c5-4d0e-9e21-e427a470ab53 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:11.501409 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc40e9e-2316-4f09-ba8a-c24b0ef396c2 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:11.535240 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460bf5bc-452b-4eda-9cd5-21aaa436a2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:11.536414 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460bf5bc-452b-4eda-9cd5-21aaa436a2ac None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:11.536856 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460bf5bc-452b-4eda-9cd5-21aaa436a2ac None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:11.537262 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460bf5bc-452b-4eda-9cd5-21aaa436a2ac None admin] PATH_INFO: `/v3/projects/45776741808d4cd98d7420b62d06836d` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:11.538833 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460bf5bc-452b-4eda-9cd5-21aaa436a2ac None admin] RBAC: Authorizing `identity:get_project(project_id=45776741808d4cd98d7420b62d06836d)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:11.540427 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460bf5bc-452b-4eda-9cd5-21aaa436a2ac None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:11.542554 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 201/405] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 9 20:11:11 2022] GET /identity/v3/projects/45776741808d4cd98d7420b62d06836d => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:11.542720 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55572ce-be1b-4fe3-94cf-887039282a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:11.543385 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55572ce-be1b-4fe3-94cf-887039282a62 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:11.543762 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460bf5bc-452b-4eda-9cd5-21aaa436a2ac None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:11.547736 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55572ce-be1b-4fe3-94cf-887039282a62 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:11.548650 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55572ce-be1b-4fe3-94cf-887039282a62 None admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:11.549747 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55572ce-be1b-4fe3-94cf-887039282a62 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:11.550226 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55572ce-be1b-4fe3-94cf-887039282a62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:11.551772 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55572ce-be1b-4fe3-94cf-887039282a62 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:11.560530 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 205/406] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 9 20:11:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:11.566104 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55572ce-be1b-4fe3-94cf-887039282a62 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:11.665358 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55572ce-be1b-4fe3-94cf-887039282a62 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:11.669810 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460bf5bc-452b-4eda-9cd5-21aaa436a2ac None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:11.708530 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb24c57b-7763-4224-ba8a-ceb0f62d9d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:11.709607 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24c57b-7763-4224-ba8a-ceb0f62d9d4a None admin] REQUEST_METHOD: `PUT` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:11.709889 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24c57b-7763-4224-ba8a-ceb0f62d9d4a None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:11.710162 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24c57b-7763-4224-ba8a-ceb0f62d9d4a None admin] PATH_INFO: `/v3/projects/45776741808d4cd98d7420b62d06836d/groups/9e5d512ace634db398dc14cdc158344c/roles/79f90a0bf6ea43d0b3c434e31556253a` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:11.711126 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c0fcae-b493-49d5-8b74-4cc2caf2323f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:11.712141 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0fcae-b493-49d5-8b74-4cc2caf2323f None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:11.712261 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb24c57b-7763-4224-ba8a-ceb0f62d9d4a None admin] RBAC: Authorizing `identity:create_grant(project_id=45776741808d4cd98d7420b62d06836d, group_id=9e5d512ace634db398dc14cdc158344c, role_id=79f90a0bf6ea43d0b3c434e31556253a)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:11.712728 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0fcae-b493-49d5-8b74-4cc2caf2323f None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:11.713167 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0fcae-b493-49d5-8b74-4cc2caf2323f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:11.713664 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb24c57b-7763-4224-ba8a-ceb0f62d9d4a None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:11.726309 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c0fcae-b493-49d5-8b74-4cc2caf2323f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:11:11.734944 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-92c0fcae-b493-49d5-8b74-4cc2caf2323f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 20:11:11.734944 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:11.734944 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:11.734944 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:11.734944 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:11.734944 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:11.734944 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:11.734944 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:11.734944 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:11.734944 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:11.734944 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:11.734944 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:11.734944 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:11:11.734944 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:11:11.734944 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:11:11.734944 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:11:11.735939 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:11:11.735939 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:11:11.735939 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:11:11.735939 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:11:11.735939 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:11.735939 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:11.735939 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:11.735939 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:11.735939 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:11.735939 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:11.735939 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:11.735939 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:11:11.735939 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:11.735939 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:11.735939 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:11.735939 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:11.736730 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:11.736730 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:11.736730 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:11.736730 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:11.736730 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:11:11.736730 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:11:11.736730 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:11:11.736730 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:11:11.736730 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:11:11.736730 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:11:11.736730 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 20:11:11.736730 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:11.737929 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 206/407] 10.222.0.44 () {58 vars in 1442 bytes} [Mon May 9 20:11:11 2022] PUT /identity/v3/projects/45776741808d4cd98d7420b62d06836d/groups/9e5d512ace634db398dc14cdc158344c/roles/79f90a0bf6ea43d0b3c434e31556253a => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:11:11.737929 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb24c57b-7763-4224-ba8a-ceb0f62d9d4a None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:11.740031 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 202/408] 10.222.0.44 () {56 vars in 1096 bytes} [Mon May 9 20:11:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:11.750761 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c0fcae-b493-49d5-8b74-4cc2caf2323f None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:11.928331 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c0fcae-b493-49d5-8b74-4cc2caf2323f None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:11.959135 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb24c57b-7763-4224-ba8a-ceb0f62d9d4a None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:11.963847 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e89e03-f145-4ed7-abe6-a13e9188c83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:11.964830 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e89e03-f145-4ed7-abe6-a13e9188c83c None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:11.965302 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e89e03-f145-4ed7-abe6-a13e9188c83c None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:11.965789 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e89e03-f145-4ed7-abe6-a13e9188c83c None admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:11.966892 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e89e03-f145-4ed7-abe6-a13e9188c83c None admin] RBAC: Adding query filter params (name=admin) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:11.967406 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e89e03-f145-4ed7-abe6-a13e9188c83c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:11.970477 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e89e03-f145-4ed7-abe6-a13e9188c83c None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:11.979942 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 203/409] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 9 20:11:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:11:11.985483 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e89e03-f145-4ed7-abe6-a13e9188c83c None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:12.005630 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60310edf-3a17-4e3c-add1-01d952d9bb3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:12.007324 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60310edf-3a17-4e3c-add1-01d952d9bb3e None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:12.007855 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60310edf-3a17-4e3c-add1-01d952d9bb3e None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:12.008336 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60310edf-3a17-4e3c-add1-01d952d9bb3e None admin] PATH_INFO: `/v3/groups/9e5d512ace634db398dc14cdc158344c` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:12.011077 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60310edf-3a17-4e3c-add1-01d952d9bb3e None admin] RBAC: Authorizing `identity:get_group(group_id=9e5d512ace634db398dc14cdc158344c)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:12.013247 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60310edf-3a17-4e3c-add1-01d952d9bb3e None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:12.015662 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 207/410] 10.222.0.44 () {56 vars in 1180 bytes} [Mon May 9 20:11:11 2022] GET /identity/v3/groups/9e5d512ace634db398dc14cdc158344c => generated 226 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:12.024382 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60310edf-3a17-4e3c-add1-01d952d9bb3e None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:12.093227 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e89e03-f145-4ed7-abe6-a13e9188c83c None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:12.164874 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6024ae0b-f2b7-41ca-a6a1-a865f08dfdc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:12.166224 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6024ae0b-f2b7-41ca-a6a1-a865f08dfdc2 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:12.166885 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6024ae0b-f2b7-41ca-a6a1-a865f08dfdc2 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:12.167374 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6024ae0b-f2b7-41ca-a6a1-a865f08dfdc2 None admin] PATH_INFO: `/v3/groups/97956b19e5d4485ea0c49953ab1c3226` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:12.169078 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6024ae0b-f2b7-41ca-a6a1-a865f08dfdc2 None admin] RBAC: Authorizing `identity:get_group(group_id=97956b19e5d4485ea0c49953ab1c3226)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:12.170698 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6024ae0b-f2b7-41ca-a6a1-a865f08dfdc2 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:12.172890 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 204/411] 10.222.0.44 () {56 vars in 1180 bytes} [Mon May 9 20:11:11 2022] GET /identity/v3/groups/97956b19e5d4485ea0c49953ab1c3226 => generated 229 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:11:12.178733 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6024ae0b-f2b7-41ca-a6a1-a865f08dfdc2 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:12.180916 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60310edf-3a17-4e3c-add1-01d952d9bb3e None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:12.244339 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67980b59-ad88-48bc-b1dc-47be49353b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:12.245200 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67980b59-ad88-48bc-b1dc-47be49353b1c None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:12.245465 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67980b59-ad88-48bc-b1dc-47be49353b1c None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:12.245740 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67980b59-ad88-48bc-b1dc-47be49353b1c None admin] PATH_INFO: `/v3/projects/45776741808d4cd98d7420b62d06836d` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:12.247247 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67980b59-ad88-48bc-b1dc-47be49353b1c None admin] RBAC: Authorizing `identity:get_project(project_id=45776741808d4cd98d7420b62d06836d)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:12.248985 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67980b59-ad88-48bc-b1dc-47be49353b1c None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:12.250612 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 208/412] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 9 20:11:12 2022] GET /identity/v3/projects/45776741808d4cd98d7420b62d06836d => generated 302 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:11:12.257773 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67980b59-ad88-48bc-b1dc-47be49353b1c None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:12.297383 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6024ae0b-f2b7-41ca-a6a1-a865f08dfdc2 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:12.335694 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecc2317-e548-4282-889a-b7d2083cecb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:12.336923 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc2317-e548-4282-889a-b7d2083cecb2 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:12.337399 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc2317-e548-4282-889a-b7d2083cecb2 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:12.337863 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc2317-e548-4282-889a-b7d2083cecb2 None admin] PATH_INFO: `/v3/projects/fc21a92582474562a4faafd37e72b6be` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:12.339389 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecc2317-e548-4282-889a-b7d2083cecb2 None admin] RBAC: Authorizing `identity:get_project(project_id=fc21a92582474562a4faafd37e72b6be)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:12.341198 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecc2317-e548-4282-889a-b7d2083cecb2 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:12.343459 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 205/413] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 9 20:11:12 2022] GET /identity/v3/projects/fc21a92582474562a4faafd37e72b6be => generated 344 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:11:12.354277 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecc2317-e548-4282-889a-b7d2083cecb2 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:12.456295 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67980b59-ad88-48bc-b1dc-47be49353b1c None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:12.491422 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5957c517-e81c-4781-baf4-f783157019fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:12.493319 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5957c517-e81c-4781-baf4-f783157019fc None admin] REQUEST_METHOD: `PUT` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:12.493607 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5957c517-e81c-4781-baf4-f783157019fc None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:12.493882 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5957c517-e81c-4781-baf4-f783157019fc None admin] PATH_INFO: `/v3/projects/45776741808d4cd98d7420b62d06836d/groups/9e5d512ace634db398dc14cdc158344c/roles/52c0c2910c294965839ef51e91b156a1` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:12.496558 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5957c517-e81c-4781-baf4-f783157019fc None admin] RBAC: Authorizing `identity:create_grant(project_id=45776741808d4cd98d7420b62d06836d, group_id=9e5d512ace634db398dc14cdc158344c, role_id=52c0c2910c294965839ef51e91b156a1)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:12.498293 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5957c517-e81c-4781-baf4-f783157019fc None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:12.508347 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecc2317-e548-4282-889a-b7d2083cecb2 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:12.515777 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 209/414] 10.222.0.44 () {58 vars in 1442 bytes} [Mon May 9 20:11:12 2022] PUT /identity/v3/projects/45776741808d4cd98d7420b62d06836d/groups/9e5d512ace634db398dc14cdc158344c/roles/52c0c2910c294965839ef51e91b156a1 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:11:12.517353 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483df0ca-2bb0-47db-bb58-46b32877b618 None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:12.517700 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483df0ca-2bb0-47db-bb58-46b32877b618 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:12.518971 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483df0ca-2bb0-47db-bb58-46b32877b618 None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:12.525241 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 210/415] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:11:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:11:12.532998 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce800916-4905-4d8c-9e45-3d19e10bf3b6 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:12.533334 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce800916-4905-4d8c-9e45-3d19e10bf3b6 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:12.533555 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce800916-4905-4d8c-9e45-3d19e10bf3b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:12.554970 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc6b018-a32e-4994-953e-1d5c460b1a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:12.556394 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc6b018-a32e-4994-953e-1d5c460b1a56 None admin] REQUEST_METHOD: `PUT` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:12.556881 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc6b018-a32e-4994-953e-1d5c460b1a56 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:12.557404 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc6b018-a32e-4994-953e-1d5c460b1a56 None admin] PATH_INFO: `/v3/projects/fc21a92582474562a4faafd37e72b6be/groups/97956b19e5d4485ea0c49953ab1c3226/roles/274130b78e304bb88789c1b349263f3c` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:12.559825 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc6b018-a32e-4994-953e-1d5c460b1a56 None admin] RBAC: Authorizing `identity:create_grant(project_id=fc21a92582474562a4faafd37e72b6be, group_id=97956b19e5d4485ea0c49953ab1c3226, role_id=274130b78e304bb88789c1b349263f3c)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:12.561738 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc6b018-a32e-4994-953e-1d5c460b1a56 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:12.579713 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 206/416] 10.222.0.44 () {58 vars in 1442 bytes} [Mon May 9 20:11:12 2022] PUT /identity/v3/projects/fc21a92582474562a4faafd37e72b6be/groups/97956b19e5d4485ea0c49953ab1c3226/roles/274130b78e304bb88789c1b349263f3c => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:11:12.587509 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-ce800916-4905-4d8c-9e45-3d19e10bf3b6 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:11:12.589874 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-ce800916-4905-4d8c-9e45-3d19e10bf3b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:11:12.671972 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 211/417] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:11:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 20:11:12.697571 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc6b018-a32e-4994-953e-1d5c460b1a56 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:12.815018 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc6b018-a32e-4994-953e-1d5c460b1a56 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:12.852567 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45601348-4e1a-4854-8ab5-f2ef886ac1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:12.853743 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45601348-4e1a-4854-8ab5-f2ef886ac1cf None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:12.854251 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45601348-4e1a-4854-8ab5-f2ef886ac1cf None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:12.854777 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45601348-4e1a-4854-8ab5-f2ef886ac1cf None admin] PATH_INFO: `/v3/roles/member` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:12.868105 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45601348-4e1a-4854-8ab5-f2ef886ac1cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:11:12.876239 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-45601348-4e1a-4854-8ab5-f2ef886ac1cf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 20:11:12.876239 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:12.876239 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:12.876239 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:12.876239 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:12.876239 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:12.876239 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:12.876239 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:12.876239 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:12.876239 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:12.876239 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:12.876239 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:12.876239 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:11:12.876239 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:11:12.876239 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:11:12.876239 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:11:12.877135 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:11:12.877135 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:11:12.877135 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:11:12.877135 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:11:12.877135 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:12.877135 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:12.877135 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:12.877135 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:12.877135 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:12.877135 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:12.877135 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:12.877135 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:11:12.877135 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:12.877135 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:12.877135 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:12.877135 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:12.877971 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:12.877971 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:12.877971 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:12.877971 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:12.877971 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:11:12.877971 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:11:12.877971 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:11:12.877971 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:11:12.877971 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:11:12.877971 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:11:12.877971 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 20:11:12.877971 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:12.880948 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 207/418] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 9 20:11:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:12.887049 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce800916-4905-4d8c-9e45-3d19e10bf3b6 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:12.991535 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce800916-4905-4d8c-9e45-3d19e10bf3b6 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:13.026400 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e23040-3220-48be-9b63-c4e4bdb408c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:13.027452 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e23040-3220-48be-9b63-c4e4bdb408c1 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:13.028066 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e23040-3220-48be-9b63-c4e4bdb408c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:13.028536 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e23040-3220-48be-9b63-c4e4bdb408c1 None admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:13.029495 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e23040-3220-48be-9b63-c4e4bdb408c1 None admin] RBAC: Adding query filter params (name=member) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:13.029992 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e23040-3220-48be-9b63-c4e4bdb408c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:13.031671 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e23040-3220-48be-9b63-c4e4bdb408c1 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:13.041171 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 212/419] 10.222.0.44 () {56 vars in 1101 bytes} [Mon May 9 20:11:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:13.047065 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45601348-4e1a-4854-8ab5-f2ef886ac1cf None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:13.149880 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45601348-4e1a-4854-8ab5-f2ef886ac1cf None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:13.184568 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdd030f-8f9f-41de-a048-743f8f4d9f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:13.185597 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd030f-8f9f-41de-a048-743f8f4d9f7a None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:13.185880 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd030f-8f9f-41de-a048-743f8f4d9f7a None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:13.186160 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd030f-8f9f-41de-a048-743f8f4d9f7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:13.273402 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdd030f-8f9f-41de-a048-743f8f4d9f7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:13.274895 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdd030f-8f9f-41de-a048-743f8f4d9f7a None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:13.402803 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 208/420] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 9 20:11:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 20:11:13.408297 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e23040-3220-48be-9b63-c4e4bdb408c1 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:13.477350 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a38e0-cd0c-4f7b-a220-88e5913de345 None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:13.477667 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a38e0-cd0c-4f7b-a220-88e5913de345 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:13.477897 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a38e0-cd0c-4f7b-a220-88e5913de345 None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:13.479457 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 209/421] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:11:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 20:11:13.484430 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a347ea91-b2b7-41d5-b645-560e8114a17f None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:13.484713 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a347ea91-b2b7-41d5-b645-560e8114a17f None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:13.484987 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a347ea91-b2b7-41d5-b645-560e8114a17f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:13.511387 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-a347ea91-b2b7-41d5-b645-560e8114a17f None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:11:13.514372 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-a347ea91-b2b7-41d5-b645-560e8114a17f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:11:13.549423 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e23040-3220-48be-9b63-c4e4bdb408c1 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:13.608683 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 210/422] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:11:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 20:11:13.629622 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3c443b-dc2a-4574-a2d7-a76e74d7e244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:13.630484 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c443b-dc2a-4574-a2d7-a76e74d7e244 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:13.631016 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c443b-dc2a-4574-a2d7-a76e74d7e244 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:13.631288 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c443b-dc2a-4574-a2d7-a76e74d7e244 None admin] PATH_INFO: `/v3/projects/2019f358cc3841408e7d4693c6b8133a` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:13.632596 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3c443b-dc2a-4574-a2d7-a76e74d7e244 None admin] RBAC: Authorizing `identity:get_project(project_id=2019f358cc3841408e7d4693c6b8133a)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:13.634048 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3c443b-dc2a-4574-a2d7-a76e74d7e244 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:13.634359 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a347ea91-b2b7-41d5-b645-560e8114a17f None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:13.636018 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 213/423] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 9 20:11:13 2022] GET /identity/v3/projects/2019f358cc3841408e7d4693c6b8133a => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:13.648159 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3c443b-dc2a-4574-a2d7-a76e74d7e244 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:13.745042 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a347ea91-b2b7-41d5-b645-560e8114a17f None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:13.782373 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c27bbf9-e316-4d15-92b2-28379c6d8b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:13.783238 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c27bbf9-e316-4d15-92b2-28379c6d8b44 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:13.783590 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c27bbf9-e316-4d15-92b2-28379c6d8b44 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:13.784415 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c27bbf9-e316-4d15-92b2-28379c6d8b44 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:13.795781 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c27bbf9-e316-4d15-92b2-28379c6d8b44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:11:13.805186 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-3c27bbf9-e316-4d15-92b2-28379c6d8b44 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 20:11:13.805186 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:13.805186 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:13.805186 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:13.805186 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:13.805186 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:13.805186 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:13.805186 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:13.805186 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:13.805186 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:13.805186 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:13.805186 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:13.805186 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:11:13.805186 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:11:13.805186 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:11:13.805186 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:11:13.806116 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:11:13.806116 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:11:13.806116 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:11:13.806116 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:11:13.806116 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:13.806116 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:13.806116 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:13.806116 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:13.806116 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:13.806116 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:13.806116 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:13.806116 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:11:13.806116 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:13.806116 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:13.806116 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:13.806116 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:13.807489 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:13.807489 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:13.807489 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:13.807489 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:13.807489 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:11:13.807489 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:11:13.807489 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:11:13.807489 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:11:13.807489 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:11:13.807489 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:11:13.807489 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 20:11:13.807489 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:13.807489 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 211/424] 10.222.0.44 () {56 vars in 1114 bytes} [Mon May 9 20:11:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:13.812425 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c27bbf9-e316-4d15-92b2-28379c6d8b44 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:13.901387 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3c443b-dc2a-4574-a2d7-a76e74d7e244 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:13.925379 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c27bbf9-e316-4d15-92b2-28379c6d8b44 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:13.962460 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0254ba0-81bb-4a0a-8357-ebdde28a861e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:13.963119 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0254ba0-81bb-4a0a-8357-ebdde28a861e None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:13.963412 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0254ba0-81bb-4a0a-8357-ebdde28a861e None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:13.963694 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0254ba0-81bb-4a0a-8357-ebdde28a861e None admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:13.964447 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0254ba0-81bb-4a0a-8357-ebdde28a861e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:13.964749 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0254ba0-81bb-4a0a-8357-ebdde28a861e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:13.966112 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0254ba0-81bb-4a0a-8357-ebdde28a861e None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:13.987522 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc8eb0-a987-4aa5-b3e4-d0457d400822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:13.988560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc8eb0-a987-4aa5-b3e4-d0457d400822 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:13.988858 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc8eb0-a987-4aa5-b3e4-d0457d400822 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:13.989128 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc8eb0-a987-4aa5-b3e4-d0457d400822 None admin] PATH_INFO: `/v3/groups/9e5d512ace634db398dc14cdc158344c` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:13.990500 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bc8eb0-a987-4aa5-b3e4-d0457d400822 None admin] RBAC: Authorizing `identity:get_group(group_id=9e5d512ace634db398dc14cdc158344c)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:13.991986 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bc8eb0-a987-4aa5-b3e4-d0457d400822 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:13.993490 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 212/425] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 9 20:11:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:13.993979 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 214/426] 10.222.0.44 () {56 vars in 1180 bytes} [Mon May 9 20:11:13 2022] GET /identity/v3/groups/9e5d512ace634db398dc14cdc158344c => generated 226 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:11:13.999773 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0254ba0-81bb-4a0a-8357-ebdde28a861e None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:14.002114 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc8eb0-a987-4aa5-b3e4-d0457d400822 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:14.104848 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0254ba0-81bb-4a0a-8357-ebdde28a861e None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:14.138642 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c074c-f593-472d-a222-89b54df5be10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:14.139296 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c074c-f593-472d-a222-89b54df5be10 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:14.139612 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c074c-f593-472d-a222-89b54df5be10 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:14.139887 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c074c-f593-472d-a222-89b54df5be10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:14.140721 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2c074c-f593-472d-a222-89b54df5be10 None admin] RBAC: Adding query filter params (group.id=9e5d512ace634db398dc14cdc158344c, role.id=79f90a0bf6ea43d0b3c434e31556253a, scope.project.id=2019f358cc3841408e7d4693c6b8133a) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:14.141030 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2c074c-f593-472d-a222-89b54df5be10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:14.142534 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2c074c-f593-472d-a222-89b54df5be10 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:14.149503 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 213/427] 10.222.0.44 () {56 vars in 1376 bytes} [Mon May 9 20:11:13 2022] GET /identity/v3/role_assignments?group.id=9e5d512ace634db398dc14cdc158344c&scope.project.id=2019f358cc3841408e7d4693c6b8133a&role.id=79f90a0bf6ea43d0b3c434e31556253a => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:14.223344 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc8eb0-a987-4aa5-b3e4-d0457d400822 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:14.278776 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa05c50b-fed3-4cd7-90d1-e650f4a4a435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:14.279361 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa05c50b-fed3-4cd7-90d1-e650f4a4a435 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:14.279666 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa05c50b-fed3-4cd7-90d1-e650f4a4a435 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:14.279937 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa05c50b-fed3-4cd7-90d1-e650f4a4a435 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:14.368098 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa05c50b-fed3-4cd7-90d1-e650f4a4a435 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:14.369561 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa05c50b-fed3-4cd7-90d1-e650f4a4a435 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:14.471232 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 215/428] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 9 20:11:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 20:11:14.477671 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c074c-f593-472d-a222-89b54df5be10 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:14.591692 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c074c-f593-472d-a222-89b54df5be10 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:14.627151 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1482d775-0bcc-4c03-9fd5-93f733019b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:14.628335 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1482d775-0bcc-4c03-9fd5-93f733019b94 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:14.628679 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1482d775-0bcc-4c03-9fd5-93f733019b94 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:14.628889 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1482d775-0bcc-4c03-9fd5-93f733019b94 None admin] PATH_INFO: `/v3/projects/2019f358cc3841408e7d4693c6b8133a` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:14.630103 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1482d775-0bcc-4c03-9fd5-93f733019b94 None admin] RBAC: Authorizing `identity:get_project(project_id=2019f358cc3841408e7d4693c6b8133a)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:14.631837 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1482d775-0bcc-4c03-9fd5-93f733019b94 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:14.633549 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 214/429] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 9 20:11:14 2022] GET /identity/v3/projects/2019f358cc3841408e7d4693c6b8133a => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:14.639025 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa05c50b-fed3-4cd7-90d1-e650f4a4a435 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:14.742930 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441fafae-9e95-43f2-a8de-643c3fa04d70 None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:14.743242 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441fafae-9e95-43f2-a8de-643c3fa04d70 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:14.743514 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441fafae-9e95-43f2-a8de-643c3fa04d70 None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:14.746033 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 215/430] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:11:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 20:11:14.752818 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa05c50b-fed3-4cd7-90d1-e650f4a4a435 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:14.756509 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77494cb7-7c57-448c-b9cd-c9b5e49ac109 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:14.756802 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77494cb7-7c57-448c-b9cd-c9b5e49ac109 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:14.757081 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77494cb7-7c57-448c-b9cd-c9b5e49ac109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:14.780999 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-77494cb7-7c57-448c-b9cd-c9b5e49ac109 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:11:14.782196 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-77494cb7-7c57-448c-b9cd-c9b5e49ac109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:11:14.801444 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52125d26-d241-43b6-b019-36aefa682f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:14.802798 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52125d26-d241-43b6-b019-36aefa682f21 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:14.803259 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52125d26-d241-43b6-b019-36aefa682f21 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:14.803832 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52125d26-d241-43b6-b019-36aefa682f21 None admin] PATH_INFO: `/v3/groups/9e5d512ace634db398dc14cdc158344c` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:14.805735 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52125d26-d241-43b6-b019-36aefa682f21 None admin] RBAC: Authorizing `identity:get_group(group_id=9e5d512ace634db398dc14cdc158344c)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:14.807668 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52125d26-d241-43b6-b019-36aefa682f21 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:14.810045 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 216/431] 10.222.0.44 () {56 vars in 1180 bytes} [Mon May 9 20:11:14 2022] GET /identity/v3/groups/9e5d512ace634db398dc14cdc158344c => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:11:14.816383 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52125d26-d241-43b6-b019-36aefa682f21 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:14.875153 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 216/432] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:11:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 20:11:14.901916 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77494cb7-7c57-448c-b9cd-c9b5e49ac109 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:14.932516 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52125d26-d241-43b6-b019-36aefa682f21 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:14.968861 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750ed24d-f2fd-44f5-834d-8f6b28516e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:14.969891 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ed24d-f2fd-44f5-834d-8f6b28516e6c None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:14.970371 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ed24d-f2fd-44f5-834d-8f6b28516e6c None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:14.970838 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ed24d-f2fd-44f5-834d-8f6b28516e6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:14.972784 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750ed24d-f2fd-44f5-834d-8f6b28516e6c None admin] RBAC: Adding query filter params (group.id=9e5d512ace634db398dc14cdc158344c, role.id=52c0c2910c294965839ef51e91b156a1, scope.project.id=2019f358cc3841408e7d4693c6b8133a) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:14.973345 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750ed24d-f2fd-44f5-834d-8f6b28516e6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:14.975038 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750ed24d-f2fd-44f5-834d-8f6b28516e6c None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:14.983061 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 217/433] 10.222.0.44 () {56 vars in 1376 bytes} [Mon May 9 20:11:14 2022] GET /identity/v3/role_assignments?group.id=9e5d512ace634db398dc14cdc158344c&scope.project.id=2019f358cc3841408e7d4693c6b8133a&role.id=52c0c2910c294965839ef51e91b156a1 => generated 611 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:15.012304 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77494cb7-7c57-448c-b9cd-c9b5e49ac109 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:15.050736 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefcfab8-6fe7-4d21-a561-86e4b6fdda9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:15.051970 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefcfab8-6fe7-4d21-a561-86e4b6fdda9f None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:15.052453 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefcfab8-6fe7-4d21-a561-86e4b6fdda9f None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:15.052923 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefcfab8-6fe7-4d21-a561-86e4b6fdda9f None admin] PATH_INFO: `/v3/roles/member` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:15.066041 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefcfab8-6fe7-4d21-a561-86e4b6fdda9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:11:15.074431 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-fefcfab8-6fe7-4d21-a561-86e4b6fdda9f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 20:11:15.074431 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:15.074431 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:15.074431 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:15.074431 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:15.074431 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:15.074431 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:15.074431 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:15.074431 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:15.074431 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:15.074431 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:15.074431 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:15.074431 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:11:15.074431 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:11:15.074431 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:11:15.074431 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:11:15.075434 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:11:15.075434 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:11:15.075434 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:11:15.075434 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:11:15.075434 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:15.075434 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:15.075434 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:15.075434 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:15.075434 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:15.075434 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:15.075434 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:15.075434 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:11:15.075434 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:15.075434 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:15.075434 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:15.075434 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:15.076236 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:15.076236 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:15.076236 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:15.076236 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:15.076236 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:11:15.076236 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:11:15.076236 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:11:15.076236 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:11:15.076236 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:11:15.076236 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:11:15.076236 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 20:11:15.076236 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:15.079140 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 217/434] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 9 20:11:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 20:11:15.085633 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750ed24d-f2fd-44f5-834d-8f6b28516e6c None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:15.195595 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750ed24d-f2fd-44f5-834d-8f6b28516e6c None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:15.201872 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780355dc-03d2-4586-921f-bb7823e9d427 None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:15.202462 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780355dc-03d2-4586-921f-bb7823e9d427 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:15.202938 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780355dc-03d2-4586-921f-bb7823e9d427 None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:15.205325 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 218/435] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:11:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:11:15.212603 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604d133-f326-4ecd-9ab1-2befe6d29877 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:15.213460 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604d133-f326-4ecd-9ab1-2befe6d29877 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:15.213935 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604d133-f326-4ecd-9ab1-2befe6d29877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:15.235994 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-0604d133-f326-4ecd-9ab1-2befe6d29877 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:11:15.237637 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-0604d133-f326-4ecd-9ab1-2befe6d29877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:11:15.243633 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8226f7c-7c9e-4f24-ad02-4bc1fd4f6bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:15.244308 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8226f7c-7c9e-4f24-ad02-4bc1fd4f6bf8 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:15.244594 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8226f7c-7c9e-4f24-ad02-4bc1fd4f6bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:15.244876 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8226f7c-7c9e-4f24-ad02-4bc1fd4f6bf8 None admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:15.245610 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8226f7c-7c9e-4f24-ad02-4bc1fd4f6bf8 None admin] RBAC: Adding query filter params (name=member) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:15.246328 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8226f7c-7c9e-4f24-ad02-4bc1fd4f6bf8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:15.247300 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8226f7c-7c9e-4f24-ad02-4bc1fd4f6bf8 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:15.259683 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 218/436] 10.222.0.44 () {56 vars in 1101 bytes} [Mon May 9 20:11:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:15.265070 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8226f7c-7c9e-4f24-ad02-4bc1fd4f6bf8 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:15.314089 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 219/437] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:11:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 20:11:15.340139 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0604d133-f326-4ecd-9ab1-2befe6d29877 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:15.390101 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8226f7c-7c9e-4f24-ad02-4bc1fd4f6bf8 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:15.428065 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e906ddb-e018-4a8d-a711-f2bbee7000bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:15.428722 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e906ddb-e018-4a8d-a711-f2bbee7000bf None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:15.429006 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e906ddb-e018-4a8d-a711-f2bbee7000bf None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:15.429278 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e906ddb-e018-4a8d-a711-f2bbee7000bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:15.480175 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0604d133-f326-4ecd-9ab1-2befe6d29877 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:15.513697 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e906ddb-e018-4a8d-a711-f2bbee7000bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:15.515182 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e906ddb-e018-4a8d-a711-f2bbee7000bf None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:15.522688 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f08be5-dd62-4640-b75b-21125967b842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:15.523841 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f08be5-dd62-4640-b75b-21125967b842 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:15.524240 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f08be5-dd62-4640-b75b-21125967b842 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:15.524587 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f08be5-dd62-4640-b75b-21125967b842 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:15.538237 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f08be5-dd62-4640-b75b-21125967b842 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:11:15.546363 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-60f08be5-dd62-4640-b75b-21125967b842 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 20:11:15.546363 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:15.546363 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:15.546363 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:15.546363 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:15.546363 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:15.546363 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:15.546363 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:15.546363 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:15.546363 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:15.546363 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:15.546363 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:15.546363 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:11:15.546363 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:11:15.546363 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:11:15.546363 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:11:15.547328 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:11:15.547328 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:11:15.547328 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:11:15.547328 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:11:15.547328 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:15.547328 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:15.547328 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:15.547328 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:15.547328 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:15.547328 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:15.547328 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:15.547328 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:11:15.547328 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:15.547328 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:15.547328 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:15.547328 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:15.548156 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:15.548156 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:15.548156 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:15.548156 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:15.548156 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:11:15.548156 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:11:15.548156 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:11:15.548156 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:11:15.548156 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:11:15.548156 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:11:15.548156 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 20:11:15.548156 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:15.548156 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 220/438] 10.222.0.44 () {56 vars in 1114 bytes} [Mon May 9 20:11:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 20:11:15.548880 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d5141-5c3b-41d3-9553-1d8c2449d02a None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:15.549163 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d5141-5c3b-41d3-9553-1d8c2449d02a None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:15.549982 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d5141-5c3b-41d3-9553-1d8c2449d02a None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:15.551612 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 221/439] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:11:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:11:15.553741 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22d5141-5c3b-41d3-9553-1d8c2449d02a None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:15.622367 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 219/440] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 9 20:11:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 09 20:11:15.623665 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9cf634-e112-49e9-8854-b54a76e15c57 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:15.623949 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9cf634-e112-49e9-8854-b54a76e15c57 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:15.624219 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9cf634-e112-49e9-8854-b54a76e15c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:15.639720 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-ec9cf634-e112-49e9-8854-b54a76e15c57 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:11:15.640910 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-ec9cf634-e112-49e9-8854-b54a76e15c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:11:15.651117 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22d5141-5c3b-41d3-9553-1d8c2449d02a None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:15.682414 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058f865d-6b3d-47f0-8501-7c2c687d3eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:15.683070 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058f865d-6b3d-47f0-8501-7c2c687d3eea None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:15.683349 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058f865d-6b3d-47f0-8501-7c2c687d3eea None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:15.683649 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058f865d-6b3d-47f0-8501-7c2c687d3eea None admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:15.684383 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058f865d-6b3d-47f0-8501-7c2c687d3eea None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:15.684684 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058f865d-6b3d-47f0-8501-7c2c687d3eea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:15.686051 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058f865d-6b3d-47f0-8501-7c2c687d3eea None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:15.694381 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 222/441] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 9 20:11:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:11:15.695147 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058f865d-6b3d-47f0-8501-7c2c687d3eea None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:15.705314 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 220/442] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:11:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 20:11:15.706704 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9cf634-e112-49e9-8854-b54a76e15c57 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:15.789949 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058f865d-6b3d-47f0-8501-7c2c687d3eea None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:15.799444 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9cf634-e112-49e9-8854-b54a76e15c57 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:15.821024 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b2f6cd-5c5e-4172-8aa9-912e32387609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:15.821865 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2f6cd-5c5e-4172-8aa9-912e32387609 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:15.822144 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2f6cd-5c5e-4172-8aa9-912e32387609 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:15.822413 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2f6cd-5c5e-4172-8aa9-912e32387609 None admin] PATH_INFO: `/v3/projects/45776741808d4cd98d7420b62d06836d` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:15.823611 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b2f6cd-5c5e-4172-8aa9-912e32387609 None admin] RBAC: Authorizing `identity:get_project(project_id=45776741808d4cd98d7420b62d06836d)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:15.825025 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b2f6cd-5c5e-4172-8aa9-912e32387609 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:15.826685 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 223/443] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 9 20:11:15 2022] GET /identity/v3/projects/45776741808d4cd98d7420b62d06836d => generated 302 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:15.827462 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b2f6cd-5c5e-4172-8aa9-912e32387609 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:15.833525 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61399561-9230-4201-822c-0c51413810bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:15.834172 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61399561-9230-4201-822c-0c51413810bb None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:15.834451 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61399561-9230-4201-822c-0c51413810bb None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:15.834720 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61399561-9230-4201-822c-0c51413810bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:15.897529 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61399561-9230-4201-822c-0c51413810bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:15.898977 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61399561-9230-4201-822c-0c51413810bb None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:15.924166 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b2f6cd-5c5e-4172-8aa9-912e32387609 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:15.955047 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca1ba16-e5c1-4f6c-9866-e12ce6714179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:15.956047 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1ba16-e5c1-4f6c-9866-e12ce6714179 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:15.956326 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1ba16-e5c1-4f6c-9866-e12ce6714179 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:15.956596 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1ba16-e5c1-4f6c-9866-e12ce6714179 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:15.965951 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca1ba16-e5c1-4f6c-9866-e12ce6714179 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:11:15.973956 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-aca1ba16-e5c1-4f6c-9866-e12ce6714179 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 20:11:15.973956 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:15.973956 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:15.973956 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:15.973956 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:15.973956 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:15.973956 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:15.973956 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:15.973956 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:15.973956 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:15.973956 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:15.973956 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:15.973956 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:11:15.973956 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:11:15.973956 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:11:15.973956 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:11:15.974856 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:11:15.974856 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:11:15.974856 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:11:15.974856 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:11:15.974856 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:15.974856 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:15.974856 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:15.974856 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:15.974856 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:15.974856 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:15.974856 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:15.974856 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:11:15.974856 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:15.974856 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:15.974856 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:15.974856 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:15.975677 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:15.975677 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:15.975677 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:15.975677 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:15.975677 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:11:15.975677 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:11:15.975677 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:11:15.975677 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:11:15.975677 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:11:15.975677 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:11:15.975677 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 20:11:15.975677 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:15.975677 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 224/444] 10.222.0.44 () {56 vars in 1096 bytes} [Mon May 9 20:11:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:15.976347 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca1ba16-e5c1-4f6c-9866-e12ce6714179 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:15.995302 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 221/445] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 9 20:11:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 20:11:15.995302 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61399561-9230-4201-822c-0c51413810bb None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:16.075487 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca1ba16-e5c1-4f6c-9866-e12ce6714179 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:16.086267 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61399561-9230-4201-822c-0c51413810bb None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:16.107162 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af5d852-ede0-4261-9e9e-051c9be80c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:16.108015 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af5d852-ede0-4261-9e9e-051c9be80c3b None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:16.108287 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af5d852-ede0-4261-9e9e-051c9be80c3b None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:16.108561 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af5d852-ede0-4261-9e9e-051c9be80c3b None admin] PATH_INFO: `/v3/groups/9e5d512ace634db398dc14cdc158344c` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:16.109710 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af5d852-ede0-4261-9e9e-051c9be80c3b None admin] RBAC: Authorizing `identity:get_group(group_id=9e5d512ace634db398dc14cdc158344c)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:16.111121 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af5d852-ede0-4261-9e9e-051c9be80c3b None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:16.112746 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 225/446] 10.222.0.44 () {56 vars in 1180 bytes} [Mon May 9 20:11:15 2022] GET /identity/v3/groups/9e5d512ace634db398dc14cdc158344c => generated 226 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:16.113489 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af5d852-ede0-4261-9e9e-051c9be80c3b None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:16.117771 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec982b7f-f86d-44ef-854f-8fd79adb7852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:16.118425 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec982b7f-f86d-44ef-854f-8fd79adb7852 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:16.118704 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec982b7f-f86d-44ef-854f-8fd79adb7852 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:16.118973 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec982b7f-f86d-44ef-854f-8fd79adb7852 None admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:16.119744 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec982b7f-f86d-44ef-854f-8fd79adb7852 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:16.120047 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec982b7f-f86d-44ef-854f-8fd79adb7852 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:16.121414 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec982b7f-f86d-44ef-854f-8fd79adb7852 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:16.129205 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 222/447] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 9 20:11:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:16.129976 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec982b7f-f86d-44ef-854f-8fd79adb7852 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:16.206202 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af5d852-ede0-4261-9e9e-051c9be80c3b None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:16.222383 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec982b7f-f86d-44ef-854f-8fd79adb7852 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:16.237740 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc40d89-a667-4d02-82f0-9b4254c888c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:16.238583 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc40d89-a667-4d02-82f0-9b4254c888c0 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:16.238864 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc40d89-a667-4d02-82f0-9b4254c888c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:16.239135 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc40d89-a667-4d02-82f0-9b4254c888c0 None admin] PATH_INFO: `/v3/projects/45776741808d4cd98d7420b62d06836d` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:16.240333 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc40d89-a667-4d02-82f0-9b4254c888c0 None admin] RBAC: Authorizing `identity:get_project(project_id=45776741808d4cd98d7420b62d06836d)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:16.241764 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc40d89-a667-4d02-82f0-9b4254c888c0 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:16.243440 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 226/448] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 9 20:11:16 2022] GET /identity/v3/projects/45776741808d4cd98d7420b62d06836d => generated 302 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:16.244196 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc40d89-a667-4d02-82f0-9b4254c888c0 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:16.253865 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f37de6b-d218-431b-bb98-d800941c12ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:16.254496 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37de6b-d218-431b-bb98-d800941c12ff None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:16.254771 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37de6b-d218-431b-bb98-d800941c12ff None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:16.255039 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37de6b-d218-431b-bb98-d800941c12ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:16.256140 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f37de6b-d218-431b-bb98-d800941c12ff None admin] RBAC: Adding query filter params (group.id=9e5d512ace634db398dc14cdc158344c, role.id=79f90a0bf6ea43d0b3c434e31556253a, scope.project.id=45776741808d4cd98d7420b62d06836d) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:16.256441 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f37de6b-d218-431b-bb98-d800941c12ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:16.257864 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f37de6b-d218-431b-bb98-d800941c12ff None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:16.263339 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 223/449] 10.222.0.44 () {56 vars in 1376 bytes} [Mon May 9 20:11:16 2022] GET /identity/v3/role_assignments?group.id=9e5d512ace634db398dc14cdc158344c&scope.project.id=45776741808d4cd98d7420b62d06836d&role.id=79f90a0bf6ea43d0b3c434e31556253a => generated 611 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:16.264210 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f37de6b-d218-431b-bb98-d800941c12ff None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:16.347233 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc40d89-a667-4d02-82f0-9b4254c888c0 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:16.367117 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f37de6b-d218-431b-bb98-d800941c12ff None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:16.385173 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf521eef-b55c-4ec6-abc7-818d4edb68b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:16.385900 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf521eef-b55c-4ec6-abc7-818d4edb68b8 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:16.386172 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf521eef-b55c-4ec6-abc7-818d4edb68b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:16.386443 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf521eef-b55c-4ec6-abc7-818d4edb68b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:16.402481 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633c9569-e99f-4cdc-bb2d-0d4ea82ace11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:16.403346 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c9569-e99f-4cdc-bb2d-0d4ea82ace11 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:16.403654 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c9569-e99f-4cdc-bb2d-0d4ea82ace11 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:16.403924 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c9569-e99f-4cdc-bb2d-0d4ea82ace11 None admin] PATH_INFO: `/v3/groups/9e5d512ace634db398dc14cdc158344c` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:16.405183 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633c9569-e99f-4cdc-bb2d-0d4ea82ace11 None admin] RBAC: Authorizing `identity:get_group(group_id=9e5d512ace634db398dc14cdc158344c)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:16.406650 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633c9569-e99f-4cdc-bb2d-0d4ea82ace11 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:16.408561 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 224/450] 10.222.0.44 () {56 vars in 1180 bytes} [Mon May 9 20:11:16 2022] GET /identity/v3/groups/9e5d512ace634db398dc14cdc158344c => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:16.415198 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633c9569-e99f-4cdc-bb2d-0d4ea82ace11 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:16.459313 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf521eef-b55c-4ec6-abc7-818d4edb68b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:16.461052 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf521eef-b55c-4ec6-abc7-818d4edb68b8 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:16.524068 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633c9569-e99f-4cdc-bb2d-0d4ea82ace11 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:16.558246 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a11b08-3eff-4bd6-a0f3-e2c9ef105593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:16.558961 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a11b08-3eff-4bd6-a0f3-e2c9ef105593 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:16.559248 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a11b08-3eff-4bd6-a0f3-e2c9ef105593 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:16.559555 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a11b08-3eff-4bd6-a0f3-e2c9ef105593 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:16.560440 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a11b08-3eff-4bd6-a0f3-e2c9ef105593 None admin] RBAC: Adding query filter params (group.id=9e5d512ace634db398dc14cdc158344c, role.id=52c0c2910c294965839ef51e91b156a1, scope.project.id=45776741808d4cd98d7420b62d06836d) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:16.560748 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a11b08-3eff-4bd6-a0f3-e2c9ef105593 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:16.563066 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a11b08-3eff-4bd6-a0f3-e2c9ef105593 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:16.569855 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 225/451] 10.222.0.44 () {56 vars in 1376 bytes} [Mon May 9 20:11:16 2022] GET /identity/v3/role_assignments?group.id=9e5d512ace634db398dc14cdc158344c&scope.project.id=45776741808d4cd98d7420b62d06836d&role.id=52c0c2910c294965839ef51e91b156a1 => generated 611 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:11:16.578410 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 227/452] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 9 20:11:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 20:11:16.584401 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a11b08-3eff-4bd6-a0f3-e2c9ef105593 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:16.696183 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a11b08-3eff-4bd6-a0f3-e2c9ef105593 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:16.729625 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8e2ba0-b96a-438c-af56-3a66193fde70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:16.730495 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e2ba0-b96a-438c-af56-3a66193fde70 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:16.730776 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e2ba0-b96a-438c-af56-3a66193fde70 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:16.731048 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e2ba0-b96a-438c-af56-3a66193fde70 None admin] PATH_INFO: `/v3/projects/fc21a92582474562a4faafd37e72b6be` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:16.732295 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8e2ba0-b96a-438c-af56-3a66193fde70 None admin] RBAC: Authorizing `identity:get_project(project_id=fc21a92582474562a4faafd37e72b6be)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:16.733754 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8e2ba0-b96a-438c-af56-3a66193fde70 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:16.735747 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 226/453] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 9 20:11:16 2022] GET /identity/v3/projects/fc21a92582474562a4faafd37e72b6be => generated 344 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:16.741340 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf521eef-b55c-4ec6-abc7-818d4edb68b8 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:16.842602 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf521eef-b55c-4ec6-abc7-818d4edb68b8 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:16.875567 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd695f44-ce83-493c-bf1e-dd26e2673545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:16.876430 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd695f44-ce83-493c-bf1e-dd26e2673545 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:16.876708 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd695f44-ce83-493c-bf1e-dd26e2673545 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:16.876980 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd695f44-ce83-493c-bf1e-dd26e2673545 None admin] PATH_INFO: `/v3/groups/97956b19e5d4485ea0c49953ab1c3226` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:16.878802 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd695f44-ce83-493c-bf1e-dd26e2673545 None admin] RBAC: Authorizing `identity:get_group(group_id=97956b19e5d4485ea0c49953ab1c3226)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:16.880269 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd695f44-ce83-493c-bf1e-dd26e2673545 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:16.882146 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 228/454] 10.222.0.44 () {56 vars in 1180 bytes} [Mon May 9 20:11:16 2022] GET /identity/v3/groups/97956b19e5d4485ea0c49953ab1c3226 => generated 229 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:16.888141 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8e2ba0-b96a-438c-af56-3a66193fde70 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:16.985104 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8e2ba0-b96a-438c-af56-3a66193fde70 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:17.015857 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccab29e-94d1-4d72-a97e-2ee46da85570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:17.016489 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccab29e-94d1-4d72-a97e-2ee46da85570 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:17.016768 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccab29e-94d1-4d72-a97e-2ee46da85570 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:17.017037 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccab29e-94d1-4d72-a97e-2ee46da85570 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:17.017854 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccab29e-94d1-4d72-a97e-2ee46da85570 None admin] RBAC: Adding query filter params (group.id=97956b19e5d4485ea0c49953ab1c3226, role.id=274130b78e304bb88789c1b349263f3c, scope.project.id=fc21a92582474562a4faafd37e72b6be) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:17.018714 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccab29e-94d1-4d72-a97e-2ee46da85570 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:17.020282 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccab29e-94d1-4d72-a97e-2ee46da85570 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:17.025816 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 227/455] 10.222.0.44 () {56 vars in 1376 bytes} [Mon May 9 20:11:16 2022] GET /identity/v3/role_assignments?group.id=97956b19e5d4485ea0c49953ab1c3226&scope.project.id=fc21a92582474562a4faafd37e72b6be&role.id=274130b78e304bb88789c1b349263f3c => generated 611 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:19.696250 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afebcd71-deb8-468a-bb9f-4420f65a952b None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:19.697266 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afebcd71-deb8-468a-bb9f-4420f65a952b None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:19.697754 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afebcd71-deb8-468a-bb9f-4420f65a952b None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:19.699590 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 229/456] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:11:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:11:19.706058 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb2b0cd-77d6-468e-bf49-84b4f24c6bc4 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:19.706917 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb2b0cd-77d6-468e-bf49-84b4f24c6bc4 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:19.707412 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb2b0cd-77d6-468e-bf49-84b4f24c6bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:19.728665 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-ddb2b0cd-77d6-468e-bf49-84b4f24c6bc4 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:11:19.730183 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-ddb2b0cd-77d6-468e-bf49-84b4f24c6bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:11:19.821262 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 228/457] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:11:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 20:11:19.864404 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afebcd71-deb8-468a-bb9f-4420f65a952b None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:19.982086 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e38af82-cabf-4327-81ea-b05b847d0029 None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:19.982784 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e38af82-cabf-4327-81ea-b05b847d0029 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:19.983268 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e38af82-cabf-4327-81ea-b05b847d0029 None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:19.986391 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 229/458] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:11:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:11:19.993737 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afebcd71-deb8-468a-bb9f-4420f65a952b None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:19.994038 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456d41f-5fd8-4c6d-9367-091b59413930 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:19.994562 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456d41f-5fd8-4c6d-9367-091b59413930 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:19.995033 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456d41f-5fd8-4c6d-9367-091b59413930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:20.027118 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-c456d41f-5fd8-4c6d-9367-091b59413930 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:11:20.028351 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-c456d41f-5fd8-4c6d-9367-091b59413930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:11:20.039508 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b00a42a-406d-4700-bb1e-9d51b843e54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:20.040311 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b00a42a-406d-4700-bb1e-9d51b843e54f None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:20.040585 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b00a42a-406d-4700-bb1e-9d51b843e54f None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:20.040851 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b00a42a-406d-4700-bb1e-9d51b843e54f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:20.056140 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b00a42a-406d-4700-bb1e-9d51b843e54f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:20.057608 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b00a42a-406d-4700-bb1e-9d51b843e54f None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:20.086399 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-8b00a42a-406d-4700-bb1e-9d51b843e54f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:20.086399 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:20.086399 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:20.086399 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:20.086399 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:20.086399 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:20.086399 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:20.086399 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:20.086399 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:20.086399 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:20.086399 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:20.086399 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:20.086399 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 20:11:20.086399 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 20:11:20.086399 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 20:11:20.087342 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 20:11:20.087342 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:20.087342 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:20.087342 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:20.087342 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:20.087342 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:20.087342 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:20.087342 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:20.087342 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:11:20.087342 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:20.087342 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:20.087342 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:20.087342 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:20.087342 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:20.087342 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:20.087342 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:20.087342 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:20.088251 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 20:11:20.088251 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 20:11:20.088251 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:20.088251 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:20.089725 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 230/459] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:11:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:20.096577 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b00a42a-406d-4700-bb1e-9d51b843e54f None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:20.174640 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 230/460] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:11:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 20:11:20.220485 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c456d41f-5fd8-4c6d-9367-091b59413930 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:20.253362 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b00a42a-406d-4700-bb1e-9d51b843e54f None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:20.291805 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002c3fbd-1f8e-4f60-ba8e-df3ae53851d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:20.292469 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c3fbd-1f8e-4f60-ba8e-df3ae53851d0 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:20.292740 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c3fbd-1f8e-4f60-ba8e-df3ae53851d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:20.293058 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c3fbd-1f8e-4f60-ba8e-df3ae53851d0 None admin] PATH_INFO: `/v3/domains` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:20.294138 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002c3fbd-1f8e-4f60-ba8e-df3ae53851d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:20.294438 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002c3fbd-1f8e-4f60-ba8e-df3ae53851d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:20.297866 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002c3fbd-1f8e-4f60-ba8e-df3ae53851d0 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:20.321154 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 231/461] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 9 20:11:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:20.332790 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002c3fbd-1f8e-4f60-ba8e-df3ae53851d0 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:20.407610 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c456d41f-5fd8-4c6d-9367-091b59413930 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:20.450761 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002c3fbd-1f8e-4f60-ba8e-df3ae53851d0 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:20.453581 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c9ba5-f704-499e-bb3f-95dda19888a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:20.454649 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c9ba5-f704-499e-bb3f-95dda19888a2 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:20.455129 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c9ba5-f704-499e-bb3f-95dda19888a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:20.456317 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c9ba5-f704-499e-bb3f-95dda19888a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:20.469531 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893c9ba5-f704-499e-bb3f-95dda19888a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:20.471824 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893c9ba5-f704-499e-bb3f-95dda19888a2 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:20.484643 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeee264-0d14-4f0d-88f7-c1f9fba5a896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:20.485577 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeee264-0d14-4f0d-88f7-c1f9fba5a896 None admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:20.486043 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeee264-0d14-4f0d-88f7-c1f9fba5a896 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:20.486451 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeee264-0d14-4f0d-88f7-c1f9fba5a896 None admin] PATH_INFO: `/v3/users` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:20.487372 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeee264-0d14-4f0d-88f7-c1f9fba5a896 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:20.489192 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeee264-0d14-4f0d-88f7-c1f9fba5a896 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:20.493406 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-893c9ba5-f704-499e-bb3f-95dda19888a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:20.493406 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:20.493406 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:20.493406 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:20.493406 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:20.493406 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:20.493406 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:20.493406 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:20.493406 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:20.493406 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:20.493406 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:20.493406 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:20.493406 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 20:11:20.493406 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 20:11:20.493406 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 20:11:20.494424 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 20:11:20.494424 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:20.494424 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:20.494424 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:20.494424 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:20.494424 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:20.494424 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:20.494424 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:20.494424 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:11:20.494424 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:20.494424 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:20.494424 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:20.494424 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:20.494424 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:20.494424 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:20.494424 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:20.494424 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:20.495346 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 20:11:20.495346 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 20:11:20.495346 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:20.495346 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:11:20.500844 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 231/462] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:11:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:20.500844 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c026a30-dd30-4dd4-b835-06ccc9efe89a None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:20.500844 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c026a30-dd30-4dd4-b835-06ccc9efe89a None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:20.500844 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c026a30-dd30-4dd4-b835-06ccc9efe89a None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:20.500844 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 232/463] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:11:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:11:20.503263 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c026a30-dd30-4dd4-b835-06ccc9efe89a None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:20.525494 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 232/464] 10.222.0.44 () {60 vars in 1132 bytes} [Mon May 9 20:11:20 2022] POST /identity/v3/users => generated 246 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 20:11:20.528511 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff0bfdb-f44f-4dc7-b8c5-110e0835848a None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:20.529146 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff0bfdb-f44f-4dc7-b8c5-110e0835848a None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:20.529615 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff0bfdb-f44f-4dc7-b8c5-110e0835848a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:20.564726 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-bff0bfdb-f44f-4dc7-b8c5-110e0835848a None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:11:20.567581 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-bff0bfdb-f44f-4dc7-b8c5-110e0835848a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:11:20.717022 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c026a30-dd30-4dd4-b835-06ccc9efe89a None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:20.728787 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 233/465] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:11:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 20:11:20.745628 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b398cb3-cde3-409d-a4a2-d6e9421f919f None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:20.745918 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b398cb3-cde3-409d-a4a2-d6e9421f919f None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:20.746178 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b398cb3-cde3-409d-a4a2-d6e9421f919f None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:20.747898 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 234/466] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:11:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:11:20.755692 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b398cb3-cde3-409d-a4a2-d6e9421f919f None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:20.766892 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90209a9-718a-4941-8911-146d24a84f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:20.767610 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90209a9-718a-4941-8911-146d24a84f72 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:20.767878 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90209a9-718a-4941-8911-146d24a84f72 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:20.768674 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90209a9-718a-4941-8911-146d24a84f72 None admin] PATH_INFO: `/v3/domains` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:20.769398 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90209a9-718a-4941-8911-146d24a84f72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:20.769893 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90209a9-718a-4941-8911-146d24a84f72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:20.771545 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90209a9-718a-4941-8911-146d24a84f72 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:20.791531 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 233/467] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 9 20:11:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:20.793250 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d91ed9-dae4-4fce-8860-310d80119cef None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:20.793539 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d91ed9-dae4-4fce-8860-310d80119cef None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:20.793912 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d91ed9-dae4-4fce-8860-310d80119cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:20.812488 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-47d91ed9-dae4-4fce-8860-310d80119cef None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:11:20.813674 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-47d91ed9-dae4-4fce-8860-310d80119cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:11:20.868449 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b398cb3-cde3-409d-a4a2-d6e9421f919f None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:20.891030 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 234/468] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:11:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 20:11:20.892246 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d91ed9-dae4-4fce-8860-310d80119cef None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:20.909764 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2a6f94-7b0b-4fea-a0d9-87fdd30d96fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:20.910551 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a6f94-7b0b-4fea-a0d9-87fdd30d96fc None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:20.910826 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a6f94-7b0b-4fea-a0d9-87fdd30d96fc None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:20.911094 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a6f94-7b0b-4fea-a0d9-87fdd30d96fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:20.925482 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2a6f94-7b0b-4fea-a0d9-87fdd30d96fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:20.927069 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2a6f94-7b0b-4fea-a0d9-87fdd30d96fc None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:20.944952 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-bb2a6f94-7b0b-4fea-a0d9-87fdd30d96fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:20.944952 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:20.944952 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:20.944952 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:20.944952 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:20.944952 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:20.944952 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:20.944952 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:20.944952 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:20.944952 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:20.944952 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:20.944952 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:20.944952 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 20:11:20.944952 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 20:11:20.944952 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 20:11:20.945841 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 20:11:20.945841 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:20.945841 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:20.945841 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:20.945841 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:20.945841 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:20.945841 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:20.945841 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:20.945841 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:11:20.945841 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:20.945841 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:20.945841 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:20.945841 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:20.945841 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:20.945841 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:20.945841 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:20.945841 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:20.946681 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 20:11:20.946681 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 20:11:20.946681 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:20.946681 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:20.946681 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 235/469] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:11:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 20:11:20.947357 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2a6f94-7b0b-4fea-a0d9-87fdd30d96fc None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:21.025109 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d91ed9-dae4-4fce-8860-310d80119cef None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:21.060152 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aee166c-aa6a-409e-be72-23b3ffbc116a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:21.061157 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aee166c-aa6a-409e-be72-23b3ffbc116a None admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:21.061630 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aee166c-aa6a-409e-be72-23b3ffbc116a None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:21.062121 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aee166c-aa6a-409e-be72-23b3ffbc116a None admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:21.063000 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aee166c-aa6a-409e-be72-23b3ffbc116a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:21.064679 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aee166c-aa6a-409e-be72-23b3ffbc116a None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:21.079682 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2a6f94-7b0b-4fea-a0d9-87fdd30d96fc None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:21.091431 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 235/470] 10.222.0.44 () {60 vars in 1132 bytes} [Mon May 9 20:11:20 2022] POST /identity/v3/users => generated 248 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:11:21.091431 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aee166c-aa6a-409e-be72-23b3ffbc116a None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:21.147045 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561db2e3-45a6-4128-b82d-117a57dc129a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:21.147869 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561db2e3-45a6-4128-b82d-117a57dc129a None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:21.148150 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561db2e3-45a6-4128-b82d-117a57dc129a None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:21.148422 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561db2e3-45a6-4128-b82d-117a57dc129a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:21.168727 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561db2e3-45a6-4128-b82d-117a57dc129a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:21.170243 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561db2e3-45a6-4128-b82d-117a57dc129a None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:21.194272 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-561db2e3-45a6-4128-b82d-117a57dc129a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:21.194272 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:21.194272 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:21.194272 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:21.194272 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:21.194272 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:21.194272 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:21.194272 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:21.194272 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:21.194272 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:21.194272 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:21.194272 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:21.194272 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 20:11:21.194272 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 20:11:21.194272 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 20:11:21.195225 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 20:11:21.195225 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:21.195225 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:21.195225 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:21.195225 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:21.195225 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:21.195225 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:21.195225 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:21.195225 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:11:21.195225 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:21.195225 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:21.195225 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:21.195225 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:21.195225 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:21.195225 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:21.195225 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:21.195225 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:21.196099 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 20:11:21.196099 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 20:11:21.196099 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:21.196099 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:21.196099 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 236/471] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:11:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:21.197103 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f28c230-eb44-407c-98a7-b988cdceba20 None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:21.197205 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f28c230-eb44-407c-98a7-b988cdceba20 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:21.197410 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f28c230-eb44-407c-98a7-b988cdceba20 None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:21.202512 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 237/472] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:11:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:11:21.203693 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f28c230-eb44-407c-98a7-b988cdceba20 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:21.249321 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aee166c-aa6a-409e-be72-23b3ffbc116a None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:21.291684 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b49e9-44d6-450e-a650-1192799bff5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:21.292322 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b49e9-44d6-450e-a650-1192799bff5b None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:21.292607 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b49e9-44d6-450e-a650-1192799bff5b None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:21.292882 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b49e9-44d6-450e-a650-1192799bff5b None admin] PATH_INFO: `/v3/domains` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:21.293659 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b49e9-44d6-450e-a650-1192799bff5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:21.293920 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b49e9-44d6-450e-a650-1192799bff5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:21.295305 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b49e9-44d6-450e-a650-1192799bff5b None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:21.311421 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 236/473] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 9 20:11:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:21.312301 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c670b5-209a-432a-a9c0-116f9b1ac4ff None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:21.312593 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c670b5-209a-432a-a9c0-116f9b1ac4ff None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:21.312867 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c670b5-209a-432a-a9c0-116f9b1ac4ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:21.332389 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-23c670b5-209a-432a-a9c0-116f9b1ac4ff None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:11:21.333586 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-23c670b5-209a-432a-a9c0-116f9b1ac4ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:11:21.336122 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f28c230-eb44-407c-98a7-b988cdceba20 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:21.388727 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80de98c-f949-44d9-a219-37bb01851d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:21.389766 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80de98c-f949-44d9-a219-37bb01851d07 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:21.390051 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80de98c-f949-44d9-a219-37bb01851d07 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:21.390324 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80de98c-f949-44d9-a219-37bb01851d07 None admin] PATH_INFO: `/v3/domains` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:21.391270 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80de98c-f949-44d9-a219-37bb01851d07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:21.391624 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80de98c-f949-44d9-a219-37bb01851d07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:21.394213 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80de98c-f949-44d9-a219-37bb01851d07 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:21.410666 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 238/474] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 9 20:11:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:21.411752 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80de98c-f949-44d9-a219-37bb01851d07 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:21.419479 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 237/475] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:11:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 20:11:21.421060 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c670b5-209a-432a-a9c0-116f9b1ac4ff None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:21.528638 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80de98c-f949-44d9-a219-37bb01851d07 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:21.533732 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c670b5-209a-432a-a9c0-116f9b1ac4ff None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:21.562399 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1223598-41b0-4d8b-9deb-e650981fa01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:21.562982 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1223598-41b0-4d8b-9deb-e650981fa01c None admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:21.563263 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1223598-41b0-4d8b-9deb-e650981fa01c None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:21.563567 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1223598-41b0-4d8b-9deb-e650981fa01c None admin] PATH_INFO: `/v3/users` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:21.564265 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1223598-41b0-4d8b-9deb-e650981fa01c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:21.566108 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1223598-41b0-4d8b-9deb-e650981fa01c None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:21.579449 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a11d94-8931-46ff-bbdc-35933c9550c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:21.579449 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a11d94-8931-46ff-bbdc-35933c9550c1 None admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:21.579449 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a11d94-8931-46ff-bbdc-35933c9550c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:21.579449 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a11d94-8931-46ff-bbdc-35933c9550c1 None admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:21.579927 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a11d94-8931-46ff-bbdc-35933c9550c1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:21.579927 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a11d94-8931-46ff-bbdc-35933c9550c1 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:21.599586 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 239/476] 10.222.0.44 () {60 vars in 1132 bytes} [Mon May 9 20:11:21 2022] POST /identity/v3/users => generated 248 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:11:21.600731 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1223598-41b0-4d8b-9deb-e650981fa01c None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:21.603189 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 238/477] 10.222.0.44 () {60 vars in 1132 bytes} [Mon May 9 20:11:21 2022] POST /identity/v3/users => generated 249 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:11:21.779410 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1223598-41b0-4d8b-9deb-e650981fa01c None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:21.825869 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e026a7fd-5aa6-4494-9bd1-8f30cebfb2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:21.826469 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026a7fd-5aa6-4494-9bd1-8f30cebfb2d3 None admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:21.826747 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026a7fd-5aa6-4494-9bd1-8f30cebfb2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:21.827016 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026a7fd-5aa6-4494-9bd1-8f30cebfb2d3 None admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:21.827794 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e026a7fd-5aa6-4494-9bd1-8f30cebfb2d3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:21.829236 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e026a7fd-5aa6-4494-9bd1-8f30cebfb2d3 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:21.837710 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.sql.core [None req-e026a7fd-5aa6-4494-9bd1-8f30cebfb2d3 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 09 20:11:21.837710 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 09 20:11:21.837710 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [parameters: {'id': '24b35b7f88b94ad997b59e04d1217c62', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 09 20:11:21.837710 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79828) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 09 20:11:21.854787 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-e026a7fd-5aa6-4494-9bd1-8f30cebfb2d3 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 09 20:11:21.854787 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:21.854787 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 09 20:11:21.854787 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application self.dialect.do_execute( May 09 20:11:21.854787 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 09 20:11:21.854787 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 09 20:11:21.854787 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 09 20:11:21.854787 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application result = self._query(query) May 09 20:11:21.854787 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 09 20:11:21.854787 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application conn.query(q) May 09 20:11:21.854787 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 09 20:11:21.854787 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 09 20:11:21.854787 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 09 20:11:21.854787 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application result.read() May 09 20:11:21.854787 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 09 20:11:21.855779 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 09 20:11:21.855779 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 09 20:11:21.855779 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application packet.raise_for_error() May 09 20:11:21.855779 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 09 20:11:21.855779 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 09 20:11:21.855779 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 09 20:11:21.855779 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 09 20:11:21.855779 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 09 20:11:21.855779 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:21.855779 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 09 20:11:21.855779 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:21.855779 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:21.855779 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 09 20:11:21.855779 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 09 20:11:21.855779 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 09 20:11:21.855779 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return ref.to_dict() May 09 20:11:21.855779 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 09 20:11:21.855779 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application next(self.gen) May 09 20:11:21.856699 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 09 20:11:21.856699 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application yield resource May 09 20:11:21.856699 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 09 20:11:21.856699 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application next(self.gen) May 09 20:11:21.856699 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 09 20:11:21.856699 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application self.session.rollback() May 09 20:11:21.856699 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 09 20:11:21.856699 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application self.force_reraise() May 09 20:11:21.856699 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 09 20:11:21.856699 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise self.value May 09 20:11:21.856699 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 09 20:11:21.856699 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 09 20:11:21.856699 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 09 20:11:21.856699 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application session.commit() May 09 20:11:21.856699 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 09 20:11:21.856699 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 09 20:11:21.856699 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 09 20:11:21.857931 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application self._prepare_impl() May 09 20:11:21.857931 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 09 20:11:21.857931 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application self.session.flush() May 09 20:11:21.857931 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 09 20:11:21.857931 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application self._flush(objects) May 09 20:11:21.857931 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 09 20:11:21.857931 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 09 20:11:21.857931 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 09 20:11:21.857931 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application compat.raise_( May 09 20:11:21.857931 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 09 20:11:21.857931 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception May 09 20:11:21.857931 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 09 20:11:21.857931 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application flush_context.execute() May 09 20:11:21.857931 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 09 20:11:21.857931 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rec.execute(self) May 09 20:11:21.857931 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 09 20:11:21.857931 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 09 20:11:21.858988 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 09 20:11:21.858988 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application _emit_insert_statements( May 09 20:11:21.858988 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 09 20:11:21.858988 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application c = connection._execute_20( May 09 20:11:21.858988 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 09 20:11:21.858988 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 09 20:11:21.858988 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 09 20:11:21.858988 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 09 20:11:21.858988 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 09 20:11:21.858988 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ret = self._execute_context( May 09 20:11:21.858988 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 09 20:11:21.858988 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 09 20:11:21.858988 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 09 20:11:21.858988 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 09 20:11:21.858988 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 09 20:11:21.858988 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception May 09 20:11:21.859886 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 09 20:11:21.859886 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application self.dialect.do_execute( May 09 20:11:21.859886 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 09 20:11:21.859886 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 09 20:11:21.859886 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 09 20:11:21.859886 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application result = self._query(query) May 09 20:11:21.859886 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 09 20:11:21.859886 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application conn.query(q) May 09 20:11:21.859886 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 09 20:11:21.859886 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 09 20:11:21.859886 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 09 20:11:21.859886 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application result.read() May 09 20:11:21.859886 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 09 20:11:21.859886 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 09 20:11:21.859886 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 09 20:11:21.859886 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application packet.raise_for_error() May 09 20:11:21.861128 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 09 20:11:21.861128 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 09 20:11:21.861128 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 09 20:11:21.861128 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 09 20:11:21.861128 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 09 20:11:21.861128 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 09 20:11:21.861128 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [parameters: {'id': '24b35b7f88b94ad997b59e04d1217c62', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 09 20:11:21.861128 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 09 20:11:21.861128 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:21.861128 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 20:11:21.861128 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:21.861128 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:21.861128 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:21.861128 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:21.861128 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:21.861128 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:21.862219 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:21.862219 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:21.862219 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:21.862219 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:21.862219 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:21.862219 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:21.862219 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 09 20:11:21.862219 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 09 20:11:21.862219 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:21.862219 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:21.862219 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 09 20:11:21.862219 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 09 20:11:21.862219 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 09 20:11:21.862219 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 09 20:11:21.862219 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 09 20:11:21.862219 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:21.863388 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 240/478] 10.222.0.44 () {60 vars in 1131 bytes} [Mon May 9 20:11:21 2022] POST /identity/v3/roles => generated 144 bytes in 256 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:21.866866 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a11d94-8931-46ff-bbdc-35933c9550c1 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:21.985064 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a11d94-8931-46ff-bbdc-35933c9550c1 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:22.019884 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2a25db-20f6-438e-bcb6-c628b55ea028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:22.020698 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a25db-20f6-438e-bcb6-c628b55ea028 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:22.020977 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a25db-20f6-438e-bcb6-c628b55ea028 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:22.021249 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a25db-20f6-438e-bcb6-c628b55ea028 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:22.031734 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2a25db-20f6-438e-bcb6-c628b55ea028 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:11:22.040491 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-7d2a25db-20f6-438e-bcb6-c628b55ea028 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 20:11:22.040491 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:22.040491 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:22.040491 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:22.040491 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:22.040491 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:22.040491 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:22.040491 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:22.040491 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:22.040491 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:22.040491 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:22.040491 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:22.040491 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:11:22.040491 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:11:22.040491 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:11:22.040491 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:11:22.041560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:11:22.041560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:11:22.041560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:11:22.041560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:11:22.041560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:22.041560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:22.041560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:22.041560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:22.041560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:22.041560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:22.041560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:22.041560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:11:22.041560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:22.041560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:22.041560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:22.041560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:22.042413 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:22.042413 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:22.042413 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:22.042413 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:22.042413 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:11:22.042413 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:11:22.042413 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:11:22.042413 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:11:22.042413 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:11:22.042413 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:11:22.042413 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 20:11:22.042413 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:11:22.042413 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 239/479] 10.222.0.44 () {56 vars in 1114 bytes} [Mon May 9 20:11:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:22.047480 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e026a7fd-5aa6-4494-9bd1-8f30cebfb2d3 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:22.166908 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e026a7fd-5aa6-4494-9bd1-8f30cebfb2d3 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:22.201566 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c3cf3f-9e23-4ff6-8103-3ca0c8939293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:22.202235 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c3cf3f-9e23-4ff6-8103-3ca0c8939293 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:22.202517 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c3cf3f-9e23-4ff6-8103-3ca0c8939293 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:22.202792 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c3cf3f-9e23-4ff6-8103-3ca0c8939293 None admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:22.203584 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c3cf3f-9e23-4ff6-8103-3ca0c8939293 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:22.203893 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c3cf3f-9e23-4ff6-8103-3ca0c8939293 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:22.205263 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c3cf3f-9e23-4ff6-8103-3ca0c8939293 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:22.215625 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 241/480] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 9 20:11:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:23.243520 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9884e84c-9ad0-451c-a458-03a3627bcae2 None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:23.244258 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9884e84c-9ad0-451c-a458-03a3627bcae2 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:23.244258 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9884e84c-9ad0-451c-a458-03a3627bcae2 None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:23.245406 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 240/481] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:11:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:11:23.250966 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26037459-b397-43e8-99ed-3958c3810569 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:23.251556 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26037459-b397-43e8-99ed-3958c3810569 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:23.251556 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26037459-b397-43e8-99ed-3958c3810569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:23.276540 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-26037459-b397-43e8-99ed-3958c3810569 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:11:23.277730 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-26037459-b397-43e8-99ed-3958c3810569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:11:23.369665 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 242/482] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:11:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 20:11:23.410275 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9884e84c-9ad0-451c-a458-03a3627bcae2 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:23.536315 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9884e84c-9ad0-451c-a458-03a3627bcae2 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:23.597931 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3099e17-ca25-433f-b76b-b681968e31ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:23.598730 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3099e17-ca25-433f-b76b-b681968e31ca None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:23.599011 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3099e17-ca25-433f-b76b-b681968e31ca None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:23.599278 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3099e17-ca25-433f-b76b-b681968e31ca None admin] PATH_INFO: `/v3/roles/service` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:23.615717 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3099e17-ca25-433f-b76b-b681968e31ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:11:23.623370 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-a3099e17-ca25-433f-b76b-b681968e31ca None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 20:11:23.623370 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:23.623370 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:23.623370 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:23.623370 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:23.623370 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:23.623370 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:23.623370 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:23.623370 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:23.623370 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:23.623370 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:23.623370 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:23.623370 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:11:23.623370 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:11:23.623370 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:11:23.623370 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:11:23.624276 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:11:23.624276 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:11:23.624276 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:11:23.624276 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:11:23.624276 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:23.624276 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:23.624276 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:23.624276 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:23.624276 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:23.624276 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:23.624276 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:23.624276 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:11:23.624276 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:23.624276 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:23.624276 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:23.624276 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:23.625061 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:23.625061 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:23.625061 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:23.625061 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:23.625061 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:11:23.625061 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:11:23.625061 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:11:23.625061 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:11:23.625061 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:11:23.625061 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:11:23.625061 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 20:11:23.625061 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:11:23.625061 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 241/483] 10.222.0.44 () {56 vars in 1102 bytes} [Mon May 9 20:11:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:23.631173 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26037459-b397-43e8-99ed-3958c3810569 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:23.729024 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26037459-b397-43e8-99ed-3958c3810569 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:23.754426 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb8fac-d5ce-4bb8-9511-e2572903c331 None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:23.755066 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb8fac-d5ce-4bb8-9511-e2572903c331 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:23.755580 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb8fac-d5ce-4bb8-9511-e2572903c331 None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:23.757650 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 242/484] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:11:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:11:23.764880 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76515418-e592-48b8-afcf-3509f694953e None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:23.765408 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76515418-e592-48b8-afcf-3509f694953e None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:23.765877 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76515418-e592-48b8-afcf-3509f694953e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:23.781438 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000f0170-aeb3-41f6-a1af-26b1ffa1ed23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:23.782464 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f0170-aeb3-41f6-a1af-26b1ffa1ed23 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:23.782943 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f0170-aeb3-41f6-a1af-26b1ffa1ed23 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:23.783428 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f0170-aeb3-41f6-a1af-26b1ffa1ed23 None admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:23.784523 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000f0170-aeb3-41f6-a1af-26b1ffa1ed23 None admin] RBAC: Adding query filter params (name=service) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:23.785032 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000f0170-aeb3-41f6-a1af-26b1ffa1ed23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:23.786676 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000f0170-aeb3-41f6-a1af-26b1ffa1ed23 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:23.799776 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 243/485] 10.222.0.44 () {56 vars in 1103 bytes} [Mon May 9 20:11:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:23.800890 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-76515418-e592-48b8-afcf-3509f694953e None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:11:23.802323 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-76515418-e592-48b8-afcf-3509f694953e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:11:23.808708 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000f0170-aeb3-41f6-a1af-26b1ffa1ed23 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:23.904344 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 243/486] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:11:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 20:11:23.931347 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76515418-e592-48b8-afcf-3509f694953e None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:23.935307 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000f0170-aeb3-41f6-a1af-26b1ffa1ed23 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:23.995126 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c792db3-a26c-40b2-a8ce-35d8628a2122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:23.995946 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c792db3-a26c-40b2-a8ce-35d8628a2122 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:23.996219 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c792db3-a26c-40b2-a8ce-35d8628a2122 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:23.996481 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c792db3-a26c-40b2-a8ce-35d8628a2122 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:24.012258 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c792db3-a26c-40b2-a8ce-35d8628a2122 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:24.013731 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c792db3-a26c-40b2-a8ce-35d8628a2122 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:24.042470 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-7c792db3-a26c-40b2-a8ce-35d8628a2122 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:24.042470 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:24.042470 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:24.042470 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:24.042470 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:24.042470 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:24.042470 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:24.042470 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:24.042470 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:24.042470 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:24.042470 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:24.042470 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:24.042470 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 20:11:24.042470 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 20:11:24.042470 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 20:11:24.043344 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 20:11:24.043344 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:24.043344 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:24.043344 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:24.043344 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:24.043344 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:24.043344 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:24.043344 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:24.043344 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:11:24.043344 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:24.043344 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:24.043344 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:24.043344 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:24.043344 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:24.043344 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:24.043344 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:24.043344 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:24.044247 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 20:11:24.044247 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 20:11:24.044247 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:24.044247 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:24.047087 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 244/487] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:11:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:24.056490 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c792db3-a26c-40b2-a8ce-35d8628a2122 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:24.096960 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76515418-e592-48b8-afcf-3509f694953e None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:24.170468 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb81155-c096-44bc-b51f-4bed67cabdfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:24.171283 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb81155-c096-44bc-b51f-4bed67cabdfb None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:24.171586 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb81155-c096-44bc-b51f-4bed67cabdfb None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:24.171888 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb81155-c096-44bc-b51f-4bed67cabdfb None admin] PATH_INFO: `/v3/roles/service` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:24.175172 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c792db3-a26c-40b2-a8ce-35d8628a2122 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:24.196955 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb81155-c096-44bc-b51f-4bed67cabdfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:11:24.204569 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-cbb81155-c096-44bc-b51f-4bed67cabdfb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 20:11:24.204569 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:24.204569 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:24.204569 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:24.204569 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:24.204569 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:24.204569 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:24.204569 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:24.204569 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:24.204569 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:24.204569 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:24.204569 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:24.204569 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:11:24.204569 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:11:24.204569 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:11:24.204569 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:11:24.205556 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:11:24.205556 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:11:24.205556 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:11:24.205556 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:11:24.205556 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:24.205556 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:24.205556 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:24.205556 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:24.205556 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:24.205556 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:24.205556 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:24.205556 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:11:24.205556 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:24.205556 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:24.205556 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:24.205556 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:24.206746 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:24.206746 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:24.206746 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:24.206746 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:24.206746 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:11:24.206746 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:11:24.206746 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:11:24.206746 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:11:24.206746 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:11:24.206746 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:11:24.206746 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 20:11:24.206746 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:11:24.206746 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 244/488] 10.222.0.44 () {56 vars in 1102 bytes} [Mon May 9 20:11:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:24.215136 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb81155-c096-44bc-b51f-4bed67cabdfb None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:24.254981 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eea3a4-5bd1-40a5-a37b-2be2499a0de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:24.255706 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eea3a4-5bd1-40a5-a37b-2be2499a0de2 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:24.259420 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eea3a4-5bd1-40a5-a37b-2be2499a0de2 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:24.259420 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eea3a4-5bd1-40a5-a37b-2be2499a0de2 None admin] PATH_INFO: `/v3/domains` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:24.259420 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eea3a4-5bd1-40a5-a37b-2be2499a0de2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:24.259420 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eea3a4-5bd1-40a5-a37b-2be2499a0de2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:24.261026 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eea3a4-5bd1-40a5-a37b-2be2499a0de2 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:24.286558 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 245/489] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 9 20:11:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:24.292583 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eea3a4-5bd1-40a5-a37b-2be2499a0de2 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:24.367625 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb81155-c096-44bc-b51f-4bed67cabdfb None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:24.393762 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eea3a4-5bd1-40a5-a37b-2be2499a0de2 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:24.401493 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a7e925-9302-43c9-b3d3-5e2213e21a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:24.402161 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7e925-9302-43c9-b3d3-5e2213e21a4c None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:24.402444 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7e925-9302-43c9-b3d3-5e2213e21a4c None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:24.402719 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7e925-9302-43c9-b3d3-5e2213e21a4c None admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:24.403495 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a7e925-9302-43c9-b3d3-5e2213e21a4c None admin] RBAC: Adding query filter params (name=service) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:24.403805 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a7e925-9302-43c9-b3d3-5e2213e21a4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:24.405198 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a7e925-9302-43c9-b3d3-5e2213e21a4c None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:24.414148 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 245/490] 10.222.0.44 () {56 vars in 1103 bytes} [Mon May 9 20:11:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:24.415619 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ea50c-22de-450c-85fd-1d291c8d091d None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:24.415909 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ea50c-22de-450c-85fd-1d291c8d091d None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:24.416185 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ea50c-22de-450c-85fd-1d291c8d091d None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:24.417679 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 246/491] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:11:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:11:24.418998 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645ea50c-22de-450c-85fd-1d291c8d091d None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:24.432007 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7a74d5-5393-4964-8d8a-792452c60bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:24.432801 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a74d5-5393-4964-8d8a-792452c60bdf None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:24.433078 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a74d5-5393-4964-8d8a-792452c60bdf None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:24.433350 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a74d5-5393-4964-8d8a-792452c60bdf None admin] PATH_INFO: `/v3/users/nova` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:24.440756 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7a74d5-5393-4964-8d8a-792452c60bdf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:24.442228 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7a74d5-5393-4964-8d8a-792452c60bdf None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:24.459520 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-dc7a74d5-5393-4964-8d8a-792452c60bdf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 09 20:11:24.459520 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:24.459520 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:24.459520 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:24.459520 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:24.459520 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:24.459520 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:24.459520 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:24.459520 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:24.459520 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:24.459520 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:24.459520 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:24.459520 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 20:11:24.459520 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 20:11:24.459520 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 20:11:24.459520 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 20:11:24.460657 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:24.460657 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:24.460657 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 20:11:24.460657 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 20:11:24.460657 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 20:11:24.460657 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 20:11:24.460657 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:24.460657 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:24.460657 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:24.460657 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:24.460657 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:24.460657 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:11:24.460657 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:24.460657 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:24.460657 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:24.460657 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:24.460657 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:24.460657 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:24.461807 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:24.461807 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:24.461807 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 20:11:24.461807 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 20:11:24.461807 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 20:11:24.461807 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 20:11:24.461807 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 20:11:24.461807 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 20:11:24.461807 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 09 20:11:24.461807 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:24.461807 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 246/492] 10.222.0.44 () {56 vars in 1093 bytes} [Mon May 9 20:11:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:24.462379 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ce2b1-38cd-4726-90aa-045ac9215ea7 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:24.462723 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ce2b1-38cd-4726-90aa-045ac9215ea7 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:24.462867 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ce2b1-38cd-4726-90aa-045ac9215ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:24.489562 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-f50ce2b1-38cd-4726-90aa-045ac9215ea7 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:11:24.491286 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-f50ce2b1-38cd-4726-90aa-045ac9215ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:11:24.536536 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645ea50c-22de-450c-85fd-1d291c8d091d None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:24.572876 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f0a78-c636-4acc-aec4-c7f41f6ace30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:24.573644 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f0a78-c636-4acc-aec4-c7f41f6ace30 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:24.574026 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f0a78-c636-4acc-aec4-c7f41f6ace30 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:24.575729 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f0a78-c636-4acc-aec4-c7f41f6ace30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:24.584101 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 247/493] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:11:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 20:11:24.584101 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50ce2b1-38cd-4726-90aa-045ac9215ea7 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:24.599638 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926f0a78-c636-4acc-aec4-c7f41f6ace30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:24.601128 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926f0a78-c636-4acc-aec4-c7f41f6ace30 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:24.623513 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-926f0a78-c636-4acc-aec4-c7f41f6ace30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:24.623513 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:24.623513 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:24.623513 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:24.623513 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:24.623513 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:24.623513 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:24.623513 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:24.623513 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:24.623513 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:24.623513 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:24.623513 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:24.623513 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 20:11:24.623513 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 20:11:24.623513 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 20:11:24.624430 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 20:11:24.624430 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:24.624430 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:24.624430 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:24.624430 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:24.624430 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:24.624430 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:24.624430 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:24.624430 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:11:24.624430 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:24.624430 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:24.624430 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:24.624430 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:24.624430 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:24.624430 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:24.624430 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:24.624430 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:24.625268 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 20:11:24.625268 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 20:11:24.625268 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:24.625268 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:11:24.625268 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 247/494] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:11:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:24.626071 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f0a78-c636-4acc-aec4-c7f41f6ace30 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:24.696347 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50ce2b1-38cd-4726-90aa-045ac9215ea7 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:24.726764 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f0a78-c636-4acc-aec4-c7f41f6ace30 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:24.729036 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fdc3aa-4c90-4d1f-ab2d-70080f63d5fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:24.729749 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fdc3aa-4c90-4d1f-ab2d-70080f63d5fa None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:24.730031 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fdc3aa-4c90-4d1f-ab2d-70080f63d5fa None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:24.730301 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fdc3aa-4c90-4d1f-ab2d-70080f63d5fa None admin] PATH_INFO: `/v3/users` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:24.731136 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fdc3aa-4c90-4d1f-ab2d-70080f63d5fa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:24.731473 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fdc3aa-4c90-4d1f-ab2d-70080f63d5fa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:24.732932 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fdc3aa-4c90-4d1f-ab2d-70080f63d5fa None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:24.760927 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8783e13-0680-4101-82b9-ad35ffe4393d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:24.762033 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8783e13-0680-4101-82b9-ad35ffe4393d None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:24.762498 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8783e13-0680-4101-82b9-ad35ffe4393d None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:24.762966 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8783e13-0680-4101-82b9-ad35ffe4393d None admin] PATH_INFO: `/v3/roles/service` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:24.770386 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 248/495] 10.222.0.44 () {56 vars in 1133 bytes} [Mon May 9 20:11:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:24.771247 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fdc3aa-4c90-4d1f-ab2d-70080f63d5fa None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:24.777815 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8783e13-0680-4101-82b9-ad35ffe4393d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:11:24.786409 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-d8783e13-0680-4101-82b9-ad35ffe4393d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 20:11:24.786409 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:24.786409 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:24.786409 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:24.786409 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:24.786409 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:24.786409 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:24.786409 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:24.786409 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:24.786409 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:24.786409 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:24.786409 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:24.786409 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:11:24.786409 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:11:24.786409 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:11:24.786409 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:11:24.787323 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:11:24.787323 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:11:24.787323 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:11:24.787323 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:11:24.787323 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:24.787323 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:24.787323 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:24.787323 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:24.787323 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:24.787323 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:24.787323 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:24.787323 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:11:24.787323 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:24.787323 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:24.787323 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:24.787323 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:24.788336 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:24.788336 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:24.788336 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:24.788336 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:24.788336 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:11:24.788336 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:11:24.788336 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:11:24.788336 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:11:24.788336 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:11:24.788336 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:11:24.788336 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 20:11:24.788336 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:11:24.790366 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 248/496] 10.222.0.44 () {56 vars in 1102 bytes} [Mon May 9 20:11:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:24.791808 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c7d3e-6cc8-47b6-b766-c16fd4bd54d1 None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:24.792220 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c7d3e-6cc8-47b6-b766-c16fd4bd54d1 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:24.792619 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c7d3e-6cc8-47b6-b766-c16fd4bd54d1 None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:24.794721 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 249/497] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:11:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:11:24.795989 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79c7d3e-6cc8-47b6-b766-c16fd4bd54d1 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:24.872549 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fdc3aa-4c90-4d1f-ab2d-70080f63d5fa None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:24.907926 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ed0f7-6204-4190-b121-904ecd2073f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:24.908312 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79c7d3e-6cc8-47b6-b766-c16fd4bd54d1 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:24.908664 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ed0f7-6204-4190-b121-904ecd2073f1 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:24.908954 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ed0f7-6204-4190-b121-904ecd2073f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:24.909229 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ed0f7-6204-4190-b121-904ecd2073f1 None admin] PATH_INFO: `/v3/domains` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:24.910150 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026ed0f7-6204-4190-b121-904ecd2073f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:24.910457 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026ed0f7-6204-4190-b121-904ecd2073f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:24.911863 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026ed0f7-6204-4190-b121-904ecd2073f1 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:24.927132 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 249/498] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 9 20:11:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:24.927132 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb297758-3f6e-4880-a2d5-e239902940c5 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:24.927132 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb297758-3f6e-4880-a2d5-e239902940c5 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:24.927132 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb297758-3f6e-4880-a2d5-e239902940c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:24.941977 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-bb297758-3f6e-4880-a2d5-e239902940c5 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:11:24.943164 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-bb297758-3f6e-4880-a2d5-e239902940c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:11:24.945738 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900ca031-7583-4fc0-8ecb-ef30bd372803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:24.946383 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900ca031-7583-4fc0-8ecb-ef30bd372803 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:24.946663 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900ca031-7583-4fc0-8ecb-ef30bd372803 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:24.946936 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900ca031-7583-4fc0-8ecb-ef30bd372803 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:25.012459 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900ca031-7583-4fc0-8ecb-ef30bd372803 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:25.023467 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 250/499] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:11:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 20:11:25.023633 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900ca031-7583-4fc0-8ecb-ef30bd372803 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:25.023716 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb297758-3f6e-4880-a2d5-e239902940c5 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:25.112827 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 250/500] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 9 20:11:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 20:11:25.113827 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900ca031-7583-4fc0-8ecb-ef30bd372803 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:25.124784 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb297758-3f6e-4880-a2d5-e239902940c5 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:25.165645 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3e6dd0-b6ea-49b3-8ce3-41efa6b01485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:25.166707 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e6dd0-b6ea-49b3-8ce3-41efa6b01485 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:25.167152 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e6dd0-b6ea-49b3-8ce3-41efa6b01485 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:25.167599 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e6dd0-b6ea-49b3-8ce3-41efa6b01485 None admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:25.168347 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3e6dd0-b6ea-49b3-8ce3-41efa6b01485 None admin] RBAC: Adding query filter params (name=service) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:25.168648 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3e6dd0-b6ea-49b3-8ce3-41efa6b01485 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:25.170015 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3e6dd0-b6ea-49b3-8ce3-41efa6b01485 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:25.178497 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 251/501] 10.222.0.44 () {56 vars in 1103 bytes} [Mon May 9 20:11:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:25.179095 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3e6dd0-b6ea-49b3-8ce3-41efa6b01485 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:25.221881 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900ca031-7583-4fc0-8ecb-ef30bd372803 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:25.256419 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f71e964-5134-4e72-9bae-bb4d87cdad98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:25.257200 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f71e964-5134-4e72-9bae-bb4d87cdad98 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:25.257475 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f71e964-5134-4e72-9bae-bb4d87cdad98 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:25.257743 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f71e964-5134-4e72-9bae-bb4d87cdad98 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:25.264838 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f71e964-5134-4e72-9bae-bb4d87cdad98 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:25.266266 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f71e964-5134-4e72-9bae-bb4d87cdad98 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:25.275651 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3e6dd0-b6ea-49b3-8ce3-41efa6b01485 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:25.282494 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-7f71e964-5134-4e72-9bae-bb4d87cdad98 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 09 20:11:25.282494 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:25.282494 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:25.282494 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:25.282494 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:25.282494 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:25.282494 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:25.282494 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:25.282494 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:25.282494 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:25.282494 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:25.282494 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:25.282494 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 20:11:25.282494 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 20:11:25.282494 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 20:11:25.282494 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 20:11:25.283378 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:25.283378 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:25.283378 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 20:11:25.283378 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 20:11:25.283378 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 20:11:25.283378 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 20:11:25.283378 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:25.283378 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:25.283378 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:25.283378 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:25.283378 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:25.283378 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:11:25.283378 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:25.283378 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:25.283378 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:25.283378 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:25.283378 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:25.283378 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:25.285164 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:25.285164 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:25.285164 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 20:11:25.285164 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 20:11:25.285164 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 20:11:25.285164 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 20:11:25.285164 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 20:11:25.285164 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 20:11:25.285164 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 09 20:11:25.285164 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:11:25.285164 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 251/502] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 9 20:11:25 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:25.285164 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f71e964-5134-4e72-9bae-bb4d87cdad98 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:25.311676 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a51582-671f-4909-9b62-653340679973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:25.312457 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a51582-671f-4909-9b62-653340679973 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:25.312754 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a51582-671f-4909-9b62-653340679973 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:25.313008 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a51582-671f-4909-9b62-653340679973 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:25.322561 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a51582-671f-4909-9b62-653340679973 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:11:25.330111 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-f1a51582-671f-4909-9b62-653340679973 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 20:11:25.330111 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:25.330111 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:25.330111 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:25.330111 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:25.330111 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:25.330111 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:25.330111 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:25.330111 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:25.330111 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:25.330111 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:25.330111 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:25.330111 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:11:25.330111 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:11:25.330111 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:11:25.330111 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:11:25.331755 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:11:25.331755 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:11:25.331755 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:11:25.331755 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:11:25.331755 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:25.331755 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:25.331755 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:25.331755 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:25.331755 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:25.331755 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:25.331755 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:25.331755 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:11:25.331755 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:25.331755 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:25.331755 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:25.331755 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:25.332632 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:25.332632 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:25.332632 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:25.332632 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:25.332632 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:11:25.332632 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:11:25.332632 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:11:25.332632 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:11:25.332632 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:11:25.332632 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:11:25.332632 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 20:11:25.332632 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:25.332632 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 252/503] 10.222.0.44 () {56 vars in 1102 bytes} [Mon May 9 20:11:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:25.333412 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a51582-671f-4909-9b62-653340679973 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:25.383564 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f71e964-5134-4e72-9bae-bb4d87cdad98 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:25.415798 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421de49f-2659-4140-9862-f184ccc19f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:25.416565 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421de49f-2659-4140-9862-f184ccc19f50 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:25.416840 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421de49f-2659-4140-9862-f184ccc19f50 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:25.417108 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421de49f-2659-4140-9862-f184ccc19f50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:25.424720 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a51582-671f-4909-9b62-653340679973 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:25.426625 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421de49f-2659-4140-9862-f184ccc19f50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:25.428106 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421de49f-2659-4140-9862-f184ccc19f50 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:25.445157 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-421de49f-2659-4140-9862-f184ccc19f50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:25.445157 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:25.445157 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:25.445157 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:25.445157 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:25.445157 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:25.445157 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:25.445157 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:25.445157 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:25.445157 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:25.445157 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:25.445157 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:25.445157 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 20:11:25.445157 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 20:11:25.445157 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 20:11:25.445984 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 20:11:25.445984 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:25.445984 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:25.445984 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:25.445984 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:25.445984 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:25.445984 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:25.445984 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:25.445984 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:11:25.445984 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:25.445984 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:25.445984 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:25.445984 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:25.445984 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:25.445984 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:25.445984 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:25.445984 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:25.446845 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 20:11:25.446845 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 20:11:25.446845 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:25.446845 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:11:25.446845 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 252/504] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:11:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:25.447113 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421de49f-2659-4140-9862-f184ccc19f50 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:25.456086 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e708f59-6cf9-460b-83d1-6846c9569367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:25.456861 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e708f59-6cf9-460b-83d1-6846c9569367 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:25.457140 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e708f59-6cf9-460b-83d1-6846c9569367 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:25.457405 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e708f59-6cf9-460b-83d1-6846c9569367 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:25.468346 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e708f59-6cf9-460b-83d1-6846c9569367 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:25.469783 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e708f59-6cf9-460b-83d1-6846c9569367 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:25.487219 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-2e708f59-6cf9-460b-83d1-6846c9569367 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:25.487219 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:25.487219 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:25.487219 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:25.487219 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:25.487219 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:25.487219 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:25.487219 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:25.487219 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:25.487219 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:25.487219 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:25.487219 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:25.487219 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 20:11:25.487219 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 20:11:25.487219 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 20:11:25.488635 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 20:11:25.488635 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:25.488635 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:25.488635 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:25.488635 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:25.488635 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:25.488635 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:25.488635 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:25.488635 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:11:25.488635 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:25.488635 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:25.488635 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:25.488635 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:25.488635 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:25.488635 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:25.488635 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:25.488635 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:25.489473 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 20:11:25.489473 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 20:11:25.489473 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:25.489473 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:25.491541 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 253/505] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:11:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:25.493092 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b7bbb4-7cef-4761-ab09-22c48a1174c8 None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:25.493533 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b7bbb4-7cef-4761-ab09-22c48a1174c8 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:25.493814 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b7bbb4-7cef-4761-ab09-22c48a1174c8 None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:25.495097 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 254/506] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:11:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:11:25.495823 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b7bbb4-7cef-4761-ab09-22c48a1174c8 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:25.542017 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421de49f-2659-4140-9862-f184ccc19f50 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:25.574209 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93668da1-b1d7-4770-a0d9-d5371194c2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:25.574856 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93668da1-b1d7-4770-a0d9-d5371194c2b2 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:25.575129 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93668da1-b1d7-4770-a0d9-d5371194c2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:25.579771 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93668da1-b1d7-4770-a0d9-d5371194c2b2 None admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:25.579771 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93668da1-b1d7-4770-a0d9-d5371194c2b2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:25.579771 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93668da1-b1d7-4770-a0d9-d5371194c2b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:25.579771 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93668da1-b1d7-4770-a0d9-d5371194c2b2 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:25.593985 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b7bbb4-7cef-4761-ab09-22c48a1174c8 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:25.614000 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 253/507] 10.222.0.44 () {56 vars in 1137 bytes} [Mon May 9 20:11:25 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:25.614818 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93668da1-b1d7-4770-a0d9-d5371194c2b2 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:25.626889 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4897be0a-793c-45bb-9779-247cf685098f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:25.627597 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897be0a-793c-45bb-9779-247cf685098f None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:25.627877 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897be0a-793c-45bb-9779-247cf685098f None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:25.628149 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897be0a-793c-45bb-9779-247cf685098f None admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:25.628883 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4897be0a-793c-45bb-9779-247cf685098f None admin] RBAC: Adding query filter params (name=service) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:25.629183 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4897be0a-793c-45bb-9779-247cf685098f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:25.630540 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4897be0a-793c-45bb-9779-247cf685098f None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:25.638399 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 255/508] 10.222.0.44 () {56 vars in 1103 bytes} [Mon May 9 20:11:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:25.639105 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4897be0a-793c-45bb-9779-247cf685098f None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:25.708208 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93668da1-b1d7-4770-a0d9-d5371194c2b2 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:25.729776 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4897be0a-793c-45bb-9779-247cf685098f None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:25.740470 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e256b0-e719-4ca7-9348-c8b976673842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:25.741119 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e256b0-e719-4ca7-9348-c8b976673842 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:25.741401 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e256b0-e719-4ca7-9348-c8b976673842 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:25.741676 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e256b0-e719-4ca7-9348-c8b976673842 None admin] PATH_INFO: `/v3/domains` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:25.742419 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e256b0-e719-4ca7-9348-c8b976673842 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:25.742725 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e256b0-e719-4ca7-9348-c8b976673842 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:25.744145 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e256b0-e719-4ca7-9348-c8b976673842 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:25.755426 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 254/509] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 9 20:11:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:25.756797 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53427cd5-bb33-4b93-a4f6-fe78a04b2287 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:25.757082 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53427cd5-bb33-4b93-a4f6-fe78a04b2287 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:25.757351 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53427cd5-bb33-4b93-a4f6-fe78a04b2287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:25.761497 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be366a99-c815-4309-b3e8-4d3be2a87aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:25.762141 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be366a99-c815-4309-b3e8-4d3be2a87aea None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:25.762415 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be366a99-c815-4309-b3e8-4d3be2a87aea None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:25.762688 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be366a99-c815-4309-b3e8-4d3be2a87aea None admin] PATH_INFO: `/v3/domains` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:25.763415 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be366a99-c815-4309-b3e8-4d3be2a87aea None admin] RBAC: Adding query filter params (name=Default) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:25.763720 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be366a99-c815-4309-b3e8-4d3be2a87aea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:25.765079 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be366a99-c815-4309-b3e8-4d3be2a87aea None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:25.772883 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-53427cd5-bb33-4b93-a4f6-fe78a04b2287 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:11:25.774064 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-53427cd5-bb33-4b93-a4f6-fe78a04b2287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:11:25.776698 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 256/510] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 9 20:11:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:25.777345 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be366a99-c815-4309-b3e8-4d3be2a87aea None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:25.838130 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 255/511] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:11:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 20:11:25.838985 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53427cd5-bb33-4b93-a4f6-fe78a04b2287 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:25.870892 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be366a99-c815-4309-b3e8-4d3be2a87aea None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:25.903227 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb989242-1b66-4422-a9d1-6c7175f1a946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:25.903819 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb989242-1b66-4422-a9d1-6c7175f1a946 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:25.904100 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb989242-1b66-4422-a9d1-6c7175f1a946 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:25.904378 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb989242-1b66-4422-a9d1-6c7175f1a946 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:25.937384 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53427cd5-bb33-4b93-a4f6-fe78a04b2287 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:25.967877 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb989242-1b66-4422-a9d1-6c7175f1a946 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:25.969328 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb989242-1b66-4422-a9d1-6c7175f1a946 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:25.970563 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93c52c8-751c-4107-a6a6-bb650f367f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:25.971558 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93c52c8-751c-4107-a6a6-bb650f367f30 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:25.971867 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93c52c8-751c-4107-a6a6-bb650f367f30 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:25.972134 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93c52c8-751c-4107-a6a6-bb650f367f30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:25.981531 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93c52c8-751c-4107-a6a6-bb650f367f30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:25.982979 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93c52c8-751c-4107-a6a6-bb650f367f30 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:26.000089 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-b93c52c8-751c-4107-a6a6-bb650f367f30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:26.000089 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:26.000089 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:26.000089 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:26.000089 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:26.000089 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:26.000089 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:26.000089 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:26.000089 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:26.000089 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:26.000089 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:26.000089 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:26.000089 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 20:11:26.000089 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 20:11:26.000089 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 20:11:26.001059 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 20:11:26.001059 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:26.001059 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:26.001059 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:26.001059 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:26.001059 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:26.001059 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:26.001059 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:26.001059 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:11:26.001059 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:26.001059 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:26.001059 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:26.001059 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:26.001059 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:26.001059 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:26.001059 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:26.001059 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:26.001904 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 20:11:26.001904 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 20:11:26.001904 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:26.001904 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:11:26.004664 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 256/512] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:11:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:26.004664 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93c52c8-751c-4107-a6a6-bb650f367f30 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:26.061712 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 257/513] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 9 20:11:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 20:11:26.062579 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb989242-1b66-4422-a9d1-6c7175f1a946 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:26.097219 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93c52c8-751c-4107-a6a6-bb650f367f30 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:26.129124 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a819392-dbdf-4f1d-8d9a-a37a4a009696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:26.129890 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a819392-dbdf-4f1d-8d9a-a37a4a009696 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:26.130168 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a819392-dbdf-4f1d-8d9a-a37a4a009696 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:26.130435 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a819392-dbdf-4f1d-8d9a-a37a4a009696 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:26.137064 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a819392-dbdf-4f1d-8d9a-a37a4a009696 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:26.138493 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a819392-dbdf-4f1d-8d9a-a37a4a009696 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:26.153793 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb989242-1b66-4422-a9d1-6c7175f1a946 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:26.153992 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-9a819392-dbdf-4f1d-8d9a-a37a4a009696 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 20:11:26.153992 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:26.153992 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:26.153992 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:26.153992 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:26.153992 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:26.153992 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:26.153992 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:26.153992 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:26.153992 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:26.153992 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:26.153992 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:26.153992 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 20:11:26.153992 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 20:11:26.153992 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 20:11:26.154973 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 20:11:26.154973 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:26.154973 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:26.154973 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:26.154973 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:26.154973 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:26.154973 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:26.154973 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:26.154973 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:11:26.154973 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:26.154973 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:26.154973 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:26.154973 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:26.154973 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:26.154973 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:26.154973 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:26.154973 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:26.155986 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 20:11:26.155986 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 20:11:26.155986 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 20:11:26.155986 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 20:11:26.155986 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 20:11:26.155986 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 20:11:26.155986 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 20:11:26.155986 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:11:26.155986 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 257/514] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 9 20:11:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:26.156498 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a819392-dbdf-4f1d-8d9a-a37a4a009696 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:26.191319 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c5a04a-0118-44b4-9bc6-89124501f366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:26.192133 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c5a04a-0118-44b4-9bc6-89124501f366 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:26.192412 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c5a04a-0118-44b4-9bc6-89124501f366 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:26.192680 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c5a04a-0118-44b4-9bc6-89124501f366 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:26.199310 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c5a04a-0118-44b4-9bc6-89124501f366 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:26.200771 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c5a04a-0118-44b4-9bc6-89124501f366 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:26.214570 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-22c5a04a-0118-44b4-9bc6-89124501f366 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 09 20:11:26.214570 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:26.214570 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:26.214570 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:26.214570 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:26.214570 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:26.214570 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:26.214570 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:26.214570 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:26.214570 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:26.214570 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:26.214570 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:26.214570 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 20:11:26.214570 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 20:11:26.214570 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 20:11:26.214570 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 20:11:26.215661 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:26.215661 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:26.215661 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 20:11:26.215661 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 20:11:26.215661 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 20:11:26.215661 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 20:11:26.215661 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:26.215661 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:26.215661 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:26.215661 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:26.215661 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:26.215661 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:11:26.215661 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:26.215661 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:26.215661 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:26.215661 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:26.215661 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:26.215661 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:26.216702 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:26.216702 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:26.216702 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 20:11:26.216702 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 20:11:26.216702 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 20:11:26.216702 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 20:11:26.216702 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 20:11:26.216702 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 20:11:26.216702 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 09 20:11:26.216702 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:26.216702 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 258/515] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 9 20:11:26 2022] GET /identity/v3/users/glance => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:26.216702 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c5a04a-0118-44b4-9bc6-89124501f366 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:26.250450 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a819392-dbdf-4f1d-8d9a-a37a4a009696 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:26.282297 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e1ef54-f5c3-4aa3-935b-3a2038d2ca63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:26.283075 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1ef54-f5c3-4aa3-935b-3a2038d2ca63 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:26.283359 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1ef54-f5c3-4aa3-935b-3a2038d2ca63 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:26.284199 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1ef54-f5c3-4aa3-935b-3a2038d2ca63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:26.293699 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e1ef54-f5c3-4aa3-935b-3a2038d2ca63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:26.295157 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e1ef54-f5c3-4aa3-935b-3a2038d2ca63 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:26.307176 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c5a04a-0118-44b4-9bc6-89124501f366 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:26.312532 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-71e1ef54-f5c3-4aa3-935b-3a2038d2ca63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:26.312532 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:26.312532 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:26.312532 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:26.312532 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:26.312532 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:26.312532 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:26.312532 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:26.312532 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:26.312532 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:26.312532 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:26.312532 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:26.312532 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 20:11:26.312532 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 20:11:26.312532 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 20:11:26.313500 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 20:11:26.313500 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:26.313500 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:26.313500 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:26.313500 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:26.313500 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:26.313500 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:26.313500 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:26.313500 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:11:26.313500 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:26.313500 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:26.313500 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:26.313500 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:26.313500 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:26.313500 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:26.313500 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:26.313500 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:26.314394 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 20:11:26.314394 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 20:11:26.314394 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:26.314394 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:11:26.314394 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 258/516] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:11:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:26.314843 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e1ef54-f5c3-4aa3-935b-3a2038d2ca63 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:26.338797 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85aef80-79cc-4f81-8b44-d71cd241d555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:26.339470 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85aef80-79cc-4f81-8b44-d71cd241d555 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:26.339750 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85aef80-79cc-4f81-8b44-d71cd241d555 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:26.340016 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85aef80-79cc-4f81-8b44-d71cd241d555 None admin] PATH_INFO: `/v3/domains` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:26.340726 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85aef80-79cc-4f81-8b44-d71cd241d555 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:26.341025 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85aef80-79cc-4f81-8b44-d71cd241d555 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:26.342369 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85aef80-79cc-4f81-8b44-d71cd241d555 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:26.353339 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 259/517] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 9 20:11:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:26.354122 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85aef80-79cc-4f81-8b44-d71cd241d555 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:26.407642 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e1ef54-f5c3-4aa3-935b-3a2038d2ca63 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:26.439593 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb48ff-b66f-4fa9-91d4-768499811f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:26.440974 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb48ff-b66f-4fa9-91d4-768499811f87 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:26.441248 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb48ff-b66f-4fa9-91d4-768499811f87 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:26.441510 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb48ff-b66f-4fa9-91d4-768499811f87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:26.446832 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85aef80-79cc-4f81-8b44-d71cd241d555 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:26.450873 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cb48ff-b66f-4fa9-91d4-768499811f87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:26.452346 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cb48ff-b66f-4fa9-91d4-768499811f87 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:26.468757 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-e5cb48ff-b66f-4fa9-91d4-768499811f87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:26.468757 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:26.468757 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:26.468757 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:26.468757 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:26.468757 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:26.468757 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:26.468757 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:26.468757 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:26.468757 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:26.468757 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:26.468757 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:26.468757 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 20:11:26.468757 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 20:11:26.468757 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 20:11:26.469790 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 20:11:26.469790 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:26.469790 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:26.469790 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:26.469790 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:26.469790 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:26.469790 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:26.469790 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:26.469790 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:11:26.469790 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:26.469790 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:26.469790 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:26.469790 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:26.469790 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:26.469790 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:26.469790 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:26.469790 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:26.470825 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 20:11:26.470825 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 20:11:26.470825 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:26.470825 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:11:26.470825 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 259/518] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:11:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:26.470825 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb48ff-b66f-4fa9-91d4-768499811f87 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:26.480488 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ab0ade-299f-40a8-854f-9e1833271760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:26.481127 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab0ade-299f-40a8-854f-9e1833271760 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:26.481402 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab0ade-299f-40a8-854f-9e1833271760 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:26.481669 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab0ade-299f-40a8-854f-9e1833271760 None admin] PATH_INFO: `/v3/projects` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:26.482440 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ab0ade-299f-40a8-854f-9e1833271760 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:26.482739 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ab0ade-299f-40a8-854f-9e1833271760 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:26.484185 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ab0ade-299f-40a8-854f-9e1833271760 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:26.501138 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 260/519] 10.222.0.44 () {56 vars in 1148 bytes} [Mon May 9 20:11:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:26.501922 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ab0ade-299f-40a8-854f-9e1833271760 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:26.567293 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb48ff-b66f-4fa9-91d4-768499811f87 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:26.594970 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ab0ade-299f-40a8-854f-9e1833271760 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:26.600188 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b75da5d-0c25-4ba2-801c-f32742cdbdf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:26.600847 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75da5d-0c25-4ba2-801c-f32742cdbdf9 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:26.601124 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75da5d-0c25-4ba2-801c-f32742cdbdf9 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:26.601450 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75da5d-0c25-4ba2-801c-f32742cdbdf9 None admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:26.602277 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b75da5d-0c25-4ba2-801c-f32742cdbdf9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:26.602581 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b75da5d-0c25-4ba2-801c-f32742cdbdf9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:26.604104 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b75da5d-0c25-4ba2-801c-f32742cdbdf9 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:26.620305 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 260/520] 10.222.0.44 () {56 vars in 1137 bytes} [Mon May 9 20:11:26 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:26.621088 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b75da5d-0c25-4ba2-801c-f32742cdbdf9 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:26.627305 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf6e071-9be3-4cc4-9a90-e14b941e17a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:26.627987 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf6e071-9be3-4cc4-9a90-e14b941e17a3 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:26.628269 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf6e071-9be3-4cc4-9a90-e14b941e17a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:26.628541 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf6e071-9be3-4cc4-9a90-e14b941e17a3 None admin] PATH_INFO: `/v3/domains` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:26.629258 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf6e071-9be3-4cc4-9a90-e14b941e17a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:26.629561 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf6e071-9be3-4cc4-9a90-e14b941e17a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:26.631192 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf6e071-9be3-4cc4-9a90-e14b941e17a3 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:26.642015 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 261/521] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 9 20:11:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:26.642729 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf6e071-9be3-4cc4-9a90-e14b941e17a3 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:26.713198 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b75da5d-0c25-4ba2-801c-f32742cdbdf9 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:26.733940 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf6e071-9be3-4cc4-9a90-e14b941e17a3 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:26.744866 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e79a84e-66e8-4e35-a795-9fa2931dbe1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:26.745642 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e79a84e-66e8-4e35-a795-9fa2931dbe1f None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:26.745921 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e79a84e-66e8-4e35-a795-9fa2931dbe1f None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:26.746191 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e79a84e-66e8-4e35-a795-9fa2931dbe1f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:26.752960 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e79a84e-66e8-4e35-a795-9fa2931dbe1f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:26.754399 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e79a84e-66e8-4e35-a795-9fa2931dbe1f None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:26.765374 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2592333-e688-46a5-b748-fe4b8a99d860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:26.766011 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2592333-e688-46a5-b748-fe4b8a99d860 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:26.766291 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2592333-e688-46a5-b748-fe4b8a99d860 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:26.766561 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2592333-e688-46a5-b748-fe4b8a99d860 None admin] PATH_INFO: `/v3/domains` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:26.767298 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2592333-e688-46a5-b748-fe4b8a99d860 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:26.767629 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2592333-e688-46a5-b748-fe4b8a99d860 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:26.769722 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2592333-e688-46a5-b748-fe4b8a99d860 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:26.769924 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-4e79a84e-66e8-4e35-a795-9fa2931dbe1f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 09 20:11:26.769924 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:26.769924 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:26.769924 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:26.769924 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:26.769924 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:26.769924 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:26.769924 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:26.769924 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:26.769924 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:26.769924 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:26.769924 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:26.769924 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 20:11:26.769924 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 20:11:26.769924 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 20:11:26.769924 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 20:11:26.770902 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:26.770902 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:26.770902 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 20:11:26.770902 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 20:11:26.770902 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 20:11:26.770902 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 20:11:26.770902 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:26.770902 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:26.770902 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:26.770902 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:26.770902 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:26.770902 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:11:26.770902 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:26.770902 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:26.770902 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:26.770902 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:26.770902 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:26.770902 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:26.771839 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:26.771839 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:26.771839 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 20:11:26.771839 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 20:11:26.771839 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 20:11:26.771839 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 20:11:26.771839 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 20:11:26.771839 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 20:11:26.771839 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 09 20:11:26.771839 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:11:26.771839 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 261/522] 10.222.0.44 () {56 vars in 1102 bytes} [Mon May 9 20:11:26 2022] GET /identity/v3/users/neutron => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:26.771839 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e79a84e-66e8-4e35-a795-9fa2931dbe1f None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:26.785307 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 262/523] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 9 20:11:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:26.785307 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2592333-e688-46a5-b748-fe4b8a99d860 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:26.868006 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e79a84e-66e8-4e35-a795-9fa2931dbe1f None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:26.874429 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2592333-e688-46a5-b748-fe4b8a99d860 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:26.907333 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a05ac89-ac05-4d05-977f-f8fc27727a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:26.908000 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a05ac89-ac05-4d05-977f-f8fc27727a61 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:26.908276 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a05ac89-ac05-4d05-977f-f8fc27727a61 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:26.909106 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0125b8c-b63d-4d36-a678-a7066bf7db0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:26.909250 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a05ac89-ac05-4d05-977f-f8fc27727a61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:26.909766 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0125b8c-b63d-4d36-a678-a7066bf7db0d None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:26.910042 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0125b8c-b63d-4d36-a678-a7066bf7db0d None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:26.910314 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0125b8c-b63d-4d36-a678-a7066bf7db0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:26.911130 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0125b8c-b63d-4d36-a678-a7066bf7db0d None admin] RBAC: Adding query filter params (role.id=1ec9314b191d4bd59d71fe4d635de747, scope.project.id=563db7f5a25f480e8e6568b92ec3f195, user.id=eb59440b21074d9da15679dc2d745f72) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:26.911461 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0125b8c-b63d-4d36-a678-a7066bf7db0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:26.912893 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0125b8c-b63d-4d36-a678-a7066bf7db0d None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:26.918096 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 262/524] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 9 20:11:26 2022] GET /identity/v3/role_assignments?user.id=eb59440b21074d9da15679dc2d745f72&scope.project.id=563db7f5a25f480e8e6568b92ec3f195&role.id=1ec9314b191d4bd59d71fe4d635de747 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:26.918844 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0125b8c-b63d-4d36-a678-a7066bf7db0d None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:26.988030 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a05ac89-ac05-4d05-977f-f8fc27727a61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:26.989426 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a05ac89-ac05-4d05-977f-f8fc27727a61 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:27.028619 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0125b8c-b63d-4d36-a678-a7066bf7db0d None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:27.062333 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973203d9-4116-4a0a-971a-36d9e5f8bfc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:27.063013 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973203d9-4116-4a0a-971a-36d9e5f8bfc7 None admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:27.063290 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973203d9-4116-4a0a-971a-36d9e5f8bfc7 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:27.063591 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973203d9-4116-4a0a-971a-36d9e5f8bfc7 None admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:27.064305 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973203d9-4116-4a0a-971a-36d9e5f8bfc7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:27.066389 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973203d9-4116-4a0a-971a-36d9e5f8bfc7 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:27.095433 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 263/525] 10.222.0.44 () {60 vars in 1132 bytes} [Mon May 9 20:11:26 2022] POST /identity/v3/users => generated 247 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:11:27.095433 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973203d9-4116-4a0a-971a-36d9e5f8bfc7 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:27.112373 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 263/526] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 9 20:11:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 20:11:27.114141 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a05ac89-ac05-4d05-977f-f8fc27727a61 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:27.214602 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973203d9-4116-4a0a-971a-36d9e5f8bfc7 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:27.231041 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a05ac89-ac05-4d05-977f-f8fc27727a61 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:27.250372 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95db5c98-398a-417a-ab18-364481cddc56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:27.250972 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95db5c98-398a-417a-ab18-364481cddc56 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:27.251253 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95db5c98-398a-417a-ab18-364481cddc56 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:27.251580 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95db5c98-398a-417a-ab18-364481cddc56 None admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:27.252967 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95db5c98-398a-417a-ab18-364481cddc56 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:27.253273 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95db5c98-398a-417a-ab18-364481cddc56 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:27.254844 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95db5c98-398a-417a-ab18-364481cddc56 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:27.267994 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f231fc42-9161-4d22-afbf-3fecb074d843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:27.268837 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f231fc42-9161-4d22-afbf-3fecb074d843 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:27.269114 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f231fc42-9161-4d22-afbf-3fecb074d843 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:27.269436 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f231fc42-9161-4d22-afbf-3fecb074d843 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:27.274692 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 264/527] 10.222.0.44 () {56 vars in 1139 bytes} [Mon May 9 20:11:27 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:27.275622 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95db5c98-398a-417a-ab18-364481cddc56 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:27.277042 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f231fc42-9161-4d22-afbf-3fecb074d843 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:27.278508 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f231fc42-9161-4d22-afbf-3fecb074d843 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:27.294779 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-f231fc42-9161-4d22-afbf-3fecb074d843 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 20:11:27.294779 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:27.294779 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:27.294779 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:27.294779 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:27.294779 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:27.294779 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:27.294779 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:27.294779 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:27.294779 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:27.294779 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:27.294779 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:27.294779 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 20:11:27.294779 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 20:11:27.294779 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 20:11:27.295724 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 20:11:27.295724 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:27.295724 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:27.295724 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:27.295724 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:27.295724 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:27.295724 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:27.295724 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:27.295724 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:11:27.295724 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:27.295724 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:27.295724 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:27.295724 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:27.295724 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:27.295724 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:27.295724 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:27.295724 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:27.296602 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 20:11:27.296602 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 20:11:27.296602 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 20:11:27.296602 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 20:11:27.296602 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 20:11:27.296602 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 20:11:27.296602 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 20:11:27.296602 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:27.296602 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 264/528] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 9 20:11:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:27.297607 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f231fc42-9161-4d22-afbf-3fecb074d843 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:27.374861 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95db5c98-398a-417a-ab18-364481cddc56 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:27.401302 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f231fc42-9161-4d22-afbf-3fecb074d843 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:27.410108 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c048c91-112e-450a-b2e3-7b49d5a78203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:27.411538 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c048c91-112e-450a-b2e3-7b49d5a78203 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:27.412033 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c048c91-112e-450a-b2e3-7b49d5a78203 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:27.412490 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c048c91-112e-450a-b2e3-7b49d5a78203 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:27.422696 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c048c91-112e-450a-b2e3-7b49d5a78203 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:27.425095 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c048c91-112e-450a-b2e3-7b49d5a78203 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:27.436484 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c33b64f-37e6-4eda-8c0e-f3738ea34d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:27.437134 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c33b64f-37e6-4eda-8c0e-f3738ea34d8a None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:27.437417 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c33b64f-37e6-4eda-8c0e-f3738ea34d8a None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:27.437688 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c33b64f-37e6-4eda-8c0e-f3738ea34d8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:27.444872 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-9c048c91-112e-450a-b2e3-7b49d5a78203 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:27.444872 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:27.444872 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:27.444872 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:27.444872 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:27.444872 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:27.444872 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:27.444872 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:27.444872 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:27.444872 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:27.444872 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:27.444872 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:27.444872 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 20:11:27.444872 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 20:11:27.444872 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 20:11:27.445716 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 20:11:27.445716 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:27.445716 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:27.445716 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:27.445716 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:27.445716 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:27.445716 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:27.445716 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:27.445716 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:11:27.445716 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:27.445716 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:27.445716 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:27.445716 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:27.445716 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:27.445716 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:27.445716 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:27.445716 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:27.446563 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 20:11:27.446563 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 20:11:27.446563 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:27.446563 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:11:27.449984 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 265/529] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:11:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:27.449984 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c048c91-112e-450a-b2e3-7b49d5a78203 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:27.508086 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c33b64f-37e6-4eda-8c0e-f3738ea34d8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:27.509479 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c33b64f-37e6-4eda-8c0e-f3738ea34d8a None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:27.550090 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c048c91-112e-450a-b2e3-7b49d5a78203 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:27.585872 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108b6e19-97fe-43c9-a7e3-dab830968dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:27.586696 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b6e19-97fe-43c9-a7e3-dab830968dd5 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:27.587114 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b6e19-97fe-43c9-a7e3-dab830968dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:27.587565 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b6e19-97fe-43c9-a7e3-dab830968dd5 None admin] PATH_INFO: `/v3/projects` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:27.588502 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108b6e19-97fe-43c9-a7e3-dab830968dd5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:27.588961 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108b6e19-97fe-43c9-a7e3-dab830968dd5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:27.590537 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108b6e19-97fe-43c9-a7e3-dab830968dd5 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:27.613977 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 266/530] 10.222.0.44 () {56 vars in 1148 bytes} [Mon May 9 20:11:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:27.615110 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108b6e19-97fe-43c9-a7e3-dab830968dd5 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:27.616505 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 265/531] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 9 20:11:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 20:11:27.617390 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c33b64f-37e6-4eda-8c0e-f3738ea34d8a None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:27.715275 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108b6e19-97fe-43c9-a7e3-dab830968dd5 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:27.716282 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c33b64f-37e6-4eda-8c0e-f3738ea34d8a None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:27.751113 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c8f4c2-3aad-4951-b233-fcf78410c0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:27.751810 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8f4c2-3aad-4951-b233-fcf78410c0bf None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:27.752682 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8f4c2-3aad-4951-b233-fcf78410c0bf None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:27.752961 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8f4c2-3aad-4951-b233-fcf78410c0bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:27.753796 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c8f4c2-3aad-4951-b233-fcf78410c0bf None admin] RBAC: Adding query filter params (role.id=1ec9314b191d4bd59d71fe4d635de747, scope.project.id=563db7f5a25f480e8e6568b92ec3f195, user.id=9d65e731386d44948dcc1ecd40cbda65) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:27.754110 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c8f4c2-3aad-4951-b233-fcf78410c0bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:27.755159 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c42a294-b27e-4da1-8c34-3ecf54901da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:27.755585 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c8f4c2-3aad-4951-b233-fcf78410c0bf None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:27.756217 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c42a294-b27e-4da1-8c34-3ecf54901da8 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:27.756497 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c42a294-b27e-4da1-8c34-3ecf54901da8 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:27.756769 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c42a294-b27e-4da1-8c34-3ecf54901da8 None admin] PATH_INFO: `/v3/domains` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:27.757487 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c42a294-b27e-4da1-8c34-3ecf54901da8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:27.757795 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c42a294-b27e-4da1-8c34-3ecf54901da8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:27.759266 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c42a294-b27e-4da1-8c34-3ecf54901da8 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:27.762422 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 266/532] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 9 20:11:27 2022] GET /identity/v3/role_assignments?user.id=9d65e731386d44948dcc1ecd40cbda65&scope.project.id=563db7f5a25f480e8e6568b92ec3f195&role.id=1ec9314b191d4bd59d71fe4d635de747 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:27.763269 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c8f4c2-3aad-4951-b233-fcf78410c0bf None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:27.772881 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 267/533] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 9 20:11:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:27.781022 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c42a294-b27e-4da1-8c34-3ecf54901da8 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:27.913977 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c42a294-b27e-4da1-8c34-3ecf54901da8 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:27.956627 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d790b4d-1c9f-4dbc-931e-064b17c64f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:27.957437 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d790b4d-1c9f-4dbc-931e-064b17c64f8c None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:27.957719 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d790b4d-1c9f-4dbc-931e-064b17c64f8c None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:27.957994 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d790b4d-1c9f-4dbc-931e-064b17c64f8c None admin] PATH_INFO: `/v3/projects/service` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:27.968246 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d790b4d-1c9f-4dbc-931e-064b17c64f8c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:27.971530 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d790b4d-1c9f-4dbc-931e-064b17c64f8c None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:27.997948 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c8f4c2-3aad-4951-b233-fcf78410c0bf None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:28.004133 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-6d790b4d-1c9f-4dbc-931e-064b17c64f8c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 20:11:28.004133 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:28.004133 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:28.004133 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:28.004133 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:28.004133 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:28.004133 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:28.004133 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:28.004133 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:28.004133 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:28.004133 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:28.004133 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:28.004133 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 20:11:28.004133 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 20:11:28.004133 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 20:11:28.004977 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 20:11:28.004977 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:28.004977 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:28.004977 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:28.004977 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:28.004977 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:28.004977 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:28.004977 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:28.004977 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:11:28.004977 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:28.004977 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:28.004977 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:28.004977 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:28.004977 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:28.004977 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:28.004977 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:28.004977 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:28.006160 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 20:11:28.006160 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 20:11:28.006160 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 20:11:28.006160 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 20:11:28.006160 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 20:11:28.006160 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 20:11:28.006160 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 20:11:28.006160 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:11:28.011241 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 268/534] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 9 20:11:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:28.014082 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d790b4d-1c9f-4dbc-931e-064b17c64f8c None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:28.065726 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c7c70d-bd13-4e77-97ed-0bf0e82a34b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:28.066533 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c7c70d-bd13-4e77-97ed-0bf0e82a34b7 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:28.066813 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c7c70d-bd13-4e77-97ed-0bf0e82a34b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:28.067086 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c7c70d-bd13-4e77-97ed-0bf0e82a34b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:28.089512 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c7c70d-bd13-4e77-97ed-0bf0e82a34b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:28.090971 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c7c70d-bd13-4e77-97ed-0bf0e82a34b7 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:28.119432 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-64c7c70d-bd13-4e77-97ed-0bf0e82a34b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:28.119432 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:28.119432 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:28.119432 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:28.119432 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:28.119432 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:28.119432 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:28.119432 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:28.119432 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:28.119432 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:28.119432 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:28.119432 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:28.119432 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 20:11:28.119432 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 20:11:28.119432 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 20:11:28.121248 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 20:11:28.121248 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:28.121248 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:28.121248 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:28.121248 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:28.121248 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:28.121248 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:28.121248 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:28.121248 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:11:28.121248 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:28.121248 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:28.121248 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:28.121248 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:28.121248 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:28.121248 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:28.121248 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:28.121248 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:28.122247 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 20:11:28.122247 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 20:11:28.122247 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:28.122247 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:28.122247 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 267/535] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:11:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:28.122581 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d790b4d-1c9f-4dbc-931e-064b17c64f8c None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:28.132449 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c7c70d-bd13-4e77-97ed-0bf0e82a34b7 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:28.157887 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68010987-b64e-4746-b6b7-4eaa466acfe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:28.158631 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68010987-b64e-4746-b6b7-4eaa466acfe4 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:28.158914 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68010987-b64e-4746-b6b7-4eaa466acfe4 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:28.159223 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68010987-b64e-4746-b6b7-4eaa466acfe4 None admin] PATH_INFO: `/v3/projects` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:28.160035 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68010987-b64e-4746-b6b7-4eaa466acfe4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:28.160345 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68010987-b64e-4746-b6b7-4eaa466acfe4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:28.161872 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68010987-b64e-4746-b6b7-4eaa466acfe4 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:28.174719 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 269/536] 10.222.0.44 () {56 vars in 1148 bytes} [Mon May 9 20:11:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:28.184358 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68010987-b64e-4746-b6b7-4eaa466acfe4 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:28.249732 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c7c70d-bd13-4e77-97ed-0bf0e82a34b7 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:28.308860 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68010987-b64e-4746-b6b7-4eaa466acfe4 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:28.312109 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d982be75-6686-48c2-916e-97aa92f100b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:28.312845 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d982be75-6686-48c2-916e-97aa92f100b5 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:28.313180 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d982be75-6686-48c2-916e-97aa92f100b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:28.313548 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d982be75-6686-48c2-916e-97aa92f100b5 None admin] PATH_INFO: `/v3/domains` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:28.314289 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d982be75-6686-48c2-916e-97aa92f100b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:28.314596 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d982be75-6686-48c2-916e-97aa92f100b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:28.316680 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d982be75-6686-48c2-916e-97aa92f100b5 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:28.343925 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 268/537] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 9 20:11:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:28.350757 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d982be75-6686-48c2-916e-97aa92f100b5 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:28.351444 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b9f05a-e8ad-4614-b71c-245f10160e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:28.352107 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b9f05a-e8ad-4614-b71c-245f10160e80 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:28.352385 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b9f05a-e8ad-4614-b71c-245f10160e80 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:28.352651 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b9f05a-e8ad-4614-b71c-245f10160e80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:28.353579 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b9f05a-e8ad-4614-b71c-245f10160e80 None admin] RBAC: Adding query filter params (role.id=1ec9314b191d4bd59d71fe4d635de747, scope.project.id=563db7f5a25f480e8e6568b92ec3f195, user.id=65db5d9a86fd48acb5874df0165c0ef9) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:28.353882 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b9f05a-e8ad-4614-b71c-245f10160e80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:28.355331 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b9f05a-e8ad-4614-b71c-245f10160e80 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:28.363527 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 270/538] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 9 20:11:28 2022] GET /identity/v3/role_assignments?user.id=65db5d9a86fd48acb5874df0165c0ef9&scope.project.id=563db7f5a25f480e8e6568b92ec3f195&role.id=1ec9314b191d4bd59d71fe4d635de747 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:28.518378 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d982be75-6686-48c2-916e-97aa92f100b5 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:28.555604 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0f76be-0908-4daa-8c37-ed8a650211e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:28.556904 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f76be-0908-4daa-8c37-ed8a650211e1 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:28.557388 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f76be-0908-4daa-8c37-ed8a650211e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:28.557846 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f76be-0908-4daa-8c37-ed8a650211e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:28.566285 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0f76be-0908-4daa-8c37-ed8a650211e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:28.568080 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0f76be-0908-4daa-8c37-ed8a650211e1 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:28.583027 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-af0f76be-0908-4daa-8c37-ed8a650211e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 20:11:28.583027 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:28.583027 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:28.583027 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:28.583027 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:28.583027 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:28.583027 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:28.583027 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:28.583027 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:28.583027 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:28.583027 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:28.583027 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:28.583027 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 20:11:28.583027 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 20:11:28.583027 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 20:11:28.583879 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 20:11:28.583879 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:28.583879 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:28.583879 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:28.583879 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:28.583879 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:28.583879 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:28.583879 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:28.583879 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:11:28.583879 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:28.583879 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:28.583879 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:28.583879 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:28.583879 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:28.583879 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:28.583879 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:28.583879 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:28.584713 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 20:11:28.584713 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 20:11:28.584713 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 20:11:28.584713 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 20:11:28.584713 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 20:11:28.584713 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 20:11:28.584713 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 20:11:28.584713 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:28.584713 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 269/539] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 9 20:11:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 20:11:28.590807 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b9f05a-e8ad-4614-b71c-245f10160e80 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:28.705894 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b9f05a-e8ad-4614-b71c-245f10160e80 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:28.746741 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055c38a1-b4b0-4bc0-a53d-b0bf280b7f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:28.747686 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c38a1-b4b0-4bc0-a53d-b0bf280b7f07 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:28.748129 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c38a1-b4b0-4bc0-a53d-b0bf280b7f07 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:28.748539 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c38a1-b4b0-4bc0-a53d-b0bf280b7f07 None admin] PATH_INFO: `/v3/projects` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:28.749464 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055c38a1-b4b0-4bc0-a53d-b0bf280b7f07 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:28.749907 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055c38a1-b4b0-4bc0-a53d-b0bf280b7f07 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:28.751515 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055c38a1-b4b0-4bc0-a53d-b0bf280b7f07 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:28.768339 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 271/540] 10.222.0.44 () {56 vars in 1148 bytes} [Mon May 9 20:11:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:28.774370 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0f76be-0908-4daa-8c37-ed8a650211e1 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:28.923013 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0f76be-0908-4daa-8c37-ed8a650211e1 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:28.964033 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88c9694-4872-4dcf-8b45-31bb16d8f0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:28.964685 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c9694-4872-4dcf-8b45-31bb16d8f0c1 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:28.964961 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c9694-4872-4dcf-8b45-31bb16d8f0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:28.965230 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c9694-4872-4dcf-8b45-31bb16d8f0c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:28.966048 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88c9694-4872-4dcf-8b45-31bb16d8f0c1 None admin] RBAC: Adding query filter params (role.id=1ec9314b191d4bd59d71fe4d635de747, scope.project.id=563db7f5a25f480e8e6568b92ec3f195, user.id=b2a13ad25f27471792ba0758602b6e63) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:28.966352 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88c9694-4872-4dcf-8b45-31bb16d8f0c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:28.967808 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88c9694-4872-4dcf-8b45-31bb16d8f0c1 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:28.976363 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 270/541] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 9 20:11:28 2022] GET /identity/v3/role_assignments?user.id=b2a13ad25f27471792ba0758602b6e63&scope.project.id=563db7f5a25f480e8e6568b92ec3f195&role.id=1ec9314b191d4bd59d71fe4d635de747 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:29.429071 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603360c9-3455-4101-8189-7bcd3c363abd None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:29.429761 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603360c9-3455-4101-8189-7bcd3c363abd None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:29.430254 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603360c9-3455-4101-8189-7bcd3c363abd None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:29.432103 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 272/542] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:11:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:11:29.445432 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d75cb-1962-4022-9d28-5434c40d09d9 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:29.445992 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d75cb-1962-4022-9d28-5434c40d09d9 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:29.446459 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d75cb-1962-4022-9d28-5434c40d09d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:29.468363 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-c03d75cb-1962-4022-9d28-5434c40d09d9 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:11:29.469891 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-c03d75cb-1962-4022-9d28-5434c40d09d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:11:29.552333 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 271/543] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:11:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 20:11:29.592122 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603360c9-3455-4101-8189-7bcd3c363abd None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:29.721566 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603360c9-3455-4101-8189-7bcd3c363abd None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:29.763359 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3812b397-6ed2-41de-a092-7358e41afef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:29.764490 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3812b397-6ed2-41de-a092-7358e41afef0 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:29.764943 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3812b397-6ed2-41de-a092-7358e41afef0 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:29.765400 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3812b397-6ed2-41de-a092-7358e41afef0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:29.776242 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3812b397-6ed2-41de-a092-7358e41afef0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:11:29.788239 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-3812b397-6ed2-41de-a092-7358e41afef0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 20:11:29.788239 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:29.788239 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:29.788239 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:29.788239 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:29.788239 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:29.788239 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:29.788239 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:29.788239 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:29.788239 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:29.788239 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:29.788239 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:29.788239 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:11:29.788239 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:11:29.788239 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:11:29.788239 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:11:29.789136 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:11:29.789136 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:11:29.789136 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:11:29.789136 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:11:29.789136 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:29.789136 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:29.789136 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:29.789136 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:29.789136 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:29.789136 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:29.789136 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:29.789136 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:11:29.789136 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:29.789136 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:29.789136 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:29.789136 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:29.789933 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:29.789933 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:29.789933 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:29.789933 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:29.789933 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:11:29.789933 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:11:29.789933 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:11:29.789933 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:11:29.789933 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:11:29.789933 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:11:29.789933 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 20:11:29.789933 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:11:29.792304 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 273/544] 10.222.0.44 () {56 vars in 1102 bytes} [Mon May 9 20:11:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:29.798612 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03d75cb-1962-4022-9d28-5434c40d09d9 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:29.816861 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68457206-077c-492b-b5f4-38e04787e348 None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:29.817357 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68457206-077c-492b-b5f4-38e04787e348 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:29.817784 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68457206-077c-492b-b5f4-38e04787e348 None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:29.819554 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 274/545] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:11:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:11:29.824684 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c21ac-0515-4e40-805d-32969d3c7647 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:29.825156 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c21ac-0515-4e40-805d-32969d3c7647 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:29.825610 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c21ac-0515-4e40-805d-32969d3c7647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:29.842615 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-fd1c21ac-0515-4e40-805d-32969d3c7647 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:11:29.844078 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-fd1c21ac-0515-4e40-805d-32969d3c7647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:11:29.911274 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 275/546] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:11:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 20:11:29.940139 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1c21ac-0515-4e40-805d-32969d3c7647 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:29.999150 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03d75cb-1962-4022-9d28-5434c40d09d9 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:30.047727 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1c21ac-0515-4e40-805d-32969d3c7647 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:30.082099 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf724577-0ba9-4b56-9c62-f6af45a7ac8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:30.082771 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf724577-0ba9-4b56-9c62-f6af45a7ac8b None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:30.083045 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf724577-0ba9-4b56-9c62-f6af45a7ac8b None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:30.083311 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf724577-0ba9-4b56-9c62-f6af45a7ac8b None admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:30.084086 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf724577-0ba9-4b56-9c62-f6af45a7ac8b None admin] RBAC: Adding query filter params (name=service) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:30.084388 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf724577-0ba9-4b56-9c62-f6af45a7ac8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:30.085756 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf724577-0ba9-4b56-9c62-f6af45a7ac8b None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:30.103910 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fedbd7-85df-4cb4-af47-920114e8140c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:30.104691 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fedbd7-85df-4cb4-af47-920114e8140c None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:30.104963 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fedbd7-85df-4cb4-af47-920114e8140c None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:30.105231 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fedbd7-85df-4cb4-af47-920114e8140c None admin] PATH_INFO: `/v3/roles/service` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:30.106123 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 272/547] 10.222.0.44 () {56 vars in 1103 bytes} [Mon May 9 20:11:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:30.108857 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf724577-0ba9-4b56-9c62-f6af45a7ac8b None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:30.129438 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fedbd7-85df-4cb4-af47-920114e8140c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:11:30.143703 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-36fedbd7-85df-4cb4-af47-920114e8140c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 20:11:30.143703 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:30.143703 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:30.143703 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:30.143703 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:30.143703 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:30.143703 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:30.143703 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:30.143703 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:30.143703 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:30.143703 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:30.143703 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:30.143703 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:11:30.143703 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:11:30.143703 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:11:30.143703 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:11:30.144642 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:11:30.144642 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:11:30.144642 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:11:30.144642 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:11:30.144642 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:30.144642 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:30.144642 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:30.144642 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:30.144642 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:30.144642 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:30.144642 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:30.144642 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:11:30.144642 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:30.144642 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:30.144642 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:30.144642 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:30.145429 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:30.145429 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:30.145429 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:30.145429 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:30.145429 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:11:30.145429 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:11:30.145429 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:11:30.145429 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:11:30.145429 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:11:30.145429 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:11:30.145429 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 20:11:30.145429 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:11:30.148231 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 276/548] 10.222.0.44 () {56 vars in 1102 bytes} [Mon May 9 20:11:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:30.152647 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fedbd7-85df-4cb4-af47-920114e8140c None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:30.241593 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf724577-0ba9-4b56-9c62-f6af45a7ac8b None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:30.276116 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14d6200-72b1-46ed-a7d1-96dbb302d237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:30.276861 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d6200-72b1-46ed-a7d1-96dbb302d237 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:30.277147 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d6200-72b1-46ed-a7d1-96dbb302d237 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:30.277420 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d6200-72b1-46ed-a7d1-96dbb302d237 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:30.288293 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14d6200-72b1-46ed-a7d1-96dbb302d237 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:30.289736 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14d6200-72b1-46ed-a7d1-96dbb302d237 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:30.307517 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-e14d6200-72b1-46ed-a7d1-96dbb302d237 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:30.307517 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:30.307517 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:30.307517 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:30.307517 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:30.307517 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:30.307517 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:30.307517 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:30.307517 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:30.307517 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:30.307517 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:30.307517 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:30.307517 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 20:11:30.307517 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 20:11:30.307517 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 20:11:30.308407 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 20:11:30.308407 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:30.308407 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:30.308407 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:30.308407 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:30.308407 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:30.308407 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:30.308407 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:30.308407 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:11:30.308407 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:30.308407 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:30.308407 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:30.308407 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:30.308407 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:30.308407 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:30.308407 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:30.308407 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:30.309247 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 20:11:30.309247 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 20:11:30.309247 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:30.309247 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:30.309247 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 273/549] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:11:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:30.320410 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14d6200-72b1-46ed-a7d1-96dbb302d237 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:30.390162 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fedbd7-85df-4cb4-af47-920114e8140c None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:30.418643 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14d6200-72b1-46ed-a7d1-96dbb302d237 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:30.453408 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a353d2-c9da-4c16-918d-e411cab1c4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:30.454092 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a353d2-c9da-4c16-918d-e411cab1c4bc None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:30.454371 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a353d2-c9da-4c16-918d-e411cab1c4bc None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:30.454640 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a353d2-c9da-4c16-918d-e411cab1c4bc None admin] PATH_INFO: `/v3/domains` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:30.456205 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a353d2-c9da-4c16-918d-e411cab1c4bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:30.456525 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a353d2-c9da-4c16-918d-e411cab1c4bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:30.457943 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a353d2-c9da-4c16-918d-e411cab1c4bc None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:30.471989 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 274/550] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 9 20:11:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:30.473229 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f018d-d1b5-405a-8456-706f59a1c2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:30.473914 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f018d-d1b5-405a-8456-706f59a1c2b0 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:30.474195 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f018d-d1b5-405a-8456-706f59a1c2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:30.474466 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f018d-d1b5-405a-8456-706f59a1c2b0 None admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:30.475221 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8f018d-d1b5-405a-8456-706f59a1c2b0 None admin] RBAC: Adding query filter params (name=service) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:30.479459 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8f018d-d1b5-405a-8456-706f59a1c2b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:30.479459 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8f018d-d1b5-405a-8456-706f59a1c2b0 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:30.480845 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a353d2-c9da-4c16-918d-e411cab1c4bc None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:30.491169 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 277/551] 10.222.0.44 () {56 vars in 1103 bytes} [Mon May 9 20:11:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:30.492765 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f018d-d1b5-405a-8456-706f59a1c2b0 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:30.603259 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f018d-d1b5-405a-8456-706f59a1c2b0 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:30.646897 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366719cd-f2b7-4b50-b386-e8886ecbdb9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:30.648100 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366719cd-f2b7-4b50-b386-e8886ecbdb9f None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:30.648581 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366719cd-f2b7-4b50-b386-e8886ecbdb9f None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:30.649047 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366719cd-f2b7-4b50-b386-e8886ecbdb9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:30.668033 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366719cd-f2b7-4b50-b386-e8886ecbdb9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:30.670446 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366719cd-f2b7-4b50-b386-e8886ecbdb9f None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:30.685736 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a353d2-c9da-4c16-918d-e411cab1c4bc None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:30.705282 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-366719cd-f2b7-4b50-b386-e8886ecbdb9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:30.705282 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:30.705282 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:30.705282 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:30.705282 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:30.705282 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:30.705282 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:30.705282 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:30.705282 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:30.705282 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:30.705282 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:30.705282 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:30.705282 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 20:11:30.705282 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 20:11:30.705282 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 20:11:30.706195 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 20:11:30.706195 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:30.706195 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:30.706195 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:30.706195 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:30.706195 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:30.706195 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:30.706195 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:30.706195 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:11:30.706195 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:30.706195 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:30.706195 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:30.706195 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:30.706195 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:30.706195 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:30.706195 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:30.706195 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:30.707036 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 20:11:30.707036 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 20:11:30.707036 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:30.707036 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:11:30.715382 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 278/552] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:11:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:30.716923 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366719cd-f2b7-4b50-b386-e8886ecbdb9f None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:30.739011 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd8cc0-19b0-4114-84bb-cca5715d86b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:30.740071 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd8cc0-19b0-4114-84bb-cca5715d86b8 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:30.740575 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd8cc0-19b0-4114-84bb-cca5715d86b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:30.741051 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd8cc0-19b0-4114-84bb-cca5715d86b8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:30.748985 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cd8cc0-19b0-4114-84bb-cca5715d86b8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:30.751882 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cd8cc0-19b0-4114-84bb-cca5715d86b8 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:30.772982 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-f8cd8cc0-19b0-4114-84bb-cca5715d86b8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 09 20:11:30.772982 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:30.772982 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:30.772982 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:30.772982 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:30.772982 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:30.772982 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:30.772982 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:30.772982 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:30.772982 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:30.772982 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:30.772982 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:30.772982 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 20:11:30.772982 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 20:11:30.772982 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 20:11:30.772982 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 20:11:30.773931 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:30.773931 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:30.773931 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 20:11:30.773931 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 20:11:30.773931 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 20:11:30.773931 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 20:11:30.773931 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:30.773931 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:30.773931 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:30.773931 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:30.773931 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:30.773931 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:11:30.773931 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:30.773931 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:30.773931 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:30.773931 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:30.773931 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:30.773931 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:30.774823 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:30.774823 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:30.774823 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 20:11:30.774823 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 20:11:30.774823 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 20:11:30.774823 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 20:11:30.774823 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 20:11:30.774823 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 20:11:30.774823 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 09 20:11:30.774823 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:30.777661 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 275/553] 10.222.0.44 () {56 vars in 1093 bytes} [Mon May 9 20:11:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:30.779229 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05fab2e-e4d6-4847-a10a-c110e40c5010 None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:30.779686 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05fab2e-e4d6-4847-a10a-c110e40c5010 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:30.780122 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05fab2e-e4d6-4847-a10a-c110e40c5010 None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:30.786872 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 276/554] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:11:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:11:30.786872 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05fab2e-e4d6-4847-a10a-c110e40c5010 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:30.842877 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366719cd-f2b7-4b50-b386-e8886ecbdb9f None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:30.876560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737526a3-535f-4acd-8b14-ffc397547b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:30.878028 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737526a3-535f-4acd-8b14-ffc397547b3d None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:30.878546 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737526a3-535f-4acd-8b14-ffc397547b3d None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:30.878969 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737526a3-535f-4acd-8b14-ffc397547b3d None admin] PATH_INFO: `/v3/domains` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:30.880002 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737526a3-535f-4acd-8b14-ffc397547b3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:30.880539 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737526a3-535f-4acd-8b14-ffc397547b3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:30.882437 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737526a3-535f-4acd-8b14-ffc397547b3d None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:30.895563 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 279/555] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 9 20:11:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:11:30.897251 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69305abd-e268-4b56-84bb-8b75aea7f544 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:30.897735 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69305abd-e268-4b56-84bb-8b75aea7f544 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:30.898228 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69305abd-e268-4b56-84bb-8b75aea7f544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:30.913016 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05fab2e-e4d6-4847-a10a-c110e40c5010 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:30.918467 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-69305abd-e268-4b56-84bb-8b75aea7f544 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:11:30.919764 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-69305abd-e268-4b56-84bb-8b75aea7f544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:11:30.948299 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722434e2-c954-4c18-8a47-8076e49a2896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:30.949346 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722434e2-c954-4c18-8a47-8076e49a2896 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:30.949866 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722434e2-c954-4c18-8a47-8076e49a2896 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:30.950338 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722434e2-c954-4c18-8a47-8076e49a2896 None admin] PATH_INFO: `/v3/users` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:30.951492 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722434e2-c954-4c18-8a47-8076e49a2896 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:30.952018 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722434e2-c954-4c18-8a47-8076e49a2896 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:30.953700 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722434e2-c954-4c18-8a47-8076e49a2896 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:30.977754 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 277/556] 10.222.0.44 () {56 vars in 1133 bytes} [Mon May 9 20:11:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:30.978978 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722434e2-c954-4c18-8a47-8076e49a2896 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:30.999998 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 280/557] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:11:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 20:11:31.001257 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69305abd-e268-4b56-84bb-8b75aea7f544 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:31.079773 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722434e2-c954-4c18-8a47-8076e49a2896 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:31.105940 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69305abd-e268-4b56-84bb-8b75aea7f544 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:31.112913 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d8f873-9567-4005-b4a1-f3498c399827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:31.113705 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8f873-9567-4005-b4a1-f3498c399827 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:31.113983 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8f873-9567-4005-b4a1-f3498c399827 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:31.114257 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8f873-9567-4005-b4a1-f3498c399827 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:31.121218 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d8f873-9567-4005-b4a1-f3498c399827 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:31.122652 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d8f873-9567-4005-b4a1-f3498c399827 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:31.137429 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-82d8f873-9567-4005-b4a1-f3498c399827 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 09 20:11:31.137429 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:31.137429 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:31.137429 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:31.137429 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:31.137429 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:31.137429 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:31.137429 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:31.137429 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:31.137429 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:31.137429 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:31.137429 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:31.137429 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 20:11:31.137429 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 20:11:31.137429 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 20:11:31.137429 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 20:11:31.138352 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:31.138352 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:31.138352 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 20:11:31.138352 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 20:11:31.138352 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 20:11:31.138352 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 20:11:31.138352 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:31.138352 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:31.138352 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:31.138352 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:31.138352 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:31.138352 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:11:31.138352 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:31.138352 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:31.138352 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:31.138352 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:31.138352 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:31.138352 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:31.139332 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:31.139332 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:31.139332 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 20:11:31.139332 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 20:11:31.139332 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 20:11:31.139332 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 20:11:31.139332 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 20:11:31.139332 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 20:11:31.139332 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 09 20:11:31.139332 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:31.139332 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 278/558] 10.222.0.44 () {56 vars in 1096 bytes} [Mon May 9 20:11:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:31.139943 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fcf45e-7de3-4fc8-8207-82f7d554ebea None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:31.140331 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fcf45e-7de3-4fc8-8207-82f7d554ebea None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:31.140426 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fcf45e-7de3-4fc8-8207-82f7d554ebea None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:31.144085 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 279/559] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:11:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:11:31.144085 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fcf45e-7de3-4fc8-8207-82f7d554ebea None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:31.150351 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28342284-d07b-4105-afec-50737133b829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:31.151137 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28342284-d07b-4105-afec-50737133b829 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:31.151433 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28342284-d07b-4105-afec-50737133b829 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:31.151706 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28342284-d07b-4105-afec-50737133b829 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:31.162811 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28342284-d07b-4105-afec-50737133b829 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:31.164310 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28342284-d07b-4105-afec-50737133b829 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:31.182804 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-28342284-d07b-4105-afec-50737133b829 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:31.182804 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:31.182804 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:31.182804 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:31.182804 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:31.182804 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:31.182804 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:31.182804 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:31.182804 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:31.182804 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:31.182804 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:31.182804 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:31.182804 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 20:11:31.182804 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 20:11:31.182804 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 20:11:31.183739 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 20:11:31.183739 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:31.183739 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:31.183739 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:31.183739 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:31.183739 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:31.183739 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:31.183739 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:31.183739 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:11:31.183739 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:31.183739 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:31.183739 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:31.183739 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:31.183739 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:31.183739 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:31.183739 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:31.183739 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:31.184578 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 20:11:31.184578 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 20:11:31.184578 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:31.184578 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:11:31.184578 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 281/560] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:11:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:31.184842 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28342284-d07b-4105-afec-50737133b829 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:31.249639 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fcf45e-7de3-4fc8-8207-82f7d554ebea None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:31.282522 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b002b0f1-926c-4516-9ae2-553a10f8a99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:31.282951 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28342284-d07b-4105-afec-50737133b829 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:31.283304 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b002b0f1-926c-4516-9ae2-553a10f8a99f None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:31.284288 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b002b0f1-926c-4516-9ae2-553a10f8a99f None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:31.284791 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b002b0f1-926c-4516-9ae2-553a10f8a99f None admin] PATH_INFO: `/v3/roles/service` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:31.294334 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b002b0f1-926c-4516-9ae2-553a10f8a99f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:11:31.302196 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-b002b0f1-926c-4516-9ae2-553a10f8a99f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 20:11:31.302196 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:31.302196 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:31.302196 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:31.302196 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:31.302196 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:31.302196 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:31.302196 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:31.302196 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:31.302196 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:31.302196 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:31.302196 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:31.302196 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:11:31.302196 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:11:31.302196 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:11:31.302196 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:11:31.303110 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:11:31.303110 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:11:31.303110 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:11:31.303110 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:11:31.303110 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:31.303110 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:31.303110 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:31.303110 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:31.303110 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:31.303110 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:31.303110 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:31.303110 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:11:31.303110 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:31.303110 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:31.303110 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:31.303110 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:31.303985 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:31.303985 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:31.303985 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:31.303985 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:31.303985 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:11:31.303985 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:11:31.303985 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:11:31.303985 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:11:31.303985 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:11:31.303985 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:11:31.303985 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 20:11:31.303985 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:31.310875 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 280/561] 10.222.0.44 () {56 vars in 1102 bytes} [Mon May 9 20:11:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:31.310875 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3079b4a7-c0e0-4ade-8890-813fd9210e52 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:31.310875 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3079b4a7-c0e0-4ade-8890-813fd9210e52 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:31.310875 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3079b4a7-c0e0-4ade-8890-813fd9210e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:31.323389 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780519c-1366-4f4c-a4eb-5564e2948e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:31.324081 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780519c-1366-4f4c-a4eb-5564e2948e0d None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:31.324365 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780519c-1366-4f4c-a4eb-5564e2948e0d None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:31.324638 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780519c-1366-4f4c-a4eb-5564e2948e0d None admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:31.325472 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8780519c-1366-4f4c-a4eb-5564e2948e0d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:31.325779 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8780519c-1366-4f4c-a4eb-5564e2948e0d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:31.325884 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-3079b4a7-c0e0-4ade-8890-813fd9210e52 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:11:31.327020 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-3079b4a7-c0e0-4ade-8890-813fd9210e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:11:31.327234 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8780519c-1366-4f4c-a4eb-5564e2948e0d None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:31.350680 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 282/562] 10.222.0.44 () {56 vars in 1135 bytes} [Mon May 9 20:11:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:31.350680 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780519c-1366-4f4c-a4eb-5564e2948e0d None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:31.397178 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 281/563] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:11:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 20:11:31.397935 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3079b4a7-c0e0-4ade-8890-813fd9210e52 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:31.463017 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780519c-1366-4f4c-a4eb-5564e2948e0d None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:31.494378 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3079b4a7-c0e0-4ade-8890-813fd9210e52 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:31.496183 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33fc550-610d-40a5-a4ab-98de4f3d7451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:31.496920 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33fc550-610d-40a5-a4ab-98de4f3d7451 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:31.497203 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33fc550-610d-40a5-a4ab-98de4f3d7451 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:31.497475 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33fc550-610d-40a5-a4ab-98de4f3d7451 None admin] PATH_INFO: `/v3/domains` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:31.498188 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33fc550-610d-40a5-a4ab-98de4f3d7451 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:31.498488 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33fc550-610d-40a5-a4ab-98de4f3d7451 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:31.499904 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33fc550-610d-40a5-a4ab-98de4f3d7451 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:31.515763 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 283/564] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 9 20:11:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:31.515763 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33fc550-610d-40a5-a4ab-98de4f3d7451 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:31.532907 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7febe7-3f86-46c2-9e34-8687c49b1e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:31.534184 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7febe7-3f86-46c2-9e34-8687c49b1e0f None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:31.534451 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7febe7-3f86-46c2-9e34-8687c49b1e0f None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:31.534737 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7febe7-3f86-46c2-9e34-8687c49b1e0f None admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:31.535474 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7febe7-3f86-46c2-9e34-8687c49b1e0f None admin] RBAC: Adding query filter params (name=service) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:31.535777 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7febe7-3f86-46c2-9e34-8687c49b1e0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:31.537131 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7febe7-3f86-46c2-9e34-8687c49b1e0f None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:31.544877 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 282/565] 10.222.0.44 () {56 vars in 1103 bytes} [Mon May 9 20:11:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:31.550178 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7febe7-3f86-46c2-9e34-8687c49b1e0f None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:31.612657 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33fc550-610d-40a5-a4ab-98de4f3d7451 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:31.645526 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d39ad0a-a7cc-4a84-9449-61249222cfe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:31.646185 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d39ad0a-a7cc-4a84-9449-61249222cfe3 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:31.646467 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d39ad0a-a7cc-4a84-9449-61249222cfe3 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:31.646736 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d39ad0a-a7cc-4a84-9449-61249222cfe3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:31.661606 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7febe7-3f86-46c2-9e34-8687c49b1e0f None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:31.694306 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0480386d-b332-43a7-b841-bee9692d4caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:31.695169 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480386d-b332-43a7-b841-bee9692d4caf None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:31.695368 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480386d-b332-43a7-b841-bee9692d4caf None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:31.695673 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480386d-b332-43a7-b841-bee9692d4caf None admin] PATH_INFO: `/v3/roles/service` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:31.705592 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0480386d-b332-43a7-b841-bee9692d4caf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:11:31.712223 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d39ad0a-a7cc-4a84-9449-61249222cfe3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:31.713365 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-0480386d-b332-43a7-b841-bee9692d4caf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 20:11:31.713365 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:31.713365 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:31.713365 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:31.713365 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:31.713365 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:31.713365 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:31.713365 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:31.713365 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:31.713365 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:31.713365 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:31.713365 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:31.713365 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:11:31.713365 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:11:31.713365 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:11:31.713365 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:11:31.714272 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:11:31.714272 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:11:31.714272 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:11:31.714272 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:11:31.714272 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:31.714272 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:31.714272 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:31.714272 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:31.714272 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:31.714272 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:31.714272 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:31.714272 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:11:31.714272 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:31.714272 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:31.714272 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:31.714272 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:31.715189 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:31.715189 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:31.715189 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:31.715189 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:31.715189 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:11:31.715189 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:11:31.715189 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:11:31.715189 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:11:31.715189 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:11:31.715189 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:11:31.715189 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 20:11:31.715189 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:31.715836 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d39ad0a-a7cc-4a84-9449-61249222cfe3 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:31.715903 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 283/566] 10.222.0.44 () {56 vars in 1102 bytes} [Mon May 9 20:11:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:31.715903 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0480386d-b332-43a7-b841-bee9692d4caf None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:31.811242 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 284/567] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 9 20:11:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 20:11:31.812480 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d39ad0a-a7cc-4a84-9449-61249222cfe3 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:31.814685 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0480386d-b332-43a7-b841-bee9692d4caf None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:31.846678 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db146f8b-ddd6-4afb-b5ff-9689d2973f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:31.847477 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db146f8b-ddd6-4afb-b5ff-9689d2973f65 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:31.847759 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db146f8b-ddd6-4afb-b5ff-9689d2973f65 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:31.848029 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db146f8b-ddd6-4afb-b5ff-9689d2973f65 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:31.854398 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db146f8b-ddd6-4afb-b5ff-9689d2973f65 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:31.855878 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db146f8b-ddd6-4afb-b5ff-9689d2973f65 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:31.870120 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-db146f8b-ddd6-4afb-b5ff-9689d2973f65 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 20:11:31.870120 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:31.870120 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:31.870120 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:31.870120 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:31.870120 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:31.870120 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:31.870120 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:31.870120 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:31.870120 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:31.870120 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:31.870120 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:31.870120 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 20:11:31.870120 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 20:11:31.870120 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 20:11:31.871143 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 20:11:31.871143 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:31.871143 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:31.871143 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:31.871143 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:31.871143 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:31.871143 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:31.871143 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:31.871143 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:11:31.871143 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:31.871143 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:31.871143 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:31.871143 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:31.871143 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:31.871143 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:31.871143 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:31.871143 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:31.872168 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 20:11:31.872168 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 20:11:31.872168 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 20:11:31.872168 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 20:11:31.872168 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 20:11:31.872168 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 20:11:31.872168 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 20:11:31.872168 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:31.875695 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 284/568] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 9 20:11:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:31.876540 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db146f8b-ddd6-4afb-b5ff-9689d2973f65 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:31.904315 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d39ad0a-a7cc-4a84-9449-61249222cfe3 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:31.936450 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6ea550-6bd6-48da-a40a-8693d8201686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:31.937148 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ea550-6bd6-48da-a40a-8693d8201686 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:31.937421 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ea550-6bd6-48da-a40a-8693d8201686 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:31.937685 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ea550-6bd6-48da-a40a-8693d8201686 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:31.946981 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6ea550-6bd6-48da-a40a-8693d8201686 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:31.948439 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6ea550-6bd6-48da-a40a-8693d8201686 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:31.965111 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-6f6ea550-6bd6-48da-a40a-8693d8201686 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:31.965111 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:31.965111 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:31.965111 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:31.965111 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:31.965111 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:31.965111 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:31.965111 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:31.965111 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:31.965111 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:31.965111 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:31.965111 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:31.965111 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 20:11:31.965111 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 20:11:31.965111 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 20:11:31.966005 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 20:11:31.966005 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:31.966005 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:31.966005 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:31.966005 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:31.966005 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:31.966005 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:31.966005 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:31.966005 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:11:31.966005 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:31.966005 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:31.966005 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:31.966005 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:31.966005 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:31.966005 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:31.966005 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:31.966005 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:31.966886 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 20:11:31.966886 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 20:11:31.966886 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:31.966886 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:11:31.966886 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 285/569] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:11:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:31.968078 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9772d95-fd2c-46d8-8854-86681c3ebf48 None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:31.968078 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9772d95-fd2c-46d8-8854-86681c3ebf48 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:31.968336 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db146f8b-ddd6-4afb-b5ff-9689d2973f65 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:31.968418 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9772d95-fd2c-46d8-8854-86681c3ebf48 None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:31.969273 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 286/570] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:11:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:11:31.972336 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9772d95-fd2c-46d8-8854-86681c3ebf48 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:32.002907 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfe9fb4-27d0-4da1-90ae-b4bb6c43dc2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:32.003592 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe9fb4-27d0-4da1-90ae-b4bb6c43dc2e None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:32.003874 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe9fb4-27d0-4da1-90ae-b4bb6c43dc2e None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:32.004149 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe9fb4-27d0-4da1-90ae-b4bb6c43dc2e None admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:32.004886 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfe9fb4-27d0-4da1-90ae-b4bb6c43dc2e None admin] RBAC: Adding query filter params (name=service) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:32.005192 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfe9fb4-27d0-4da1-90ae-b4bb6c43dc2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:32.006816 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfe9fb4-27d0-4da1-90ae-b4bb6c43dc2e None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:32.014467 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 285/571] 10.222.0.44 () {56 vars in 1103 bytes} [Mon May 9 20:11:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:32.015094 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfe9fb4-27d0-4da1-90ae-b4bb6c43dc2e None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:32.069256 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9772d95-fd2c-46d8-8854-86681c3ebf48 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:32.100029 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0ba40c-f984-4ba3-8f02-26f127e25442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:32.100796 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ba40c-f984-4ba3-8f02-26f127e25442 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:32.101070 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ba40c-f984-4ba3-8f02-26f127e25442 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:32.101332 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ba40c-f984-4ba3-8f02-26f127e25442 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:32.110597 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0ba40c-f984-4ba3-8f02-26f127e25442 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:32.111086 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfe9fb4-27d0-4da1-90ae-b4bb6c43dc2e None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:32.112710 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0ba40c-f984-4ba3-8f02-26f127e25442 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:32.130598 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-ca0ba40c-f984-4ba3-8f02-26f127e25442 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:32.130598 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:32.130598 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:32.130598 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:32.130598 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:32.130598 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:32.130598 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:32.130598 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:32.130598 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:32.130598 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:32.130598 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:32.130598 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:32.130598 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 20:11:32.130598 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 20:11:32.130598 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 20:11:32.131777 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 20:11:32.131777 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:32.131777 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:32.131777 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:32.131777 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:32.131777 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:32.131777 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:32.131777 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:32.131777 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:11:32.131777 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:32.131777 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:32.131777 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:32.131777 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:32.131777 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:32.131777 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:32.131777 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:32.131777 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:32.132756 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 20:11:32.132756 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 20:11:32.132756 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:32.132756 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:11:32.132756 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 287/572] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:11:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:32.133240 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0ba40c-f984-4ba3-8f02-26f127e25442 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:32.147177 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2192c2f4-6e95-43b5-8c85-8b7618d291b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:32.147856 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192c2f4-6e95-43b5-8c85-8b7618d291b8 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:32.148131 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192c2f4-6e95-43b5-8c85-8b7618d291b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:32.148402 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192c2f4-6e95-43b5-8c85-8b7618d291b8 None admin] PATH_INFO: `/v3/projects` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:32.149183 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2192c2f4-6e95-43b5-8c85-8b7618d291b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:32.149490 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2192c2f4-6e95-43b5-8c85-8b7618d291b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:32.150913 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2192c2f4-6e95-43b5-8c85-8b7618d291b8 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:32.162568 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 286/573] 10.222.0.44 () {56 vars in 1148 bytes} [Mon May 9 20:11:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:32.163770 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b2d35-6c77-4ce9-a3c1-0ed3ba7ef10f None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:32.164057 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b2d35-6c77-4ce9-a3c1-0ed3ba7ef10f None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:32.164326 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b2d35-6c77-4ce9-a3c1-0ed3ba7ef10f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:32.179853 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-3f9b2d35-6c77-4ce9-a3c1-0ed3ba7ef10f None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:11:32.181013 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-3f9b2d35-6c77-4ce9-a3c1-0ed3ba7ef10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:11:32.224813 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0ba40c-f984-4ba3-8f02-26f127e25442 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:32.243287 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 287/574] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:11:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 20:11:32.244139 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b2d35-6c77-4ce9-a3c1-0ed3ba7ef10f None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:32.257093 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35840571-b033-4d87-8870-0c268c03036c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:32.257746 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35840571-b033-4d87-8870-0c268c03036c None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:32.258029 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35840571-b033-4d87-8870-0c268c03036c None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:32.258305 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35840571-b033-4d87-8870-0c268c03036c None admin] PATH_INFO: `/v3/domains` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:32.259025 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35840571-b033-4d87-8870-0c268c03036c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:32.259325 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35840571-b033-4d87-8870-0c268c03036c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:32.260718 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35840571-b033-4d87-8870-0c268c03036c None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:32.271818 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 288/575] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 9 20:11:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:32.272613 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35840571-b033-4d87-8870-0c268c03036c None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:32.341425 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b2d35-6c77-4ce9-a3c1-0ed3ba7ef10f None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:32.365001 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35840571-b033-4d87-8870-0c268c03036c None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:32.372696 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f9927b-e181-49f6-b848-a47e1b8d3351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:32.373469 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f9927b-e181-49f6-b848-a47e1b8d3351 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:32.373743 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f9927b-e181-49f6-b848-a47e1b8d3351 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:32.374007 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f9927b-e181-49f6-b848-a47e1b8d3351 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:32.384137 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f9927b-e181-49f6-b848-a47e1b8d3351 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:32.385564 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f9927b-e181-49f6-b848-a47e1b8d3351 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:32.396927 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff06c7d-2ad6-47c6-97b8-1e6a77797897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:32.397571 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff06c7d-2ad6-47c6-97b8-1e6a77797897 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:32.397848 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff06c7d-2ad6-47c6-97b8-1e6a77797897 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:32.398116 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff06c7d-2ad6-47c6-97b8-1e6a77797897 None admin] PATH_INFO: `/v3/domains` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:32.398824 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff06c7d-2ad6-47c6-97b8-1e6a77797897 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:32.399126 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff06c7d-2ad6-47c6-97b8-1e6a77797897 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:32.400501 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff06c7d-2ad6-47c6-97b8-1e6a77797897 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:32.402514 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-66f9927b-e181-49f6-b848-a47e1b8d3351 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:32.402514 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:32.402514 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:32.402514 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:32.402514 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:32.402514 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:32.402514 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:32.402514 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:32.402514 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:32.402514 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:32.402514 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:32.402514 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:32.402514 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 20:11:32.402514 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 20:11:32.402514 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 20:11:32.403414 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 20:11:32.403414 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:32.403414 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:32.403414 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:32.403414 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:32.403414 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:32.403414 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:32.403414 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:32.403414 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:11:32.403414 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:32.403414 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:32.403414 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:32.403414 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:32.403414 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:32.403414 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:32.403414 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:32.403414 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:32.404320 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 20:11:32.404320 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 20:11:32.404320 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:32.404320 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:32.404320 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 288/576] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:11:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:32.404603 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f9927b-e181-49f6-b848-a47e1b8d3351 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:32.417352 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 289/577] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 9 20:11:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:32.417352 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff06c7d-2ad6-47c6-97b8-1e6a77797897 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:32.495693 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f9927b-e181-49f6-b848-a47e1b8d3351 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:32.505305 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff06c7d-2ad6-47c6-97b8-1e6a77797897 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:32.527958 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e83124-3332-48c8-9f34-2467893bef44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:32.528819 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e83124-3332-48c8-9f34-2467893bef44 None admin] REQUEST_METHOD: `PUT` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:32.529091 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e83124-3332-48c8-9f34-2467893bef44 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:32.529357 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e83124-3332-48c8-9f34-2467893bef44 None admin] PATH_INFO: `/v3/projects/563db7f5a25f480e8e6568b92ec3f195/users/eb59440b21074d9da15679dc2d745f72/roles/1ec9314b191d4bd59d71fe4d635de747` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:32.537620 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9785a5fa-9bca-491c-a38e-b760db045dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:32.538388 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785a5fa-9bca-491c-a38e-b760db045dcc None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:32.538663 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785a5fa-9bca-491c-a38e-b760db045dcc None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:32.538928 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785a5fa-9bca-491c-a38e-b760db045dcc None admin] PATH_INFO: `/v3/roles/service` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:32.543431 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e83124-3332-48c8-9f34-2467893bef44 None admin] RBAC: Authorizing `identity:create_grant(project_id=563db7f5a25f480e8e6568b92ec3f195, user_id=eb59440b21074d9da15679dc2d745f72, role_id=1ec9314b191d4bd59d71fe4d635de747)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:32.544862 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e83124-3332-48c8-9f34-2467893bef44 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:32.548427 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9785a5fa-9bca-491c-a38e-b760db045dcc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:11:32.556455 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 289/578] 10.222.0.44 () {58 vars in 1439 bytes} [Mon May 9 20:11:32 2022] PUT /identity/v3/projects/563db7f5a25f480e8e6568b92ec3f195/users/eb59440b21074d9da15679dc2d745f72/roles/1ec9314b191d4bd59d71fe4d635de747 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:11:32.556788 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-9785a5fa-9bca-491c-a38e-b760db045dcc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 20:11:32.556788 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:32.556788 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:32.556788 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:32.556788 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:32.556788 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:32.556788 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:32.556788 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:32.556788 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:32.556788 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:32.556788 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:32.556788 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:32.556788 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:11:32.556788 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:11:32.556788 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:11:32.556788 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:11:32.557721 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:11:32.557721 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:11:32.557721 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:11:32.557721 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:11:32.557721 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:32.557721 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:32.557721 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:32.557721 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:32.557721 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:32.557721 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:32.557721 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:32.557721 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:11:32.557721 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:32.557721 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:32.557721 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:32.557721 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:32.558560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:32.558560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:32.558560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:32.558560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:32.558560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:11:32.558560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:11:32.558560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:11:32.558560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:11:32.558560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:11:32.558560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:11:32.558560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 20:11:32.558560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:11:32.559191 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e83124-3332-48c8-9f34-2467893bef44 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:32.559270 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 290/579] 10.222.0.44 () {56 vars in 1102 bytes} [Mon May 9 20:11:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:32.559270 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9785a5fa-9bca-491c-a38e-b760db045dcc None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:32.666053 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9785a5fa-9bca-491c-a38e-b760db045dcc None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:32.672525 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e83124-3332-48c8-9f34-2467893bef44 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:32.701787 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b6afb0-631e-47fc-a5e8-2fcecaf24e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:32.702877 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b6afb0-631e-47fc-a5e8-2fcecaf24e65 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:32.703363 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b6afb0-631e-47fc-a5e8-2fcecaf24e65 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:32.703663 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b6afb0-631e-47fc-a5e8-2fcecaf24e65 None admin] PATH_INFO: `/v3/domains` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:32.704397 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b6afb0-631e-47fc-a5e8-2fcecaf24e65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:32.704706 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b6afb0-631e-47fc-a5e8-2fcecaf24e65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:32.706807 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b6afb0-631e-47fc-a5e8-2fcecaf24e65 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:32.707702 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c14ba8-c37a-4e06-9a90-fa4089660558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:32.708515 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c14ba8-c37a-4e06-9a90-fa4089660558 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:32.708794 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c14ba8-c37a-4e06-9a90-fa4089660558 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:32.709123 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c14ba8-c37a-4e06-9a90-fa4089660558 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:32.717214 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c14ba8-c37a-4e06-9a90-fa4089660558 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:32.718669 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c14ba8-c37a-4e06-9a90-fa4089660558 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:32.719378 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 291/580] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 9 20:11:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:32.720282 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b6afb0-631e-47fc-a5e8-2fcecaf24e65 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:32.740372 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-e5c14ba8-c37a-4e06-9a90-fa4089660558 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 09 20:11:32.740372 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:32.740372 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:32.740372 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:32.740372 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:32.740372 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:32.740372 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:32.740372 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:32.740372 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:32.740372 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:32.740372 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:32.740372 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:32.740372 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 20:11:32.740372 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 20:11:32.740372 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 20:11:32.740372 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 20:11:32.741363 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:32.741363 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:32.741363 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 20:11:32.741363 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 20:11:32.741363 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 20:11:32.741363 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 20:11:32.741363 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:32.741363 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:32.741363 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:32.741363 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:32.741363 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:32.741363 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:11:32.741363 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:32.741363 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:32.741363 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:32.741363 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:32.741363 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:32.741363 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:32.742315 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:32.742315 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:32.742315 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 20:11:32.742315 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 20:11:32.742315 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 20:11:32.742315 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 20:11:32.742315 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 20:11:32.742315 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 20:11:32.742315 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 09 20:11:32.742315 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:32.742315 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 290/581] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 9 20:11:32 2022] GET /identity/v3/users/cinder => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:32.742901 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c14ba8-c37a-4e06-9a90-fa4089660558 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:32.827735 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b6afb0-631e-47fc-a5e8-2fcecaf24e65 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:32.842944 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c14ba8-c37a-4e06-9a90-fa4089660558 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:32.861127 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aca715-2f8e-40f7-9206-c9807cf0e130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:32.862492 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aca715-2f8e-40f7-9206-c9807cf0e130 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:32.863197 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aca715-2f8e-40f7-9206-c9807cf0e130 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:32.863574 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aca715-2f8e-40f7-9206-c9807cf0e130 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:32.870692 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aca715-2f8e-40f7-9206-c9807cf0e130 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:32.872187 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aca715-2f8e-40f7-9206-c9807cf0e130 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:32.875764 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f2044-5718-4bee-a7d3-331f4d1076e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:32.876418 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f2044-5718-4bee-a7d3-331f4d1076e0 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:32.876693 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f2044-5718-4bee-a7d3-331f4d1076e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:32.876960 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f2044-5718-4bee-a7d3-331f4d1076e0 None admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:32.878405 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3f2044-5718-4bee-a7d3-331f4d1076e0 None admin] RBAC: Adding query filter params (name=service) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:32.878713 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3f2044-5718-4bee-a7d3-331f4d1076e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:32.880091 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3f2044-5718-4bee-a7d3-331f4d1076e0 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:32.886317 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-49aca715-2f8e-40f7-9206-c9807cf0e130 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 20:11:32.886317 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:32.886317 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:32.886317 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:32.886317 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:32.886317 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:32.886317 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:32.886317 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:32.886317 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:32.886317 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:32.886317 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:32.886317 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:32.886317 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 20:11:32.886317 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 20:11:32.886317 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 20:11:32.887197 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 20:11:32.887197 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:32.887197 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:32.887197 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:32.887197 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:32.887197 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:32.887197 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:32.887197 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:32.887197 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:11:32.887197 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:32.887197 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:32.887197 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:32.887197 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:32.887197 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:32.887197 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:32.887197 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:32.887197 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:32.888127 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 20:11:32.888127 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 20:11:32.888127 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 20:11:32.888127 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 20:11:32.888127 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 20:11:32.888127 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 20:11:32.888127 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 20:11:32.888127 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:11:32.891851 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 292/582] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 9 20:11:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:32.892339 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 291/583] 10.222.0.44 () {56 vars in 1103 bytes} [Mon May 9 20:11:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:32.893215 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aca715-2f8e-40f7-9206-c9807cf0e130 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:32.893359 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f2044-5718-4bee-a7d3-331f4d1076e0 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:32.990884 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aca715-2f8e-40f7-9206-c9807cf0e130 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:32.996683 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f2044-5718-4bee-a7d3-331f4d1076e0 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:33.025797 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92635d23-ecda-4119-8292-137ad0018e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:33.026582 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92635d23-ecda-4119-8292-137ad0018e28 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:33.026861 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92635d23-ecda-4119-8292-137ad0018e28 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:33.027127 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92635d23-ecda-4119-8292-137ad0018e28 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:33.029328 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef47177-3dfe-4c77-a95e-978f6b30e12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:33.029985 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef47177-3dfe-4c77-a95e-978f6b30e12c None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:33.030262 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef47177-3dfe-4c77-a95e-978f6b30e12c None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:33.030531 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef47177-3dfe-4c77-a95e-978f6b30e12c None admin] PATH_INFO: `/v3/users` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:33.031363 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef47177-3dfe-4c77-a95e-978f6b30e12c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:33.031692 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef47177-3dfe-4c77-a95e-978f6b30e12c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:33.033124 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef47177-3dfe-4c77-a95e-978f6b30e12c None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:33.034610 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92635d23-ecda-4119-8292-137ad0018e28 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:33.036089 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92635d23-ecda-4119-8292-137ad0018e28 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:33.050024 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 292/584] 10.222.0.44 () {56 vars in 1137 bytes} [Mon May 9 20:11:32 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:33.050230 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-92635d23-ecda-4119-8292-137ad0018e28 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 09 20:11:33.050230 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:33.050230 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:33.050230 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:33.050230 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:33.050230 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:33.050230 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:33.050230 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:33.050230 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:33.050230 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:33.050230 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:33.050230 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:33.050230 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 20:11:33.050230 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 20:11:33.050230 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 20:11:33.050230 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 20:11:33.051104 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:33.051104 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:33.051104 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 20:11:33.051104 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 20:11:33.051104 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 20:11:33.051104 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 20:11:33.051104 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:33.051104 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:33.051104 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:33.051104 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:33.051104 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:33.051104 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:11:33.051104 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:33.051104 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:33.051104 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:33.051104 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:33.051104 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:33.051104 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:33.052066 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:33.052066 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:33.052066 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 20:11:33.052066 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 20:11:33.052066 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 20:11:33.052066 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 20:11:33.052066 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 20:11:33.052066 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 20:11:33.052066 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 09 20:11:33.052066 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:11:33.052066 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 293/585] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 9 20:11:32 2022] GET /identity/v3/users/glance => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:33.052660 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92635d23-ecda-4119-8292-137ad0018e28 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:33.053905 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef47177-3dfe-4c77-a95e-978f6b30e12c None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:33.156535 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef47177-3dfe-4c77-a95e-978f6b30e12c None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:33.156714 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92635d23-ecda-4119-8292-137ad0018e28 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:33.188794 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14771b7-b5cc-44b7-8108-24f056e874b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:33.189143 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a79dee-8cea-41e7-8b35-c95c78c78dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:33.190097 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14771b7-b5cc-44b7-8108-24f056e874b7 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:33.190331 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a79dee-8cea-41e7-8b35-c95c78c78dc5 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:33.190432 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14771b7-b5cc-44b7-8108-24f056e874b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:33.190741 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a79dee-8cea-41e7-8b35-c95c78c78dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:33.190846 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14771b7-b5cc-44b7-8108-24f056e874b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:33.190930 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a79dee-8cea-41e7-8b35-c95c78c78dc5 None admin] PATH_INFO: `/v3/projects` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:33.191670 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a79dee-8cea-41e7-8b35-c95c78c78dc5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:33.191977 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a79dee-8cea-41e7-8b35-c95c78c78dc5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:33.193506 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a79dee-8cea-41e7-8b35-c95c78c78dc5 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:33.200146 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14771b7-b5cc-44b7-8108-24f056e874b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:33.201548 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14771b7-b5cc-44b7-8108-24f056e874b7 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:33.209806 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 294/586] 10.222.0.44 () {56 vars in 1148 bytes} [Mon May 9 20:11:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:33.209806 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a79dee-8cea-41e7-8b35-c95c78c78dc5 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:33.221479 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-d14771b7-b5cc-44b7-8108-24f056e874b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:33.221479 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:33.221479 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:33.221479 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:33.221479 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:33.221479 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:33.221479 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:33.221479 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:33.221479 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:33.221479 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:33.221479 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:33.221479 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:33.221479 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 20:11:33.221479 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 20:11:33.221479 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 20:11:33.222445 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 20:11:33.222445 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:33.222445 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:33.222445 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:33.222445 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:33.222445 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:33.222445 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:33.222445 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:33.222445 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:11:33.222445 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:33.222445 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:33.222445 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:33.222445 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:33.222445 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:33.222445 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:33.222445 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:33.222445 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:33.223359 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 20:11:33.223359 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 20:11:33.223359 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:33.223359 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:33.227419 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 293/587] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:11:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:33.228085 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14771b7-b5cc-44b7-8108-24f056e874b7 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:33.307104 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a79dee-8cea-41e7-8b35-c95c78c78dc5 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:33.324101 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14771b7-b5cc-44b7-8108-24f056e874b7 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:33.341467 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fede43-2346-4cf2-a4a8-3d8569622571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:33.342244 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fede43-2346-4cf2-a4a8-3d8569622571 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:33.342523 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fede43-2346-4cf2-a4a8-3d8569622571 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:33.342791 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fede43-2346-4cf2-a4a8-3d8569622571 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:33.353068 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fede43-2346-4cf2-a4a8-3d8569622571 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:33.354514 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fede43-2346-4cf2-a4a8-3d8569622571 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:33.356540 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3cd939-0ce7-4860-9a8c-922065760bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:33.357203 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3cd939-0ce7-4860-9a8c-922065760bcf None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:33.357480 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3cd939-0ce7-4860-9a8c-922065760bcf None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:33.357749 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3cd939-0ce7-4860-9a8c-922065760bcf None admin] PATH_INFO: `/v3/users` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:33.358578 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3cd939-0ce7-4860-9a8c-922065760bcf None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:33.358880 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3cd939-0ce7-4860-9a8c-922065760bcf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:33.360317 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3cd939-0ce7-4860-9a8c-922065760bcf None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:33.372280 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-e9fede43-2346-4cf2-a4a8-3d8569622571 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:33.372280 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:33.372280 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:33.372280 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:33.372280 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:33.372280 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:33.372280 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:33.372280 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:33.372280 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:33.372280 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:33.372280 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:33.372280 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:33.372280 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 20:11:33.372280 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 20:11:33.372280 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 20:11:33.373223 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 20:11:33.373223 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:33.373223 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:33.373223 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:33.373223 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:33.373223 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:33.373223 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:33.373223 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:33.373223 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:11:33.373223 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:33.373223 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:33.373223 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:33.373223 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:33.373223 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:33.373223 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:33.373223 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:33.373223 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:33.374113 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 20:11:33.374113 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 20:11:33.374113 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:33.374113 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:11:33.376897 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 295/588] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:11:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:33.376897 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fede43-2346-4cf2-a4a8-3d8569622571 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:33.381893 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 294/589] 10.222.0.44 () {56 vars in 1137 bytes} [Mon May 9 20:11:33 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:33.382895 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3cd939-0ce7-4860-9a8c-922065760bcf None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:33.478880 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3cd939-0ce7-4860-9a8c-922065760bcf None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:33.483676 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fede43-2346-4cf2-a4a8-3d8569622571 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:33.511843 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bb193e-7c70-4116-bb23-29f0f2b731b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:33.512489 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb193e-7c70-4116-bb23-29f0f2b731b4 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:33.512770 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb193e-7c70-4116-bb23-29f0f2b731b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:33.513040 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb193e-7c70-4116-bb23-29f0f2b731b4 None admin] PATH_INFO: `/v3/domains` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:33.513749 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bb193e-7c70-4116-bb23-29f0f2b731b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:33.514048 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bb193e-7c70-4116-bb23-29f0f2b731b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:33.515420 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bb193e-7c70-4116-bb23-29f0f2b731b4 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:33.516776 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cdcce1-5671-4e9f-aa4c-0619b33ab9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:33.517415 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cdcce1-5671-4e9f-aa4c-0619b33ab9c6 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:33.518227 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cdcce1-5671-4e9f-aa4c-0619b33ab9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:33.518495 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cdcce1-5671-4e9f-aa4c-0619b33ab9c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:33.519343 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cdcce1-5671-4e9f-aa4c-0619b33ab9c6 None admin] RBAC: Adding query filter params (role.id=1ec9314b191d4bd59d71fe4d635de747, scope.project.id=563db7f5a25f480e8e6568b92ec3f195, user.id=965089f1a92f49bd883b337d6042c69f) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:33.519698 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cdcce1-5671-4e9f-aa4c-0619b33ab9c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:33.521120 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cdcce1-5671-4e9f-aa4c-0619b33ab9c6 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:33.535613 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 296/590] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 9 20:11:33 2022] GET /identity/v3/role_assignments?user.id=965089f1a92f49bd883b337d6042c69f&scope.project.id=563db7f5a25f480e8e6568b92ec3f195&role.id=1ec9314b191d4bd59d71fe4d635de747 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:33.535613 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cdcce1-5671-4e9f-aa4c-0619b33ab9c6 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:33.535875 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 295/591] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 9 20:11:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:33.535875 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bb193e-7c70-4116-bb23-29f0f2b731b4 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:33.641386 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bb193e-7c70-4116-bb23-29f0f2b731b4 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:33.650832 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cdcce1-5671-4e9f-aa4c-0619b33ab9c6 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:33.677820 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278fe4ce-e3ff-47dd-8608-344273fae376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:33.678903 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278fe4ce-e3ff-47dd-8608-344273fae376 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:33.679304 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278fe4ce-e3ff-47dd-8608-344273fae376 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:33.679742 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278fe4ce-e3ff-47dd-8608-344273fae376 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:33.686794 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a87ed14-9db7-4a65-953d-2507fbd0d5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:33.687561 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a87ed14-9db7-4a65-953d-2507fbd0d5b9 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:33.687818 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a87ed14-9db7-4a65-953d-2507fbd0d5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:33.688090 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a87ed14-9db7-4a65-953d-2507fbd0d5b9 None admin] PATH_INFO: `/v3/domains` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:33.688848 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a87ed14-9db7-4a65-953d-2507fbd0d5b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:33.689151 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a87ed14-9db7-4a65-953d-2507fbd0d5b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:33.691503 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a87ed14-9db7-4a65-953d-2507fbd0d5b9 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:33.692803 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278fe4ce-e3ff-47dd-8608-344273fae376 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:33.694336 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278fe4ce-e3ff-47dd-8608-344273fae376 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:33.705600 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 297/592] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 9 20:11:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:33.706704 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a87ed14-9db7-4a65-953d-2507fbd0d5b9 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:33.712794 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-278fe4ce-e3ff-47dd-8608-344273fae376 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:33.712794 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:33.712794 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:33.712794 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:33.712794 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:33.712794 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:33.712794 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:33.712794 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:33.712794 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:33.712794 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:33.712794 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:33.712794 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:33.712794 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 20:11:33.712794 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 20:11:33.712794 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 20:11:33.715264 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 20:11:33.715264 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:33.715264 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:33.715264 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:33.715264 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:33.715264 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:33.715264 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:33.715264 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:33.715264 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:11:33.715264 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:33.715264 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:33.715264 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:33.715264 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:33.715264 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:33.715264 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:33.715264 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:33.715264 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:33.717596 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 20:11:33.717596 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 20:11:33.717596 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:33.717596 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:33.717596 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 296/593] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:11:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:33.717596 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278fe4ce-e3ff-47dd-8608-344273fae376 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:33.812679 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a87ed14-9db7-4a65-953d-2507fbd0d5b9 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:33.828699 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278fe4ce-e3ff-47dd-8608-344273fae376 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:33.846868 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a78cde7-d0f7-4f2b-9600-0d250a0c7202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:33.847807 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78cde7-d0f7-4f2b-9600-0d250a0c7202 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:33.848077 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78cde7-d0f7-4f2b-9600-0d250a0c7202 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:33.848342 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78cde7-d0f7-4f2b-9600-0d250a0c7202 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:33.856029 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a78cde7-d0f7-4f2b-9600-0d250a0c7202 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:33.857471 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a78cde7-d0f7-4f2b-9600-0d250a0c7202 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:33.862972 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7001bf38-6984-4a23-8cc3-2e477537673b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:33.863788 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7001bf38-6984-4a23-8cc3-2e477537673b None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:33.864119 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7001bf38-6984-4a23-8cc3-2e477537673b None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:33.864391 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7001bf38-6984-4a23-8cc3-2e477537673b None admin] PATH_INFO: `/v3/projects/service` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:33.871532 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7001bf38-6984-4a23-8cc3-2e477537673b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:33.872074 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-2a78cde7-d0f7-4f2b-9600-0d250a0c7202 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 09 20:11:33.872074 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:33.872074 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:33.872074 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:33.872074 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:33.872074 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:33.872074 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:33.872074 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:33.872074 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:33.872074 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:33.872074 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:33.872074 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:33.872074 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 20:11:33.872074 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 20:11:33.872074 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 20:11:33.872074 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 20:11:33.874446 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:33.874446 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:33.874446 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 20:11:33.874446 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 20:11:33.874446 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 20:11:33.874446 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 20:11:33.874446 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:33.874446 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:33.874446 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:33.874446 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:33.874446 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:33.874446 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:11:33.874446 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:33.874446 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:33.874446 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:33.874446 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:33.874446 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:33.874446 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:33.876943 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:33.876943 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:33.876943 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 20:11:33.876943 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 20:11:33.876943 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 20:11:33.876943 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 20:11:33.876943 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 20:11:33.876943 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 20:11:33.876943 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 09 20:11:33.876943 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:11:33.888644 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7001bf38-6984-4a23-8cc3-2e477537673b None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:33.888815 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 298/594] 10.222.0.44 () {56 vars in 1102 bytes} [Mon May 9 20:11:33 2022] GET /identity/v3/users/neutron => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:33.888815 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a78cde7-d0f7-4f2b-9600-0d250a0c7202 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:33.893676 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-7001bf38-6984-4a23-8cc3-2e477537673b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 20:11:33.893676 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:33.893676 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:33.893676 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:33.893676 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:33.893676 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:33.893676 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:33.893676 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:33.893676 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:33.893676 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:33.893676 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:33.893676 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:33.893676 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 20:11:33.893676 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 20:11:33.893676 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 20:11:33.896085 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 20:11:33.896085 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:33.896085 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:33.896085 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:33.896085 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:33.896085 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:33.896085 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:33.896085 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:33.896085 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:11:33.896085 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:33.896085 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:33.896085 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:33.896085 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:33.896085 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:33.896085 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:33.896085 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:33.896085 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:33.898362 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 20:11:33.898362 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 20:11:33.898362 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 20:11:33.898362 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 20:11:33.898362 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 20:11:33.898362 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 20:11:33.898362 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 20:11:33.898362 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:33.898362 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 297/595] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 9 20:11:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:33.898362 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7001bf38-6984-4a23-8cc3-2e477537673b None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:33.972985 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a78cde7-d0f7-4f2b-9600-0d250a0c7202 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:33.993121 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7001bf38-6984-4a23-8cc3-2e477537673b None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:34.007306 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaa7913-ef83-4788-b41b-b0a9f449b07e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:34.008000 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa7913-ef83-4788-b41b-b0a9f449b07e None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:34.008275 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa7913-ef83-4788-b41b-b0a9f449b07e None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:34.008540 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa7913-ef83-4788-b41b-b0a9f449b07e None admin] PATH_INFO: `/v3/domains` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:34.009253 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaa7913-ef83-4788-b41b-b0a9f449b07e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:34.009554 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaa7913-ef83-4788-b41b-b0a9f449b07e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:34.010913 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaa7913-ef83-4788-b41b-b0a9f449b07e None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:34.022845 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 299/596] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 9 20:11:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:34.023696 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaa7913-ef83-4788-b41b-b0a9f449b07e None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:34.032846 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f1d2ce-be08-4022-b78a-f7b8887a073c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:34.034249 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1d2ce-be08-4022-b78a-f7b8887a073c None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:34.034971 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1d2ce-be08-4022-b78a-f7b8887a073c None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:34.034971 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1d2ce-be08-4022-b78a-f7b8887a073c None admin] PATH_INFO: `/v3/users` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:34.035758 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f1d2ce-be08-4022-b78a-f7b8887a073c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:34.036065 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f1d2ce-be08-4022-b78a-f7b8887a073c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:34.037542 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f1d2ce-be08-4022-b78a-f7b8887a073c None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:34.060542 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 298/597] 10.222.0.44 () {56 vars in 1139 bytes} [Mon May 9 20:11:33 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:34.061439 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f1d2ce-be08-4022-b78a-f7b8887a073c None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:34.131792 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaa7913-ef83-4788-b41b-b0a9f449b07e None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:34.168093 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f1d2ce-be08-4022-b78a-f7b8887a073c None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:34.177363 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7f1bcf-5bc2-4d89-94a7-99351c37452f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:34.178326 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f1bcf-5bc2-4d89-94a7-99351c37452f None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:34.179161 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f1bcf-5bc2-4d89-94a7-99351c37452f None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:34.179655 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f1bcf-5bc2-4d89-94a7-99351c37452f None admin] PATH_INFO: `/v3/projects` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:34.180968 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7f1bcf-5bc2-4d89-94a7-99351c37452f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:34.181753 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7f1bcf-5bc2-4d89-94a7-99351c37452f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:34.184115 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7f1bcf-5bc2-4d89-94a7-99351c37452f None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:34.204967 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 300/598] 10.222.0.44 () {56 vars in 1148 bytes} [Mon May 9 20:11:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:34.204967 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7f1bcf-5bc2-4d89-94a7-99351c37452f None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:34.211641 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8180b2-d87e-4a2b-9dd4-ff737057c3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:34.212630 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8180b2-d87e-4a2b-9dd4-ff737057c3ad None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:34.213059 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8180b2-d87e-4a2b-9dd4-ff737057c3ad None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:34.213484 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8180b2-d87e-4a2b-9dd4-ff737057c3ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:34.220734 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8180b2-d87e-4a2b-9dd4-ff737057c3ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:34.223006 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8180b2-d87e-4a2b-9dd4-ff737057c3ad None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:34.237253 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-9e8180b2-d87e-4a2b-9dd4-ff737057c3ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 20:11:34.237253 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:34.237253 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:34.237253 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:34.237253 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:34.237253 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:34.237253 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:34.237253 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:34.237253 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:34.237253 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:34.237253 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:34.237253 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:34.237253 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 20:11:34.237253 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 20:11:34.237253 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 20:11:34.238258 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 20:11:34.238258 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:34.238258 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:34.238258 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:34.238258 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:34.238258 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:34.238258 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:34.238258 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:34.238258 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:11:34.238258 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:34.238258 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:34.238258 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:34.238258 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:34.238258 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:34.238258 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:34.238258 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:34.238258 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:34.239331 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 20:11:34.239331 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 20:11:34.239331 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 20:11:34.239331 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 20:11:34.239331 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 20:11:34.239331 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 20:11:34.239331 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 20:11:34.239331 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:34.241468 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 299/599] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 9 20:11:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:34.242373 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8180b2-d87e-4a2b-9dd4-ff737057c3ad None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:34.332130 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7f1bcf-5bc2-4d89-94a7-99351c37452f None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:34.368029 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8180b2-d87e-4a2b-9dd4-ff737057c3ad None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:34.371259 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61130f6-077f-4bcc-9c6e-520f2c91feb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:34.371882 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61130f6-077f-4bcc-9c6e-520f2c91feb9 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:34.372255 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61130f6-077f-4bcc-9c6e-520f2c91feb9 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:34.372618 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61130f6-077f-4bcc-9c6e-520f2c91feb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:34.383809 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61130f6-077f-4bcc-9c6e-520f2c91feb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:34.385448 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61130f6-077f-4bcc-9c6e-520f2c91feb9 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:34.403264 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-d61130f6-077f-4bcc-9c6e-520f2c91feb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:34.403264 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:34.403264 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:34.403264 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:34.403264 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:34.403264 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:34.403264 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:34.403264 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:34.403264 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:34.403264 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:34.403264 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:34.403264 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:34.403264 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 20:11:34.403264 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 20:11:34.403264 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 20:11:34.404401 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 20:11:34.404401 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:34.404401 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:34.404401 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:34.404401 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:34.404401 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:34.404401 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:34.404401 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:34.404401 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:11:34.404401 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:34.404401 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:34.404401 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:34.404401 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:34.404401 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:34.404401 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:34.404401 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:34.404401 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:34.405503 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 20:11:34.405503 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 20:11:34.405503 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:34.405503 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:11:34.409412 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eb5a07-6ff2-4004-98a1-046863a9e2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:34.411030 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb5a07-6ff2-4004-98a1-046863a9e2b9 None admin] REQUEST_METHOD: `PUT` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:34.411752 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 301/600] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:11:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:34.412263 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb5a07-6ff2-4004-98a1-046863a9e2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:34.412797 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61130f6-077f-4bcc-9c6e-520f2c91feb9 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:34.413077 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb5a07-6ff2-4004-98a1-046863a9e2b9 None admin] PATH_INFO: `/v3/projects/563db7f5a25f480e8e6568b92ec3f195/users/9d65e731386d44948dcc1ecd40cbda65/roles/1ec9314b191d4bd59d71fe4d635de747` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:34.435770 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eb5a07-6ff2-4004-98a1-046863a9e2b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=563db7f5a25f480e8e6568b92ec3f195, user_id=9d65e731386d44948dcc1ecd40cbda65, role_id=1ec9314b191d4bd59d71fe4d635de747)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:34.437509 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eb5a07-6ff2-4004-98a1-046863a9e2b9 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:34.452663 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 300/601] 10.222.0.44 () {58 vars in 1439 bytes} [Mon May 9 20:11:34 2022] PUT /identity/v3/projects/563db7f5a25f480e8e6568b92ec3f195/users/9d65e731386d44948dcc1ecd40cbda65/roles/1ec9314b191d4bd59d71fe4d635de747 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:11:34.460667 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eb5a07-6ff2-4004-98a1-046863a9e2b9 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:34.518782 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61130f6-077f-4bcc-9c6e-520f2c91feb9 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:34.556131 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45ef366-c704-4acc-95e5-007cc2e284b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:34.557037 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ef366-c704-4acc-95e5-007cc2e284b7 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:34.557315 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ef366-c704-4acc-95e5-007cc2e284b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:34.559253 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ef366-c704-4acc-95e5-007cc2e284b7 None admin] PATH_INFO: `/v3/projects` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:34.560094 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45ef366-c704-4acc-95e5-007cc2e284b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:34.560398 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45ef366-c704-4acc-95e5-007cc2e284b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:34.563884 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45ef366-c704-4acc-95e5-007cc2e284b7 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:34.593453 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 302/602] 10.222.0.44 () {56 vars in 1148 bytes} [Mon May 9 20:11:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:34.596384 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45ef366-c704-4acc-95e5-007cc2e284b7 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:34.656388 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eb5a07-6ff2-4004-98a1-046863a9e2b9 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:34.695528 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b8e566-6bee-44ff-a73e-2a4abdb7545f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:34.695528 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8e566-6bee-44ff-a73e-2a4abdb7545f None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:34.695528 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8e566-6bee-44ff-a73e-2a4abdb7545f None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:34.695911 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8e566-6bee-44ff-a73e-2a4abdb7545f None admin] PATH_INFO: `/v3/domains` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:34.696541 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b8e566-6bee-44ff-a73e-2a4abdb7545f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:34.696847 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b8e566-6bee-44ff-a73e-2a4abdb7545f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:34.698920 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b8e566-6bee-44ff-a73e-2a4abdb7545f None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:34.711767 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 301/603] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 9 20:11:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:34.713705 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45ef366-c704-4acc-95e5-007cc2e284b7 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:34.722322 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b8e566-6bee-44ff-a73e-2a4abdb7545f None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:34.756751 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51349bed-d09c-4b59-a396-396662a5ab15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:34.757627 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51349bed-d09c-4b59-a396-396662a5ab15 None admin] REQUEST_METHOD: `PUT` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:34.757900 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51349bed-d09c-4b59-a396-396662a5ab15 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:34.758179 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51349bed-d09c-4b59-a396-396662a5ab15 None admin] PATH_INFO: `/v3/projects/563db7f5a25f480e8e6568b92ec3f195/users/65db5d9a86fd48acb5874df0165c0ef9/roles/1ec9314b191d4bd59d71fe4d635de747` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:34.773676 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51349bed-d09c-4b59-a396-396662a5ab15 None admin] RBAC: Authorizing `identity:create_grant(project_id=563db7f5a25f480e8e6568b92ec3f195, user_id=65db5d9a86fd48acb5874df0165c0ef9, role_id=1ec9314b191d4bd59d71fe4d635de747)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:34.775236 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51349bed-d09c-4b59-a396-396662a5ab15 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:34.792878 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 303/604] 10.222.0.44 () {58 vars in 1439 bytes} [Mon May 9 20:11:34 2022] PUT /identity/v3/projects/563db7f5a25f480e8e6568b92ec3f195/users/65db5d9a86fd48acb5874df0165c0ef9/roles/1ec9314b191d4bd59d71fe4d635de747 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:11:34.841129 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b8e566-6bee-44ff-a73e-2a4abdb7545f None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:34.878922 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2553552c-814a-4f60-b618-cb459e423150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:34.879762 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553552c-814a-4f60-b618-cb459e423150 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:34.880038 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553552c-814a-4f60-b618-cb459e423150 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:34.880302 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553552c-814a-4f60-b618-cb459e423150 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:34.888422 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2553552c-814a-4f60-b618-cb459e423150 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:34.889890 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2553552c-814a-4f60-b618-cb459e423150 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:34.905731 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-2553552c-814a-4f60-b618-cb459e423150 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 20:11:34.905731 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:34.905731 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:34.905731 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:34.905731 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:34.905731 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:34.905731 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:34.905731 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:34.905731 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:34.905731 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:34.905731 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:34.905731 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:34.905731 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 20:11:34.905731 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 20:11:34.905731 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 20:11:34.906722 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 20:11:34.906722 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:34.906722 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:34.906722 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:34.906722 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:34.906722 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:34.906722 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:34.906722 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:34.906722 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:11:34.906722 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:34.906722 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:34.906722 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:34.906722 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:34.906722 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:34.906722 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:34.906722 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:34.906722 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:34.909303 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 20:11:34.909303 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 20:11:34.909303 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 20:11:34.909303 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 20:11:34.909303 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 20:11:34.909303 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 20:11:34.909303 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 20:11:34.909303 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:34.909303 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 302/605] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 9 20:11:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:34.913669 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51349bed-d09c-4b59-a396-396662a5ab15 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:34.930097 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a92a45a-824b-410f-b44e-25556fc4c46b None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:34.930739 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a92a45a-824b-410f-b44e-25556fc4c46b None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:34.931256 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a92a45a-824b-410f-b44e-25556fc4c46b None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:34.933130 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 303/606] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:11:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:11:34.940871 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a760c5e-df21-4fbf-8894-24d3ffef732c None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:34.941509 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a760c5e-df21-4fbf-8894-24d3ffef732c None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:34.941996 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a760c5e-df21-4fbf-8894-24d3ffef732c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:34.962377 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-4a760c5e-df21-4fbf-8894-24d3ffef732c None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:11:34.964307 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-4a760c5e-df21-4fbf-8894-24d3ffef732c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:11:35.058850 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 304/607] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:11:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 20:11:35.082515 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51349bed-d09c-4b59-a396-396662a5ab15 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:35.091192 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a760c5e-df21-4fbf-8894-24d3ffef732c None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:35.129596 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e243211-d038-4ce3-a11f-facce2f863c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:35.130625 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e243211-d038-4ce3-a11f-facce2f863c6 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:35.131370 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e243211-d038-4ce3-a11f-facce2f863c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:35.132018 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e243211-d038-4ce3-a11f-facce2f863c6 None admin] PATH_INFO: `/v3/projects` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:35.133854 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e243211-d038-4ce3-a11f-facce2f863c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:35.134409 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e243211-d038-4ce3-a11f-facce2f863c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:35.136160 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e243211-d038-4ce3-a11f-facce2f863c6 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:35.155699 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 304/608] 10.222.0.44 () {56 vars in 1148 bytes} [Mon May 9 20:11:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:35.164974 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e243211-d038-4ce3-a11f-facce2f863c6 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:35.239311 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a760c5e-df21-4fbf-8894-24d3ffef732c None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:35.305437 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22736233-9d29-421f-a21f-63a6bc65aa39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:35.306229 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22736233-9d29-421f-a21f-63a6bc65aa39 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:35.306503 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22736233-9d29-421f-a21f-63a6bc65aa39 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:35.306768 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22736233-9d29-421f-a21f-63a6bc65aa39 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:35.329493 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22736233-9d29-421f-a21f-63a6bc65aa39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:11:35.337415 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-22736233-9d29-421f-a21f-63a6bc65aa39 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 20:11:35.337415 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:35.337415 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:35.337415 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:35.337415 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:35.337415 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:35.337415 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:35.337415 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:35.337415 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:35.337415 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:35.337415 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:35.337415 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:35.337415 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:11:35.337415 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:11:35.337415 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:11:35.337415 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:11:35.338391 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:11:35.338391 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:11:35.338391 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:11:35.338391 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:11:35.338391 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:35.338391 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:35.338391 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:35.338391 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:35.338391 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:35.338391 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:35.338391 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:35.338391 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:11:35.338391 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:35.338391 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:35.338391 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:35.338391 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:35.339284 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:35.339284 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:35.339284 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:35.339284 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:35.339284 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:11:35.339284 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:11:35.339284 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:11:35.339284 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:11:35.339284 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:11:35.339284 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:11:35.339284 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 20:11:35.339284 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:35.339284 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 305/609] 10.222.0.44 () {56 vars in 1102 bytes} [Mon May 9 20:11:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 20:11:35.346799 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e243211-d038-4ce3-a11f-facce2f863c6 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:35.350592 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22736233-9d29-421f-a21f-63a6bc65aa39 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:35.405816 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1366ca9a-07f2-4c88-88cc-6303d547a806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:35.406695 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1366ca9a-07f2-4c88-88cc-6303d547a806 None admin] REQUEST_METHOD: `PUT` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:35.406970 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1366ca9a-07f2-4c88-88cc-6303d547a806 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:35.407240 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1366ca9a-07f2-4c88-88cc-6303d547a806 None admin] PATH_INFO: `/v3/projects/563db7f5a25f480e8e6568b92ec3f195/users/b2a13ad25f27471792ba0758602b6e63/roles/1ec9314b191d4bd59d71fe4d635de747` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:35.433027 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1366ca9a-07f2-4c88-88cc-6303d547a806 None admin] RBAC: Authorizing `identity:create_grant(project_id=563db7f5a25f480e8e6568b92ec3f195, user_id=b2a13ad25f27471792ba0758602b6e63, role_id=1ec9314b191d4bd59d71fe4d635de747)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:35.434421 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1366ca9a-07f2-4c88-88cc-6303d547a806 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:35.462671 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 305/610] 10.222.0.44 () {58 vars in 1439 bytes} [Mon May 9 20:11:35 2022] PUT /identity/v3/projects/563db7f5a25f480e8e6568b92ec3f195/users/b2a13ad25f27471792ba0758602b6e63/roles/1ec9314b191d4bd59d71fe4d635de747 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:11:35.506061 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22736233-9d29-421f-a21f-63a6bc65aa39 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:35.547326 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb9593-8379-449f-afda-e42780c9c120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:35.548036 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb9593-8379-449f-afda-e42780c9c120 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:35.548314 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb9593-8379-449f-afda-e42780c9c120 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:35.548583 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb9593-8379-449f-afda-e42780c9c120 None admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:35.549547 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deb9593-8379-449f-afda-e42780c9c120 None admin] RBAC: Adding query filter params (name=service) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:35.549851 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deb9593-8379-449f-afda-e42780c9c120 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:35.551261 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deb9593-8379-449f-afda-e42780c9c120 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:35.560684 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 306/611] 10.222.0.44 () {56 vars in 1103 bytes} [Mon May 9 20:11:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:35.566441 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1366ca9a-07f2-4c88-88cc-6303d547a806 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:35.699637 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1366ca9a-07f2-4c88-88cc-6303d547a806 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:35.734890 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dbab3e-a268-4351-a7f8-671c29d10863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:35.735697 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dbab3e-a268-4351-a7f8-671c29d10863 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:35.735968 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dbab3e-a268-4351-a7f8-671c29d10863 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:35.736233 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dbab3e-a268-4351-a7f8-671c29d10863 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:35.747612 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dbab3e-a268-4351-a7f8-671c29d10863 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:35.749090 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dbab3e-a268-4351-a7f8-671c29d10863 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:35.767161 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-a4dbab3e-a268-4351-a7f8-671c29d10863 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:35.767161 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:35.767161 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:35.767161 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:35.767161 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:35.767161 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:35.767161 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:35.767161 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:35.767161 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:35.767161 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:35.767161 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:35.767161 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:35.767161 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 20:11:35.767161 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 20:11:35.767161 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 20:11:35.769795 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 20:11:35.769795 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:35.769795 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:35.769795 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:35.769795 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:35.769795 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:35.769795 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:35.769795 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:35.769795 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:11:35.769795 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:35.769795 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:35.769795 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:35.769795 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:35.769795 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:35.769795 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:35.769795 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:35.769795 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:35.771740 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 20:11:35.771740 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 20:11:35.771740 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:35.771740 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:11:35.771740 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 306/612] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:11:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:35.774723 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb9593-8379-449f-afda-e42780c9c120 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:35.911028 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb9593-8379-449f-afda-e42780c9c120 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:35.956663 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926be018-01f7-4140-ba19-4bd2b7a24ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:35.957331 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926be018-01f7-4140-ba19-4bd2b7a24ab9 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:35.957608 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926be018-01f7-4140-ba19-4bd2b7a24ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:35.957866 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926be018-01f7-4140-ba19-4bd2b7a24ab9 None admin] PATH_INFO: `/v3/domains` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:35.958582 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926be018-01f7-4140-ba19-4bd2b7a24ab9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:35.958885 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926be018-01f7-4140-ba19-4bd2b7a24ab9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:35.960282 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926be018-01f7-4140-ba19-4bd2b7a24ab9 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:35.976253 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 307/613] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 9 20:11:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:35.981827 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dbab3e-a268-4351-a7f8-671c29d10863 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:36.019933 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be524026-45f2-47e0-9ce9-b94f87301d61 None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:36.020262 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be524026-45f2-47e0-9ce9-b94f87301d61 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:36.020501 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be524026-45f2-47e0-9ce9-b94f87301d61 None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:36.022032 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 308/614] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:11:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 20:11:36.028559 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba81ebba-bade-410a-af85-c1db4cf4b07f None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:36.028559 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba81ebba-bade-410a-af85-c1db4cf4b07f None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:36.028902 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba81ebba-bade-410a-af85-c1db4cf4b07f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:36.056469 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-ba81ebba-bade-410a-af85-c1db4cf4b07f None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:11:36.057805 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-ba81ebba-bade-410a-af85-c1db4cf4b07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:11:36.106621 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dbab3e-a268-4351-a7f8-671c29d10863 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:36.141585 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b828300d-c119-45ba-9053-1caa162fa9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:36.143028 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828300d-c119-45ba-9053-1caa162fa9dd None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:36.143550 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828300d-c119-45ba-9053-1caa162fa9dd None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:36.144070 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828300d-c119-45ba-9053-1caa162fa9dd None admin] PATH_INFO: `/v3/users/nova` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:36.160160 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b828300d-c119-45ba-9053-1caa162fa9dd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:36.162753 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b828300d-c119-45ba-9053-1caa162fa9dd None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:36.186913 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-b828300d-c119-45ba-9053-1caa162fa9dd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 09 20:11:36.186913 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:36.186913 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:36.186913 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:36.186913 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:36.186913 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:36.186913 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:36.186913 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:36.186913 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:36.186913 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:36.186913 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:36.186913 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:36.186913 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 20:11:36.186913 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 20:11:36.186913 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 20:11:36.186913 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 20:11:36.187964 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:36.187964 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:36.187964 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 20:11:36.187964 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 20:11:36.187964 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 20:11:36.187964 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 20:11:36.187964 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:36.187964 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:36.187964 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:36.187964 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:36.187964 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:36.187964 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:11:36.187964 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:36.187964 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:36.187964 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:36.187964 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:36.187964 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:36.187964 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:36.188946 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:36.188946 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:36.188946 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 20:11:36.188946 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 20:11:36.188946 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 20:11:36.188946 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 20:11:36.188946 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 20:11:36.188946 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 20:11:36.188946 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 09 20:11:36.188946 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:11:36.192338 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 307/615] 10.222.0.44 () {56 vars in 1093 bytes} [Mon May 9 20:11:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:36.197321 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b828300d-c119-45ba-9053-1caa162fa9dd None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:36.213203 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 309/616] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:11:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 20:11:36.295195 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba81ebba-bade-410a-af85-c1db4cf4b07f None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:36.361248 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b828300d-c119-45ba-9053-1caa162fa9dd None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:36.432484 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec5fd96-cbf4-4ed6-8e66-ea95ae1b1bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:36.433240 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec5fd96-cbf4-4ed6-8e66-ea95ae1b1bdb None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:36.433459 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec5fd96-cbf4-4ed6-8e66-ea95ae1b1bdb None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:36.433703 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec5fd96-cbf4-4ed6-8e66-ea95ae1b1bdb None admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:36.434631 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec5fd96-cbf4-4ed6-8e66-ea95ae1b1bdb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:36.434936 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec5fd96-cbf4-4ed6-8e66-ea95ae1b1bdb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:36.436386 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec5fd96-cbf4-4ed6-8e66-ea95ae1b1bdb None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:36.439079 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba81ebba-bade-410a-af85-c1db4cf4b07f None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:36.467548 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 308/617] 10.222.0.44 () {56 vars in 1133 bytes} [Mon May 9 20:11:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:36.472902 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec5fd96-cbf4-4ed6-8e66-ea95ae1b1bdb None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:36.474848 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f9e50-d12a-432d-9d9d-771ce8032f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:36.475938 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f9e50-d12a-432d-9d9d-771ce8032f42 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:36.476436 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f9e50-d12a-432d-9d9d-771ce8032f42 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:36.476910 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f9e50-d12a-432d-9d9d-771ce8032f42 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:36.488282 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2f9e50-d12a-432d-9d9d-771ce8032f42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:11:36.496192 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-ec2f9e50-d12a-432d-9d9d-771ce8032f42 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 20:11:36.496192 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:36.496192 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:36.496192 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:36.496192 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:36.496192 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:36.496192 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:36.496192 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:36.496192 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:36.496192 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:36.496192 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:36.496192 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:36.496192 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:11:36.496192 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:11:36.496192 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:11:36.496192 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:11:36.497120 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:11:36.497120 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:11:36.497120 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:11:36.497120 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:11:36.497120 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:36.497120 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:36.497120 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:36.497120 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:36.497120 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:36.497120 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:36.497120 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:36.497120 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:11:36.497120 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:36.497120 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:36.497120 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:36.497120 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:36.497942 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:36.497942 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:36.497942 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:36.497942 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:36.497942 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:11:36.497942 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:11:36.497942 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:11:36.497942 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:11:36.497942 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:11:36.497942 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:11:36.497942 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 20:11:36.497942 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:36.500613 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 310/618] 10.222.0.44 () {56 vars in 1102 bytes} [Mon May 9 20:11:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 20:11:36.506599 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f9e50-d12a-432d-9d9d-771ce8032f42 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:36.618408 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec5fd96-cbf4-4ed6-8e66-ea95ae1b1bdb None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:36.652666 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36feee8a-b62f-4424-88dc-b1546495ef8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:36.653720 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36feee8a-b62f-4424-88dc-b1546495ef8e None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:36.654213 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36feee8a-b62f-4424-88dc-b1546495ef8e None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:36.654684 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36feee8a-b62f-4424-88dc-b1546495ef8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:36.690214 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f9e50-d12a-432d-9d9d-771ce8032f42 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:36.721616 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36feee8a-b62f-4424-88dc-b1546495ef8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:36.723154 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36feee8a-b62f-4424-88dc-b1546495ef8e None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:36.723674 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2550a119-5ee3-455f-b34b-8c6c5777f36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:36.724514 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2550a119-5ee3-455f-b34b-8c6c5777f36b None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:36.724945 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2550a119-5ee3-455f-b34b-8c6c5777f36b None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:36.725375 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2550a119-5ee3-455f-b34b-8c6c5777f36b None admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:36.726259 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2550a119-5ee3-455f-b34b-8c6c5777f36b None admin] RBAC: Adding query filter params (name=service) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:36.726771 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2550a119-5ee3-455f-b34b-8c6c5777f36b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:36.729008 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2550a119-5ee3-455f-b34b-8c6c5777f36b None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:36.740491 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 311/619] 10.222.0.44 () {56 vars in 1103 bytes} [Mon May 9 20:11:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:36.748774 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2550a119-5ee3-455f-b34b-8c6c5777f36b None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:36.846843 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 309/620] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 9 20:11:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 09 20:11:36.853052 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36feee8a-b62f-4424-88dc-b1546495ef8e None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:36.967819 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2550a119-5ee3-455f-b34b-8c6c5777f36b None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:36.997963 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36feee8a-b62f-4424-88dc-b1546495ef8e None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:37.036996 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce1acf7-81d6-40fb-9c06-ce41cd057f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:37.038480 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce1acf7-81d6-40fb-9c06-ce41cd057f69 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:37.038986 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce1acf7-81d6-40fb-9c06-ce41cd057f69 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:37.039461 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce1acf7-81d6-40fb-9c06-ce41cd057f69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:37.044685 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bb6fe3-a6c8-4c78-b8b6-b9e1fbc032aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:37.045482 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb6fe3-a6c8-4c78-b8b6-b9e1fbc032aa None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:37.045760 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb6fe3-a6c8-4c78-b8b6-b9e1fbc032aa None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:37.046030 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb6fe3-a6c8-4c78-b8b6-b9e1fbc032aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:37.050722 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce1acf7-81d6-40fb-9c06-ce41cd057f69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:37.052363 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce1acf7-81d6-40fb-9c06-ce41cd057f69 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:37.061630 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bb6fe3-a6c8-4c78-b8b6-b9e1fbc032aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:37.063100 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bb6fe3-a6c8-4c78-b8b6-b9e1fbc032aa None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:37.070062 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-5ce1acf7-81d6-40fb-9c06-ce41cd057f69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:37.070062 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:37.070062 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:37.070062 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:37.070062 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:37.070062 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:37.070062 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:37.070062 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:37.070062 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:37.070062 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:37.070062 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:37.070062 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:37.070062 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 20:11:37.070062 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 20:11:37.070062 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 20:11:37.070912 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 20:11:37.070912 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:37.070912 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:37.070912 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:37.070912 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:37.070912 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:37.070912 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:37.070912 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:37.070912 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:11:37.070912 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:37.070912 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:37.070912 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:37.070912 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:37.070912 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:37.070912 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:37.070912 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:37.070912 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:37.071816 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 20:11:37.071816 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 20:11:37.071816 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:37.071816 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:37.071816 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 312/621] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:11:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:37.081749 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce1acf7-81d6-40fb-9c06-ce41cd057f69 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:37.101628 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-e6bb6fe3-a6c8-4c78-b8b6-b9e1fbc032aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:37.101628 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:37.101628 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:37.101628 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:37.101628 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:37.101628 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:37.101628 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:37.101628 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:37.101628 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:37.101628 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:37.101628 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:37.101628 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:37.101628 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 20:11:37.101628 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 20:11:37.101628 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 20:11:37.102585 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 20:11:37.102585 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:37.102585 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:37.102585 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:37.102585 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:37.102585 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:37.102585 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:37.102585 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:37.102585 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:11:37.102585 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:37.102585 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:37.102585 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:37.102585 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:37.102585 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:37.102585 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:37.102585 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:37.102585 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:37.103513 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 20:11:37.103513 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 20:11:37.103513 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:37.103513 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:11:37.103513 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 310/622] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:11:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:37.108459 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bb6fe3-a6c8-4c78-b8b6-b9e1fbc032aa None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:37.223022 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bb6fe3-a6c8-4c78-b8b6-b9e1fbc032aa None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:37.259426 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5439ecbc-4741-4a24-9be9-6f63b054c470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:37.260024 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439ecbc-4741-4a24-9be9-6f63b054c470 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:37.260305 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439ecbc-4741-4a24-9be9-6f63b054c470 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:37.260579 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439ecbc-4741-4a24-9be9-6f63b054c470 None admin] PATH_INFO: `/v3/domains` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:37.261590 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5439ecbc-4741-4a24-9be9-6f63b054c470 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:37.261900 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5439ecbc-4741-4a24-9be9-6f63b054c470 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:37.263271 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5439ecbc-4741-4a24-9be9-6f63b054c470 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:37.276024 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 311/623] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 9 20:11:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:37.285869 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5439ecbc-4741-4a24-9be9-6f63b054c470 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:37.315092 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce1acf7-81d6-40fb-9c06-ce41cd057f69 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:37.405245 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5439ecbc-4741-4a24-9be9-6f63b054c470 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:37.407066 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd15e4a-f125-46e6-95d0-bd03235de5d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:37.408796 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd15e4a-f125-46e6-95d0-bd03235de5d1 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:37.409081 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd15e4a-f125-46e6-95d0-bd03235de5d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:37.409358 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd15e4a-f125-46e6-95d0-bd03235de5d1 None admin] PATH_INFO: `/v3/domains` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:37.410099 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd15e4a-f125-46e6-95d0-bd03235de5d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:37.410408 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd15e4a-f125-46e6-95d0-bd03235de5d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:37.411902 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd15e4a-f125-46e6-95d0-bd03235de5d1 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:37.427766 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 313/624] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 9 20:11:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:37.429373 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12036319-74fa-433c-9510-7f233603e251 None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:37.429661 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12036319-74fa-433c-9510-7f233603e251 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:37.429936 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12036319-74fa-433c-9510-7f233603e251 None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:37.431459 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 314/625] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:11:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:11:37.433218 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12036319-74fa-433c-9510-7f233603e251 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:37.451778 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fdb73a-3def-434b-bc19-47f144213171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:37.452811 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fdb73a-3def-434b-bc19-47f144213171 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:37.453087 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fdb73a-3def-434b-bc19-47f144213171 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:37.453352 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fdb73a-3def-434b-bc19-47f144213171 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:37.461653 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fdb73a-3def-434b-bc19-47f144213171 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:37.463534 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fdb73a-3def-434b-bc19-47f144213171 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:37.480888 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-51fdb73a-3def-434b-bc19-47f144213171 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 20:11:37.480888 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:37.480888 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:37.480888 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:37.480888 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:37.480888 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:37.480888 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:37.480888 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:37.480888 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:37.480888 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:37.480888 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:37.480888 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:37.480888 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 20:11:37.480888 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 20:11:37.480888 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 20:11:37.482126 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 20:11:37.482126 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:37.482126 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:37.482126 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:37.482126 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:37.482126 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:37.482126 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:37.482126 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:37.482126 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:11:37.482126 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:37.482126 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:37.482126 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:37.482126 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:37.482126 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:37.482126 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:37.482126 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:37.482126 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:37.483004 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 20:11:37.483004 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 20:11:37.483004 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 20:11:37.483004 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 20:11:37.483004 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 20:11:37.483004 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 20:11:37.483004 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 20:11:37.483004 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:11:37.483488 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 312/626] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 9 20:11:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:37.487439 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb9cfe-399d-421b-83be-b5e5961b03b4 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:37.487439 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb9cfe-399d-421b-83be-b5e5961b03b4 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:37.487439 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb9cfe-399d-421b-83be-b5e5961b03b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:37.504736 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-00fb9cfe-399d-421b-83be-b5e5961b03b4 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:11:37.506190 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-00fb9cfe-399d-421b-83be-b5e5961b03b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:11:37.557041 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12036319-74fa-433c-9510-7f233603e251 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:37.585548 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 313/627] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:11:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 20:11:37.586401 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb9cfe-399d-421b-83be-b5e5961b03b4 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:37.591818 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7509100a-7e41-43e8-bd1c-01a1c1ef9470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:37.592811 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509100a-7e41-43e8-bd1c-01a1c1ef9470 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:37.593264 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509100a-7e41-43e8-bd1c-01a1c1ef9470 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:37.593728 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509100a-7e41-43e8-bd1c-01a1c1ef9470 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:37.601889 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7509100a-7e41-43e8-bd1c-01a1c1ef9470 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:37.603717 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7509100a-7e41-43e8-bd1c-01a1c1ef9470 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:37.619061 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-7509100a-7e41-43e8-bd1c-01a1c1ef9470 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 09 20:11:37.619061 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:37.619061 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:37.619061 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:37.619061 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:37.619061 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:37.619061 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:37.619061 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:37.619061 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:37.619061 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:37.619061 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:37.619061 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:37.619061 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 20:11:37.619061 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 20:11:37.619061 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 20:11:37.619061 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 20:11:37.620081 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:37.620081 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:37.620081 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 20:11:37.620081 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 20:11:37.620081 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 20:11:37.620081 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 20:11:37.620081 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:37.620081 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:37.620081 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:37.620081 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:37.620081 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:37.620081 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:11:37.620081 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:37.620081 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:37.620081 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:37.620081 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:37.620081 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:37.620081 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:37.621036 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:37.621036 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:37.621036 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 20:11:37.621036 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 20:11:37.621036 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 20:11:37.621036 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 20:11:37.621036 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 20:11:37.621036 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 20:11:37.621036 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 09 20:11:37.621036 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:37.621036 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 315/628] 10.222.0.44 () {56 vars in 1096 bytes} [Mon May 9 20:11:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 20:11:37.622113 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04591b3-a1d2-4ca5-9363-cd13be21c6c9 None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:37.622113 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04591b3-a1d2-4ca5-9363-cd13be21c6c9 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:37.622401 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04591b3-a1d2-4ca5-9363-cd13be21c6c9 None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:37.625322 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 316/629] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:11:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:11:37.625322 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04591b3-a1d2-4ca5-9363-cd13be21c6c9 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:37.689098 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb9cfe-399d-421b-83be-b5e5961b03b4 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:37.721669 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcf4a11-0e5a-4e6e-a1f1-dc33875aaa7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:37.722716 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf4a11-0e5a-4e6e-a1f1-dc33875aaa7c None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:37.723278 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf4a11-0e5a-4e6e-a1f1-dc33875aaa7c None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:37.723785 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf4a11-0e5a-4e6e-a1f1-dc33875aaa7c None admin] PATH_INFO: `/v3/projects` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:37.724712 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcf4a11-0e5a-4e6e-a1f1-dc33875aaa7c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:37.725171 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcf4a11-0e5a-4e6e-a1f1-dc33875aaa7c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:37.726786 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcf4a11-0e5a-4e6e-a1f1-dc33875aaa7c None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:37.731423 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04591b3-a1d2-4ca5-9363-cd13be21c6c9 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:37.743362 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 314/630] 10.222.0.44 () {56 vars in 1148 bytes} [Mon May 9 20:11:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:37.743362 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcf4a11-0e5a-4e6e-a1f1-dc33875aaa7c None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:37.774542 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b785424-4db2-41ca-9be3-7deb86c627d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:37.775334 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b785424-4db2-41ca-9be3-7deb86c627d4 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:37.775668 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b785424-4db2-41ca-9be3-7deb86c627d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:37.776109 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b785424-4db2-41ca-9be3-7deb86c627d4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:37.786828 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b785424-4db2-41ca-9be3-7deb86c627d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:11:37.794470 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-5b785424-4db2-41ca-9be3-7deb86c627d4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 20:11:37.794470 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:37.794470 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:37.794470 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:37.794470 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:37.794470 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:37.794470 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:37.794470 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:37.794470 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:37.794470 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:37.794470 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:37.794470 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:37.794470 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:11:37.794470 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:11:37.794470 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:11:37.794470 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:11:37.801301 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:11:37.801301 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:11:37.801301 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:11:37.801301 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:11:37.801301 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:37.801301 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:37.801301 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:37.801301 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:37.801301 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:37.801301 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:37.801301 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:37.801301 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:11:37.801301 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:37.801301 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:37.801301 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:37.801301 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:37.802179 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:37.802179 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:37.802179 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:37.802179 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:37.802179 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:11:37.802179 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:11:37.802179 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:11:37.802179 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:11:37.802179 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:11:37.802179 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:11:37.802179 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 20:11:37.802179 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:37.802179 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 317/631] 10.222.0.44 () {56 vars in 1102 bytes} [Mon May 9 20:11:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:37.802179 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd9893a-48f0-41a5-b726-a97192201fbe None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:37.802954 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd9893a-48f0-41a5-b726-a97192201fbe None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:37.802954 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd9893a-48f0-41a5-b726-a97192201fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:37.815817 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-3bd9893a-48f0-41a5-b726-a97192201fbe None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:11:37.816939 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-3bd9893a-48f0-41a5-b726-a97192201fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:11:37.859357 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcf4a11-0e5a-4e6e-a1f1-dc33875aaa7c None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:37.903982 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2916cbd-8c24-4105-84d9-e3a093d4fccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:37.904991 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2916cbd-8c24-4105-84d9-e3a093d4fccc None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:37.905421 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2916cbd-8c24-4105-84d9-e3a093d4fccc None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:37.905812 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2916cbd-8c24-4105-84d9-e3a093d4fccc None admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:37.906863 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2916cbd-8c24-4105-84d9-e3a093d4fccc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:37.907212 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2916cbd-8c24-4105-84d9-e3a093d4fccc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:37.909513 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2916cbd-8c24-4105-84d9-e3a093d4fccc None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:37.922731 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 318/632] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:11:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 20:11:37.923634 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd9893a-48f0-41a5-b726-a97192201fbe None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:37.939249 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 315/633] 10.222.0.44 () {56 vars in 1135 bytes} [Mon May 9 20:11:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:37.940703 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2916cbd-8c24-4105-84d9-e3a093d4fccc None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:38.034683 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd9893a-48f0-41a5-b726-a97192201fbe None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:38.038273 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2916cbd-8c24-4105-84d9-e3a093d4fccc None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:38.073016 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02baa48-0a38-4cbd-bb09-e30a72eb4670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:38.073592 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02baa48-0a38-4cbd-bb09-e30a72eb4670 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:38.073868 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02baa48-0a38-4cbd-bb09-e30a72eb4670 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:38.074135 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02baa48-0a38-4cbd-bb09-e30a72eb4670 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:38.074755 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2016c3a5-637e-418d-9b92-b83c7dc0ddcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:38.074958 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02baa48-0a38-4cbd-bb09-e30a72eb4670 None admin] RBAC: Adding query filter params (role.id=1ec9314b191d4bd59d71fe4d635de747, scope.project.id=563db7f5a25f480e8e6568b92ec3f195, user.id=eb59440b21074d9da15679dc2d745f72) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:38.075266 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02baa48-0a38-4cbd-bb09-e30a72eb4670 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:38.075470 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2016c3a5-637e-418d-9b92-b83c7dc0ddcf None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:38.075727 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2016c3a5-637e-418d-9b92-b83c7dc0ddcf None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:38.075997 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2016c3a5-637e-418d-9b92-b83c7dc0ddcf None admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:38.076750 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2016c3a5-637e-418d-9b92-b83c7dc0ddcf None admin] RBAC: Adding query filter params (name=service) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:38.076853 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02baa48-0a38-4cbd-bb09-e30a72eb4670 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:38.077051 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2016c3a5-637e-418d-9b92-b83c7dc0ddcf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:38.078421 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2016c3a5-637e-418d-9b92-b83c7dc0ddcf None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:38.091670 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 319/634] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 9 20:11:37 2022] GET /identity/v3/role_assignments?user.id=eb59440b21074d9da15679dc2d745f72&scope.project.id=563db7f5a25f480e8e6568b92ec3f195&role.id=1ec9314b191d4bd59d71fe4d635de747 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:38.091670 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02baa48-0a38-4cbd-bb09-e30a72eb4670 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:38.097246 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 316/635] 10.222.0.44 () {56 vars in 1103 bytes} [Mon May 9 20:11:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:38.098266 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2016c3a5-637e-418d-9b92-b83c7dc0ddcf None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:38.215782 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2016c3a5-637e-418d-9b92-b83c7dc0ddcf None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:38.217880 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02baa48-0a38-4cbd-bb09-e30a72eb4670 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:38.252113 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07466924-589c-4455-bf19-9c3469559a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:38.252964 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07466924-589c-4455-bf19-9c3469559a55 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:38.253375 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07466924-589c-4455-bf19-9c3469559a55 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:38.253647 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07466924-589c-4455-bf19-9c3469559a55 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:38.262395 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491906ef-ed43-402f-a7be-10d632a23263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:38.263273 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491906ef-ed43-402f-a7be-10d632a23263 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:38.263647 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491906ef-ed43-402f-a7be-10d632a23263 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:38.263982 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491906ef-ed43-402f-a7be-10d632a23263 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:38.265016 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07466924-589c-4455-bf19-9c3469559a55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:11:38.273116 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-07466924-589c-4455-bf19-9c3469559a55 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 20:11:38.273116 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:38.273116 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:38.273116 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:38.273116 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:38.273116 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:38.273116 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:38.273116 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:38.273116 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:38.273116 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:38.273116 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:38.273116 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:38.273116 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:11:38.273116 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:11:38.273116 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:11:38.273116 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:11:38.274279 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:11:38.274279 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:11:38.274279 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:11:38.274279 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:11:38.274279 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:38.274279 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:38.274279 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:38.274279 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:38.274279 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:38.274279 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:38.274279 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:38.274279 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:11:38.274279 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:38.274279 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:38.274279 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:38.274279 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:38.275129 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:38.275129 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:38.275129 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:38.275129 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:38.275129 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:11:38.275129 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:11:38.275129 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:11:38.275129 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:11:38.275129 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:11:38.275129 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:11:38.275129 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 20:11:38.275129 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:11:38.275129 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 317/636] 10.222.0.44 () {56 vars in 1102 bytes} [Mon May 9 20:11:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:38.276663 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07466924-589c-4455-bf19-9c3469559a55 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:38.281349 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491906ef-ed43-402f-a7be-10d632a23263 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:38.282801 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491906ef-ed43-402f-a7be-10d632a23263 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:38.302256 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-491906ef-ed43-402f-a7be-10d632a23263 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:38.302256 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:38.302256 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:38.302256 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:38.302256 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:38.302256 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:38.302256 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:38.302256 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:38.302256 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:38.302256 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:38.302256 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:38.302256 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:38.302256 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 20:11:38.302256 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 20:11:38.302256 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 20:11:38.304338 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 20:11:38.304338 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:38.304338 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:38.304338 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:38.304338 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:38.304338 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:38.304338 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:38.304338 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:38.304338 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:11:38.304338 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:38.304338 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:38.304338 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:38.304338 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:38.304338 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:38.304338 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:38.304338 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:38.304338 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:38.305520 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 20:11:38.305520 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 20:11:38.305520 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:38.305520 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:38.305520 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 320/637] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:11:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:38.305520 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0ffe40-81bb-4df1-8559-6da4e36a3bfe None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:38.305520 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0ffe40-81bb-4df1-8559-6da4e36a3bfe None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:38.305520 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0ffe40-81bb-4df1-8559-6da4e36a3bfe None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:38.310775 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 321/638] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:11:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:11:38.310775 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0ffe40-81bb-4df1-8559-6da4e36a3bfe None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:38.393824 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07466924-589c-4455-bf19-9c3469559a55 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:38.417363 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0ffe40-81bb-4df1-8559-6da4e36a3bfe None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:38.426713 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb09b917-e144-4196-96c7-d1f28a86d7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:38.427524 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb09b917-e144-4196-96c7-d1f28a86d7e3 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:38.427804 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb09b917-e144-4196-96c7-d1f28a86d7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:38.428088 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb09b917-e144-4196-96c7-d1f28a86d7e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:38.438376 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb09b917-e144-4196-96c7-d1f28a86d7e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:38.440387 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb09b917-e144-4196-96c7-d1f28a86d7e3 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:38.451367 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ccb987-39e5-4841-aec6-a7e47b15cb9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:38.452048 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ccb987-39e5-4841-aec6-a7e47b15cb9f None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:38.453007 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ccb987-39e5-4841-aec6-a7e47b15cb9f None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:38.453007 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ccb987-39e5-4841-aec6-a7e47b15cb9f None admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:38.453306 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ccb987-39e5-4841-aec6-a7e47b15cb9f None admin] RBAC: Adding query filter params (name=service) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:38.453601 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ccb987-39e5-4841-aec6-a7e47b15cb9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:38.454936 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ccb987-39e5-4841-aec6-a7e47b15cb9f None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:38.457689 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-bb09b917-e144-4196-96c7-d1f28a86d7e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:38.457689 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:38.457689 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:38.457689 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:38.457689 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:38.457689 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:38.457689 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:38.457689 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:38.457689 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:38.457689 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:38.457689 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:38.457689 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:38.457689 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 20:11:38.457689 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 20:11:38.457689 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 20:11:38.458542 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 20:11:38.458542 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:38.458542 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:38.458542 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:38.458542 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:38.458542 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:38.458542 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:38.458542 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:38.458542 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:11:38.458542 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:38.458542 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:38.458542 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:38.458542 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:38.458542 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:38.458542 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:38.458542 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:38.458542 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:38.459443 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 20:11:38.459443 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 20:11:38.459443 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:38.459443 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:11:38.459443 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 318/639] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:11:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:38.459734 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb09b917-e144-4196-96c7-d1f28a86d7e3 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:38.464175 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 322/640] 10.222.0.44 () {56 vars in 1103 bytes} [Mon May 9 20:11:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:38.464926 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b87c2-f045-437c-8ffd-78e2a34766bb None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:38.465223 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b87c2-f045-437c-8ffd-78e2a34766bb None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:38.465918 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b87c2-f045-437c-8ffd-78e2a34766bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:38.486181 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-812b87c2-f045-437c-8ffd-78e2a34766bb None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:11:38.487817 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-812b87c2-f045-437c-8ffd-78e2a34766bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:11:38.558903 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 323/641] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:11:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 20:11:38.559789 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb09b917-e144-4196-96c7-d1f28a86d7e3 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:38.560524 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812b87c2-f045-437c-8ffd-78e2a34766bb None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:38.604435 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72336dd3-d791-4a39-b1a2-b4a81b560f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:38.605088 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72336dd3-d791-4a39-b1a2-b4a81b560f00 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:38.605381 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72336dd3-d791-4a39-b1a2-b4a81b560f00 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:38.605644 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72336dd3-d791-4a39-b1a2-b4a81b560f00 None admin] PATH_INFO: `/v3/domains` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:38.606361 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72336dd3-d791-4a39-b1a2-b4a81b560f00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:38.606669 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72336dd3-d791-4a39-b1a2-b4a81b560f00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:38.608063 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72336dd3-d791-4a39-b1a2-b4a81b560f00 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:38.624746 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 319/642] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 9 20:11:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:38.624746 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72336dd3-d791-4a39-b1a2-b4a81b560f00 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:38.657094 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812b87c2-f045-437c-8ffd-78e2a34766bb None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:38.691811 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ae2c1b-8c8b-4e75-b71b-acdc342c5d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:38.692484 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae2c1b-8c8b-4e75-b71b-acdc342c5d94 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:38.692772 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae2c1b-8c8b-4e75-b71b-acdc342c5d94 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:38.693044 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae2c1b-8c8b-4e75-b71b-acdc342c5d94 None admin] PATH_INFO: `/v3/domains` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:38.693798 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ae2c1b-8c8b-4e75-b71b-acdc342c5d94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:38.694107 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ae2c1b-8c8b-4e75-b71b-acdc342c5d94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:38.695503 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ae2c1b-8c8b-4e75-b71b-acdc342c5d94 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:38.707270 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 324/643] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 9 20:11:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:38.708118 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ae2c1b-8c8b-4e75-b71b-acdc342c5d94 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:38.720802 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72336dd3-d791-4a39-b1a2-b4a81b560f00 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:38.754374 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1f78b0-073b-4613-8517-561012cb786c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:38.755149 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f78b0-073b-4613-8517-561012cb786c None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:38.755444 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f78b0-073b-4613-8517-561012cb786c None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:38.755714 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f78b0-073b-4613-8517-561012cb786c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:38.765890 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1f78b0-073b-4613-8517-561012cb786c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:38.767326 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1f78b0-073b-4613-8517-561012cb786c None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:38.785898 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-6e1f78b0-073b-4613-8517-561012cb786c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:38.785898 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:38.785898 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:38.785898 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:38.785898 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:38.785898 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:38.785898 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:38.785898 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:38.785898 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:38.785898 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:38.785898 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:38.785898 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:38.785898 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 20:11:38.785898 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 20:11:38.785898 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 20:11:38.787138 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 20:11:38.787138 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:38.787138 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:38.787138 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:38.787138 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:38.787138 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:38.787138 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:38.787138 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:38.787138 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:11:38.787138 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:38.787138 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:38.787138 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:38.787138 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:38.787138 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:38.787138 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:38.787138 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:38.787138 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:38.788271 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 20:11:38.788271 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 20:11:38.788271 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:38.788271 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:11:38.793370 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 320/644] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:11:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:38.793370 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1f78b0-073b-4613-8517-561012cb786c None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:38.808648 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ae2c1b-8c8b-4e75-b71b-acdc342c5d94 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:38.841713 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614a6a47-0ee8-469f-9a08-fa6157d22790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:38.842501 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a6a47-0ee8-469f-9a08-fa6157d22790 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:38.842782 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a6a47-0ee8-469f-9a08-fa6157d22790 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:38.843056 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a6a47-0ee8-469f-9a08-fa6157d22790 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:38.853679 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614a6a47-0ee8-469f-9a08-fa6157d22790 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:11:38.861907 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-614a6a47-0ee8-469f-9a08-fa6157d22790 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 20:11:38.861907 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:38.861907 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:38.861907 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:38.861907 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:38.861907 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:38.861907 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:38.861907 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:38.861907 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:38.861907 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:38.861907 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:38.861907 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:38.861907 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:11:38.861907 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:11:38.861907 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:11:38.861907 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:11:38.863019 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:11:38.863019 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:11:38.863019 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:11:38.863019 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:11:38.863019 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:38.863019 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:38.863019 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:38.863019 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:38.863019 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:38.863019 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:38.863019 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:38.863019 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:11:38.863019 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:38.863019 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:38.863019 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:38.863019 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:38.864034 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:38.864034 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:38.864034 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:38.864034 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:38.864034 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:11:38.864034 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:11:38.864034 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:11:38.864034 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:11:38.864034 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:11:38.864034 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:11:38.864034 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 20:11:38.864034 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:38.867698 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 325/645] 10.222.0.44 () {56 vars in 1102 bytes} [Mon May 9 20:11:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:38.868688 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614a6a47-0ee8-469f-9a08-fa6157d22790 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:38.889059 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1f78b0-073b-4613-8517-561012cb786c None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:38.921834 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5551ea-8df7-4f72-bb2c-bcae04397ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:38.922703 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5551ea-8df7-4f72-bb2c-bcae04397ac0 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:38.923043 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5551ea-8df7-4f72-bb2c-bcae04397ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:38.923429 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5551ea-8df7-4f72-bb2c-bcae04397ac0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:38.930969 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5551ea-8df7-4f72-bb2c-bcae04397ac0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:38.932556 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5551ea-8df7-4f72-bb2c-bcae04397ac0 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:38.946079 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-4c5551ea-8df7-4f72-bb2c-bcae04397ac0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 20:11:38.946079 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:38.946079 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:38.946079 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:38.946079 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:38.946079 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:38.946079 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:38.946079 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:38.946079 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:38.946079 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:38.946079 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:38.946079 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:38.946079 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 20:11:38.946079 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 20:11:38.946079 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 20:11:38.947176 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 20:11:38.947176 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:38.947176 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:38.947176 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:38.947176 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:38.947176 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:38.947176 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:38.947176 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:38.947176 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:11:38.947176 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:38.947176 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:38.947176 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:38.947176 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:38.947176 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:38.947176 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:38.947176 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:38.947176 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:38.948335 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 20:11:38.948335 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 20:11:38.948335 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 20:11:38.948335 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 20:11:38.948335 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 20:11:38.948335 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 20:11:38.948335 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 20:11:38.948335 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:11:38.954581 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 321/646] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 9 20:11:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:38.954581 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5551ea-8df7-4f72-bb2c-bcae04397ac0 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:38.968938 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614a6a47-0ee8-469f-9a08-fa6157d22790 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:39.011046 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9842b702-3b5d-495e-96b7-312d9ee72eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:39.011877 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842b702-3b5d-495e-96b7-312d9ee72eaa None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:39.012159 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842b702-3b5d-495e-96b7-312d9ee72eaa None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:39.012429 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842b702-3b5d-495e-96b7-312d9ee72eaa None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:39.021775 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9842b702-3b5d-495e-96b7-312d9ee72eaa None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:39.023094 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9842b702-3b5d-495e-96b7-312d9ee72eaa None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:39.038490 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-9842b702-3b5d-495e-96b7-312d9ee72eaa None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 09 20:11:39.038490 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:39.038490 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:39.038490 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:39.038490 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:39.038490 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:39.038490 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:39.038490 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:39.038490 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:39.038490 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:39.038490 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:39.038490 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:39.038490 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 20:11:39.038490 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 20:11:39.038490 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 20:11:39.038490 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 20:11:39.040014 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:39.040014 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:39.040014 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 20:11:39.040014 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 20:11:39.040014 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 20:11:39.040014 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 20:11:39.040014 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:39.040014 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:39.040014 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:39.040014 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:39.040014 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:39.040014 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:11:39.040014 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:39.040014 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:39.040014 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:39.040014 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:39.040014 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:39.040014 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:39.040996 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:39.040996 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:39.040996 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 20:11:39.040996 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 20:11:39.040996 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 20:11:39.040996 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 20:11:39.040996 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 20:11:39.040996 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 20:11:39.040996 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 09 20:11:39.040996 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:39.040996 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 326/647] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 9 20:11:38 2022] GET /identity/v3/users/cinder => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:39.041602 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9842b702-3b5d-495e-96b7-312d9ee72eaa None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:39.060452 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5551ea-8df7-4f72-bb2c-bcae04397ac0 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:39.094780 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcbc8e9-68ab-446e-b691-8ff0efb502dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:39.095582 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcbc8e9-68ab-446e-b691-8ff0efb502dc None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:39.096318 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcbc8e9-68ab-446e-b691-8ff0efb502dc None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:39.097069 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcbc8e9-68ab-446e-b691-8ff0efb502dc None admin] PATH_INFO: `/v3/domains` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:39.097779 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcbc8e9-68ab-446e-b691-8ff0efb502dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:39.098088 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcbc8e9-68ab-446e-b691-8ff0efb502dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:39.099477 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcbc8e9-68ab-446e-b691-8ff0efb502dc None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:39.115439 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 322/648] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 9 20:11:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:39.115439 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcbc8e9-68ab-446e-b691-8ff0efb502dc None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:39.145832 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9842b702-3b5d-495e-96b7-312d9ee72eaa None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:39.177852 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49294ba-0546-46a5-8620-6e050bef8032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:39.178439 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49294ba-0546-46a5-8620-6e050bef8032 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:39.178713 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49294ba-0546-46a5-8620-6e050bef8032 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:39.178981 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49294ba-0546-46a5-8620-6e050bef8032 None admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:39.179742 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49294ba-0546-46a5-8620-6e050bef8032 None admin] RBAC: Adding query filter params (name=service) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:39.180043 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49294ba-0546-46a5-8620-6e050bef8032 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:39.181398 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49294ba-0546-46a5-8620-6e050bef8032 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:39.194078 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 327/649] 10.222.0.44 () {56 vars in 1103 bytes} [Mon May 9 20:11:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:39.194078 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49294ba-0546-46a5-8620-6e050bef8032 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:39.216974 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcbc8e9-68ab-446e-b691-8ff0efb502dc None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:39.253254 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f125f5ef-fd18-462b-9036-e02adb7e0e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:39.253985 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f125f5ef-fd18-462b-9036-e02adb7e0e50 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:39.254338 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f125f5ef-fd18-462b-9036-e02adb7e0e50 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:39.254720 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f125f5ef-fd18-462b-9036-e02adb7e0e50 None admin] PATH_INFO: `/v3/projects` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:39.255595 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f125f5ef-fd18-462b-9036-e02adb7e0e50 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:39.256260 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f125f5ef-fd18-462b-9036-e02adb7e0e50 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:39.257754 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f125f5ef-fd18-462b-9036-e02adb7e0e50 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:39.273675 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 323/650] 10.222.0.44 () {56 vars in 1148 bytes} [Mon May 9 20:11:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:39.273675 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f125f5ef-fd18-462b-9036-e02adb7e0e50 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:39.296302 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49294ba-0546-46a5-8620-6e050bef8032 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:39.332793 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e5fdec-abd8-432b-900e-c6325fa3d08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:39.333719 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e5fdec-abd8-432b-900e-c6325fa3d08e None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:39.334145 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e5fdec-abd8-432b-900e-c6325fa3d08e None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:39.334521 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e5fdec-abd8-432b-900e-c6325fa3d08e None admin] PATH_INFO: `/v3/users` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:39.335557 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e5fdec-abd8-432b-900e-c6325fa3d08e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:39.335931 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e5fdec-abd8-432b-900e-c6325fa3d08e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:39.337490 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e5fdec-abd8-432b-900e-c6325fa3d08e None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:39.358648 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 328/651] 10.222.0.44 () {56 vars in 1137 bytes} [Mon May 9 20:11:39 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:39.358648 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e5fdec-abd8-432b-900e-c6325fa3d08e None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:39.381236 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f125f5ef-fd18-462b-9036-e02adb7e0e50 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:39.414097 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00461379-fab9-48d4-866f-4287993fb0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:39.414883 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00461379-fab9-48d4-866f-4287993fb0b0 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:39.415155 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00461379-fab9-48d4-866f-4287993fb0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:39.415459 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00461379-fab9-48d4-866f-4287993fb0b0 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:39.422694 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00461379-fab9-48d4-866f-4287993fb0b0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:39.424752 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00461379-fab9-48d4-866f-4287993fb0b0 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:39.438590 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-00461379-fab9-48d4-866f-4287993fb0b0 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 09 20:11:39.438590 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:39.438590 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:39.438590 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:39.438590 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:39.438590 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:39.438590 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:39.438590 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:39.438590 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:39.438590 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:39.438590 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:39.438590 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:39.438590 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 20:11:39.438590 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 20:11:39.438590 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 20:11:39.438590 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 20:11:39.440393 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:39.440393 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:39.440393 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 20:11:39.440393 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 20:11:39.440393 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 20:11:39.440393 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 20:11:39.440393 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:39.440393 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:39.440393 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:39.440393 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:39.440393 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:39.440393 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:11:39.440393 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:39.440393 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:39.440393 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:39.440393 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:39.440393 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:39.440393 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:39.441443 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:39.441443 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:39.441443 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 20:11:39.441443 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 20:11:39.441443 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 20:11:39.441443 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 20:11:39.441443 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 20:11:39.441443 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 20:11:39.441443 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 09 20:11:39.441443 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:11:39.445164 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 324/652] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 9 20:11:39 2022] GET /identity/v3/users/glance => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:39.445969 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00461379-fab9-48d4-866f-4287993fb0b0 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:39.460207 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e5fdec-abd8-432b-900e-c6325fa3d08e None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:39.494487 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f887bb-6eb5-4337-9500-203ba1ac29f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:39.495507 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f887bb-6eb5-4337-9500-203ba1ac29f9 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:39.495948 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f887bb-6eb5-4337-9500-203ba1ac29f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:39.496375 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f887bb-6eb5-4337-9500-203ba1ac29f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:39.506976 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f887bb-6eb5-4337-9500-203ba1ac29f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:39.508586 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f887bb-6eb5-4337-9500-203ba1ac29f9 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:39.525622 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-12f887bb-6eb5-4337-9500-203ba1ac29f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:39.525622 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:39.525622 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:39.525622 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:39.525622 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:39.525622 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:39.525622 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:39.525622 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:39.525622 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:39.525622 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:39.525622 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:39.525622 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:39.525622 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 20:11:39.525622 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 20:11:39.525622 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 20:11:39.526705 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 20:11:39.526705 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:39.526705 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:39.526705 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:39.526705 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:39.526705 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:39.526705 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:39.526705 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:39.526705 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:11:39.526705 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:39.526705 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:39.526705 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:39.526705 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:39.526705 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:39.526705 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:39.526705 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:39.526705 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:39.527796 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 20:11:39.527796 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 20:11:39.527796 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:39.527796 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:39.529450 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 329/653] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:11:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:39.530299 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f887bb-6eb5-4337-9500-203ba1ac29f9 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:39.543524 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00461379-fab9-48d4-866f-4287993fb0b0 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:39.579873 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d2aa66-051d-48fc-9ce7-f288f2156e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:39.581579 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2aa66-051d-48fc-9ce7-f288f2156e89 None admin] REQUEST_METHOD: `PUT` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:39.582011 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2aa66-051d-48fc-9ce7-f288f2156e89 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:39.582277 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2aa66-051d-48fc-9ce7-f288f2156e89 None admin] PATH_INFO: `/v3/projects/563db7f5a25f480e8e6568b92ec3f195/users/965089f1a92f49bd883b337d6042c69f/roles/1ec9314b191d4bd59d71fe4d635de747` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:39.596317 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d2aa66-051d-48fc-9ce7-f288f2156e89 None admin] RBAC: Authorizing `identity:create_grant(project_id=563db7f5a25f480e8e6568b92ec3f195, user_id=965089f1a92f49bd883b337d6042c69f, role_id=1ec9314b191d4bd59d71fe4d635de747)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:39.597840 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d2aa66-051d-48fc-9ce7-f288f2156e89 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:39.619478 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 325/654] 10.222.0.44 () {58 vars in 1439 bytes} [Mon May 9 20:11:39 2022] PUT /identity/v3/projects/563db7f5a25f480e8e6568b92ec3f195/users/965089f1a92f49bd883b337d6042c69f/roles/1ec9314b191d4bd59d71fe4d635de747 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:11:39.619478 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d2aa66-051d-48fc-9ce7-f288f2156e89 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:39.634480 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f887bb-6eb5-4337-9500-203ba1ac29f9 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:39.672890 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba04e242-5ec6-430d-8c33-9ce8da8fbde3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:39.673764 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04e242-5ec6-430d-8c33-9ce8da8fbde3 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:39.674129 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04e242-5ec6-430d-8c33-9ce8da8fbde3 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:39.674470 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04e242-5ec6-430d-8c33-9ce8da8fbde3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:39.725800 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d2aa66-051d-48fc-9ce7-f288f2156e89 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:39.749299 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba04e242-5ec6-430d-8c33-9ce8da8fbde3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:39.750886 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba04e242-5ec6-430d-8c33-9ce8da8fbde3 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:39.762188 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a4d279-a727-4a3c-a5d2-71feef32511d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:39.763015 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a4d279-a727-4a3c-a5d2-71feef32511d None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:39.763425 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a4d279-a727-4a3c-a5d2-71feef32511d None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:39.763805 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a4d279-a727-4a3c-a5d2-71feef32511d None admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:39.764750 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a4d279-a727-4a3c-a5d2-71feef32511d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:39.765157 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a4d279-a727-4a3c-a5d2-71feef32511d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:39.766724 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a4d279-a727-4a3c-a5d2-71feef32511d None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:39.786548 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 326/655] 10.222.0.44 () {56 vars in 1137 bytes} [Mon May 9 20:11:39 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:39.787588 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a4d279-a727-4a3c-a5d2-71feef32511d None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:39.860950 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 330/656] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 9 20:11:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 20:11:39.862779 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba04e242-5ec6-430d-8c33-9ce8da8fbde3 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:39.896034 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a4d279-a727-4a3c-a5d2-71feef32511d None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:39.930571 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3494d59-45ba-48f7-a5d6-c960dfc08f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:39.931372 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3494d59-45ba-48f7-a5d6-c960dfc08f9b None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:39.931775 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3494d59-45ba-48f7-a5d6-c960dfc08f9b None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:39.932139 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3494d59-45ba-48f7-a5d6-c960dfc08f9b None admin] PATH_INFO: `/v3/domains` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:39.932951 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3494d59-45ba-48f7-a5d6-c960dfc08f9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:39.933350 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3494d59-45ba-48f7-a5d6-c960dfc08f9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:39.934806 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3494d59-45ba-48f7-a5d6-c960dfc08f9b None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:39.946978 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 327/657] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 9 20:11:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:39.947985 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3494d59-45ba-48f7-a5d6-c960dfc08f9b None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:39.961797 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba04e242-5ec6-430d-8c33-9ce8da8fbde3 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:39.996755 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e316bb-d100-4da3-b695-b738ae97f598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:39.997321 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e316bb-d100-4da3-b695-b738ae97f598 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:39.997601 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e316bb-d100-4da3-b695-b738ae97f598 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:39.997878 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e316bb-d100-4da3-b695-b738ae97f598 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:40.047006 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3494d59-45ba-48f7-a5d6-c960dfc08f9b None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:40.068892 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e316bb-d100-4da3-b695-b738ae97f598 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:40.070518 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e316bb-d100-4da3-b695-b738ae97f598 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:40.081145 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea993dc8-e7d6-4af8-9bac-6ee7e449af78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:40.082059 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea993dc8-e7d6-4af8-9bac-6ee7e449af78 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:40.082433 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea993dc8-e7d6-4af8-9bac-6ee7e449af78 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:40.082801 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea993dc8-e7d6-4af8-9bac-6ee7e449af78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:40.093352 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea993dc8-e7d6-4af8-9bac-6ee7e449af78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:40.094926 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea993dc8-e7d6-4af8-9bac-6ee7e449af78 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:40.117939 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-ea993dc8-e7d6-4af8-9bac-6ee7e449af78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:40.117939 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:40.117939 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:40.117939 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:40.117939 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:40.117939 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:40.117939 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:40.117939 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:40.117939 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:40.117939 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:40.117939 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:40.117939 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:40.117939 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 20:11:40.117939 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 20:11:40.117939 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 20:11:40.119127 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 20:11:40.119127 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:40.119127 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:40.119127 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:40.119127 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:40.119127 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:40.119127 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:40.119127 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:40.119127 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:11:40.119127 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:40.119127 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:40.119127 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:40.119127 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:40.119127 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:40.119127 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:40.119127 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:40.119127 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:40.120229 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 20:11:40.120229 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 20:11:40.120229 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:40.120229 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:11:40.121387 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 328/658] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:11:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:40.122382 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea993dc8-e7d6-4af8-9bac-6ee7e449af78 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:40.188735 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 331/659] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 9 20:11:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 20:11:40.189978 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e316bb-d100-4da3-b695-b738ae97f598 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:40.255054 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea993dc8-e7d6-4af8-9bac-6ee7e449af78 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:40.295815 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e316bb-d100-4da3-b695-b738ae97f598 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:40.303950 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362ac65e-2d75-4776-a39f-3187bef7eda4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:40.305319 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ac65e-2d75-4776-a39f-3187bef7eda4 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:40.305680 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ac65e-2d75-4776-a39f-3187bef7eda4 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:40.306031 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ac65e-2d75-4776-a39f-3187bef7eda4 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:40.316453 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362ac65e-2d75-4776-a39f-3187bef7eda4 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:40.317997 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362ac65e-2d75-4776-a39f-3187bef7eda4 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:40.332378 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb363300-f063-444d-857d-e5af60b46ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:40.333234 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb363300-f063-444d-857d-e5af60b46ba5 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:40.333679 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb363300-f063-444d-857d-e5af60b46ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:40.334187 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb363300-f063-444d-857d-e5af60b46ba5 None admin] PATH_INFO: `/v3/domains` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:40.335055 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb363300-f063-444d-857d-e5af60b46ba5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:40.335538 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb363300-f063-444d-857d-e5af60b46ba5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:40.336717 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-362ac65e-2d75-4776-a39f-3187bef7eda4 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 09 20:11:40.336717 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:40.336717 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:40.336717 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:40.336717 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:40.336717 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:40.336717 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:40.336717 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:40.336717 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:40.336717 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:40.336717 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:40.336717 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:40.336717 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 20:11:40.336717 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 20:11:40.336717 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 20:11:40.336717 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 20:11:40.337791 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:40.337791 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:40.337791 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 20:11:40.337791 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 20:11:40.337791 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 20:11:40.337791 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 20:11:40.337791 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:40.337791 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:40.337791 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:40.337791 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:40.337791 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:40.337791 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:11:40.337791 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:40.337791 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:40.337791 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:40.337791 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:40.337791 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:40.337791 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:40.338925 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:40.338925 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:40.338925 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 20:11:40.338925 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 20:11:40.338925 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 20:11:40.338925 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 20:11:40.338925 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 20:11:40.338925 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 20:11:40.338925 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 09 20:11:40.338925 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:11:40.340075 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb363300-f063-444d-857d-e5af60b46ba5 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:40.340456 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 329/660] 10.222.0.44 () {56 vars in 1102 bytes} [Mon May 9 20:11:40 2022] GET /identity/v3/users/neutron => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:40.342115 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362ac65e-2d75-4776-a39f-3187bef7eda4 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:40.357593 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 332/661] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 9 20:11:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:40.358778 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb363300-f063-444d-857d-e5af60b46ba5 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:40.460649 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb363300-f063-444d-857d-e5af60b46ba5 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:40.467151 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362ac65e-2d75-4776-a39f-3187bef7eda4 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:40.494408 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909641a9-abf9-4bd4-955b-805fe473d0c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:40.495069 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909641a9-abf9-4bd4-955b-805fe473d0c0 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:40.495343 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909641a9-abf9-4bd4-955b-805fe473d0c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:40.495634 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909641a9-abf9-4bd4-955b-805fe473d0c0 None admin] PATH_INFO: `/v3/users` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:40.496466 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909641a9-abf9-4bd4-955b-805fe473d0c0 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:40.496767 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909641a9-abf9-4bd4-955b-805fe473d0c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:40.498200 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909641a9-abf9-4bd4-955b-805fe473d0c0 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:40.502651 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e548747f-0820-45dd-8e24-f9843f9a4596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:40.503589 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e548747f-0820-45dd-8e24-f9843f9a4596 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:40.503971 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e548747f-0820-45dd-8e24-f9843f9a4596 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:40.504344 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e548747f-0820-45dd-8e24-f9843f9a4596 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:40.515105 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e548747f-0820-45dd-8e24-f9843f9a4596 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:40.516680 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e548747f-0820-45dd-8e24-f9843f9a4596 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:40.518155 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 333/662] 10.222.0.44 () {56 vars in 1139 bytes} [Mon May 9 20:11:40 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:40.519034 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909641a9-abf9-4bd4-955b-805fe473d0c0 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:40.538894 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-e548747f-0820-45dd-8e24-f9843f9a4596 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:40.538894 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:40.538894 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:40.538894 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:40.538894 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:40.538894 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:40.538894 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:40.538894 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:40.538894 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:40.538894 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:40.538894 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:40.538894 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:40.538894 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 20:11:40.538894 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 20:11:40.538894 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 20:11:40.539992 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 20:11:40.539992 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:40.539992 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:40.539992 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:40.539992 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:40.539992 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:40.539992 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:40.539992 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:40.539992 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:11:40.539992 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:40.539992 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:40.539992 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:40.539992 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:40.539992 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:40.539992 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:40.539992 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:40.539992 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:40.541139 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 20:11:40.541139 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 20:11:40.541139 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:40.541139 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:11:40.544564 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 330/663] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:11:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:40.545661 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e4840-8e85-4929-a510-3969ca45c9fd None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:40.545945 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e4840-8e85-4929-a510-3969ca45c9fd None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:40.546217 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e4840-8e85-4929-a510-3969ca45c9fd None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:40.552303 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 331/664] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:11:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:11:40.552862 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5e4840-8e85-4929-a510-3969ca45c9fd None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:40.622423 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909641a9-abf9-4bd4-955b-805fe473d0c0 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:40.654918 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5e4840-8e85-4929-a510-3969ca45c9fd None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:40.658422 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55746d16-b0f6-4943-98da-336bd3530fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:40.659272 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55746d16-b0f6-4943-98da-336bd3530fbf None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:40.659585 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55746d16-b0f6-4943-98da-336bd3530fbf None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:40.659858 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55746d16-b0f6-4943-98da-336bd3530fbf None admin] PATH_INFO: `/v3/projects/service` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:40.666319 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55746d16-b0f6-4943-98da-336bd3530fbf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:40.667824 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55746d16-b0f6-4943-98da-336bd3530fbf None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:40.681274 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-55746d16-b0f6-4943-98da-336bd3530fbf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 20:11:40.681274 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:40.681274 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:40.681274 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:40.681274 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:40.681274 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:40.681274 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:40.681274 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:40.681274 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:40.681274 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:40.681274 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:40.681274 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:40.681274 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 20:11:40.681274 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 20:11:40.681274 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 20:11:40.682143 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 20:11:40.682143 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:40.682143 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:40.682143 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:40.682143 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:40.682143 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:40.682143 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:40.682143 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:40.682143 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:11:40.682143 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:40.682143 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:40.682143 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:40.682143 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:40.682143 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:40.682143 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:40.682143 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:40.682143 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:40.683021 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 20:11:40.683021 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 20:11:40.683021 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 20:11:40.683021 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 20:11:40.683021 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 20:11:40.683021 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 20:11:40.683021 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 20:11:40.683021 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:40.689207 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 334/665] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 9 20:11:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:40.689207 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55746d16-b0f6-4943-98da-336bd3530fbf None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:40.693035 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83a0813-cf1c-4fcc-a2f9-4ffc6a0b6f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:40.693677 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a0813-cf1c-4fcc-a2f9-4ffc6a0b6f04 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:40.693952 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a0813-cf1c-4fcc-a2f9-4ffc6a0b6f04 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:40.694220 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a0813-cf1c-4fcc-a2f9-4ffc6a0b6f04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:40.762234 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83a0813-cf1c-4fcc-a2f9-4ffc6a0b6f04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:40.763886 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83a0813-cf1c-4fcc-a2f9-4ffc6a0b6f04 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:40.786981 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55746d16-b0f6-4943-98da-336bd3530fbf None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:40.822279 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c9bb6d-05b2-4ab6-9883-c8e8a873c75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:40.823201 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9bb6d-05b2-4ab6-9883-c8e8a873c75f None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:40.823703 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9bb6d-05b2-4ab6-9883-c8e8a873c75f None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:40.824114 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9bb6d-05b2-4ab6-9883-c8e8a873c75f None admin] PATH_INFO: `/v3/domains` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:40.825014 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c9bb6d-05b2-4ab6-9883-c8e8a873c75f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:40.825453 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c9bb6d-05b2-4ab6-9883-c8e8a873c75f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:40.826947 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c9bb6d-05b2-4ab6-9883-c8e8a873c75f None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:40.839665 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 335/666] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 9 20:11:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:40.841114 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad34ab9-2aae-4d3b-ae3d-a2f1c62b760e None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:40.841531 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad34ab9-2aae-4d3b-ae3d-a2f1c62b760e None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:40.841928 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad34ab9-2aae-4d3b-ae3d-a2f1c62b760e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:40.859181 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-6ad34ab9-2aae-4d3b-ae3d-a2f1c62b760e None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:11:40.860601 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-6ad34ab9-2aae-4d3b-ae3d-a2f1c62b760e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:11:40.864042 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 332/667] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 9 20:11:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 20:11:40.864498 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83a0813-cf1c-4fcc-a2f9-4ffc6a0b6f04 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:40.926879 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 336/668] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:11:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 20:11:40.927854 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad34ab9-2aae-4d3b-ae3d-a2f1c62b760e None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:40.962163 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83a0813-cf1c-4fcc-a2f9-4ffc6a0b6f04 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:40.997170 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e9d86-12d6-4fcd-ac11-a93036521f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:40.997818 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e9d86-12d6-4fcd-ac11-a93036521f4a None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:40.998095 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e9d86-12d6-4fcd-ac11-a93036521f4a None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:40.998360 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e9d86-12d6-4fcd-ac11-a93036521f4a None admin] PATH_INFO: `/v3/projects` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:40.999132 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021e9d86-12d6-4fcd-ac11-a93036521f4a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:40.999459 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021e9d86-12d6-4fcd-ac11-a93036521f4a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:41.000908 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021e9d86-12d6-4fcd-ac11-a93036521f4a None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:41.013666 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 333/669] 10.222.0.44 () {56 vars in 1148 bytes} [Mon May 9 20:11:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:41.014834 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e9d86-12d6-4fcd-ac11-a93036521f4a None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:41.033781 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad34ab9-2aae-4d3b-ae3d-a2f1c62b760e None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:41.067451 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181c8655-fb0b-4d97-92c8-a93c286a175b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:41.068190 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c8655-fb0b-4d97-92c8-a93c286a175b None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:41.068559 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c8655-fb0b-4d97-92c8-a93c286a175b None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:41.068833 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c8655-fb0b-4d97-92c8-a93c286a175b None admin] PATH_INFO: `/v3/projects/service` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:41.075242 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181c8655-fb0b-4d97-92c8-a93c286a175b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:41.076703 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181c8655-fb0b-4d97-92c8-a93c286a175b None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:41.089908 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-181c8655-fb0b-4d97-92c8-a93c286a175b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 20:11:41.089908 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:41.089908 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:41.089908 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:41.089908 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:41.089908 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:41.089908 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:41.089908 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:41.089908 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:41.089908 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:41.089908 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:41.089908 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:41.089908 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 20:11:41.089908 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 20:11:41.089908 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 20:11:41.090795 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 20:11:41.090795 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:41.090795 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:41.090795 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:41.090795 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:41.090795 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:41.090795 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:41.090795 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:41.090795 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:11:41.090795 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:41.090795 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:41.090795 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:41.090795 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:41.090795 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:41.090795 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:41.090795 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:41.090795 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:41.092091 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 20:11:41.092091 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 20:11:41.092091 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 20:11:41.092091 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 20:11:41.092091 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 20:11:41.092091 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 20:11:41.092091 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 20:11:41.092091 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:41.092091 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 337/670] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 9 20:11:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:41.092091 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181c8655-fb0b-4d97-92c8-a93c286a175b None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:41.118647 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e9d86-12d6-4fcd-ac11-a93036521f4a None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:41.151551 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259a1e2b-f4a2-4264-ae3a-047693c1e45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:41.152326 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a1e2b-f4a2-4264-ae3a-047693c1e45c None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:41.152599 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a1e2b-f4a2-4264-ae3a-047693c1e45c None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:41.152862 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a1e2b-f4a2-4264-ae3a-047693c1e45c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:41.162953 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259a1e2b-f4a2-4264-ae3a-047693c1e45c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:41.164419 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259a1e2b-f4a2-4264-ae3a-047693c1e45c None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:41.181088 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-259a1e2b-f4a2-4264-ae3a-047693c1e45c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:41.181088 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:41.181088 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:41.181088 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:41.181088 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:41.181088 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:41.181088 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:41.181088 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:41.181088 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:41.181088 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:41.181088 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:41.181088 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:41.181088 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 20:11:41.181088 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 20:11:41.181088 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 20:11:41.181965 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 20:11:41.181965 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:41.181965 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:41.181965 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:41.181965 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:41.181965 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:41.181965 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:41.181965 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:41.181965 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:11:41.181965 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:41.181965 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:41.181965 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:41.181965 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:41.181965 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:41.181965 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:41.181965 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:41.181965 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:41.182885 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 20:11:41.182885 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 20:11:41.182885 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:41.182885 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:11:41.182885 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 334/671] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:11:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:41.183168 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259a1e2b-f4a2-4264-ae3a-047693c1e45c None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:41.192978 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181c8655-fb0b-4d97-92c8-a93c286a175b None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:41.225807 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426a8c7a-1356-4774-ba1f-a539c66abda5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:41.226588 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a8c7a-1356-4774-ba1f-a539c66abda5 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:41.226864 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a8c7a-1356-4774-ba1f-a539c66abda5 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:41.227133 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a8c7a-1356-4774-ba1f-a539c66abda5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:41.237534 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426a8c7a-1356-4774-ba1f-a539c66abda5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:11:41.245141 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-426a8c7a-1356-4774-ba1f-a539c66abda5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 20:11:41.245141 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:41.245141 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:41.245141 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:41.245141 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:41.245141 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:41.245141 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:41.245141 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:41.245141 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:41.245141 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:41.245141 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:41.245141 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:41.245141 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:11:41.245141 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:11:41.245141 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:11:41.245141 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:11:41.246220 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:11:41.246220 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:11:41.246220 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:11:41.246220 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:11:41.246220 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:41.246220 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:41.246220 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:41.246220 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:41.246220 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:41.246220 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:41.246220 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:41.246220 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:11:41.246220 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:41.246220 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:41.246220 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:41.246220 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:41.247209 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:41.247209 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:41.247209 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:41.247209 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:41.247209 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:11:41.247209 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:11:41.247209 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:11:41.247209 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:11:41.247209 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:11:41.247209 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:11:41.247209 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 20:11:41.247209 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:41.253923 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 338/672] 10.222.0.44 () {56 vars in 1096 bytes} [Mon May 9 20:11:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:41.253923 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426a8c7a-1356-4774-ba1f-a539c66abda5 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:41.287829 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259a1e2b-f4a2-4264-ae3a-047693c1e45c None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:41.320983 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a86289a-5ee7-4581-ab8e-8738a7360c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:41.321551 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a86289a-5ee7-4581-ab8e-8738a7360c7a None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:41.321825 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a86289a-5ee7-4581-ab8e-8738a7360c7a None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:41.322097 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a86289a-5ee7-4581-ab8e-8738a7360c7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:41.322906 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a86289a-5ee7-4581-ab8e-8738a7360c7a None admin] RBAC: Adding query filter params (role.id=1ec9314b191d4bd59d71fe4d635de747, scope.project.id=563db7f5a25f480e8e6568b92ec3f195, user.id=9d65e731386d44948dcc1ecd40cbda65) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:41.323210 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a86289a-5ee7-4581-ab8e-8738a7360c7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:41.324665 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a86289a-5ee7-4581-ab8e-8738a7360c7a None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:41.339602 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 335/673] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 9 20:11:41 2022] GET /identity/v3/role_assignments?user.id=9d65e731386d44948dcc1ecd40cbda65&scope.project.id=563db7f5a25f480e8e6568b92ec3f195&role.id=1ec9314b191d4bd59d71fe4d635de747 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:41.339602 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a86289a-5ee7-4581-ab8e-8738a7360c7a None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:41.366006 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426a8c7a-1356-4774-ba1f-a539c66abda5 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:41.406853 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc49161-40ad-4f4e-a374-c162c596836f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:41.407563 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc49161-40ad-4f4e-a374-c162c596836f None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:41.407841 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc49161-40ad-4f4e-a374-c162c596836f None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:41.408209 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc49161-40ad-4f4e-a374-c162c596836f None admin] PATH_INFO: `/v3/projects` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:41.408996 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc49161-40ad-4f4e-a374-c162c596836f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:41.409300 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc49161-40ad-4f4e-a374-c162c596836f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:41.410808 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc49161-40ad-4f4e-a374-c162c596836f None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:41.428943 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 339/674] 10.222.0.44 () {56 vars in 1148 bytes} [Mon May 9 20:11:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:41.429931 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc49161-40ad-4f4e-a374-c162c596836f None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:41.473792 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a86289a-5ee7-4581-ab8e-8738a7360c7a None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:41.513532 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04b067b-8670-4911-a998-5bb6ae4e641e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:41.514300 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b067b-8670-4911-a998-5bb6ae4e641e None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:41.514652 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b067b-8670-4911-a998-5bb6ae4e641e None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:41.514984 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b067b-8670-4911-a998-5bb6ae4e641e None admin] PATH_INFO: `/v3/domains` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:41.515813 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04b067b-8670-4911-a998-5bb6ae4e641e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:41.516186 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04b067b-8670-4911-a998-5bb6ae4e641e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:41.518243 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04b067b-8670-4911-a998-5bb6ae4e641e None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:41.535504 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 336/675] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 9 20:11:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:41.536519 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04b067b-8670-4911-a998-5bb6ae4e641e None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:41.536965 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc49161-40ad-4f4e-a374-c162c596836f None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:41.572588 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5d5fa2-a5c6-4427-9755-3281d0539fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:41.572588 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d5fa2-a5c6-4427-9755-3281d0539fd6 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:41.572588 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d5fa2-a5c6-4427-9755-3281d0539fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:41.572588 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d5fa2-a5c6-4427-9755-3281d0539fd6 None admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:41.573176 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5d5fa2-a5c6-4427-9755-3281d0539fd6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:41.573472 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5d5fa2-a5c6-4427-9755-3281d0539fd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:41.574828 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5d5fa2-a5c6-4427-9755-3281d0539fd6 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:41.584957 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 340/676] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 9 20:11:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:41.585816 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5d5fa2-a5c6-4427-9755-3281d0539fd6 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:41.640760 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04b067b-8670-4911-a998-5bb6ae4e641e None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:41.675802 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b133db-390d-48e0-9676-dfe3d7cf98d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:41.676813 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b133db-390d-48e0-9676-dfe3d7cf98d1 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:41.676949 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b133db-390d-48e0-9676-dfe3d7cf98d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:41.677324 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b133db-390d-48e0-9676-dfe3d7cf98d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:41.678236 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b133db-390d-48e0-9676-dfe3d7cf98d1 None admin] RBAC: Adding query filter params (role.id=1ec9314b191d4bd59d71fe4d635de747, scope.project.id=563db7f5a25f480e8e6568b92ec3f195, user.id=65db5d9a86fd48acb5874df0165c0ef9) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:41.678639 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b133db-390d-48e0-9676-dfe3d7cf98d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:41.680210 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b133db-390d-48e0-9676-dfe3d7cf98d1 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:41.686377 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 337/677] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 9 20:11:41 2022] GET /identity/v3/role_assignments?user.id=65db5d9a86fd48acb5874df0165c0ef9&scope.project.id=563db7f5a25f480e8e6568b92ec3f195&role.id=1ec9314b191d4bd59d71fe4d635de747 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:41.687218 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b133db-390d-48e0-9676-dfe3d7cf98d1 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:41.690276 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5d5fa2-a5c6-4427-9755-3281d0539fd6 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:41.728029 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc56f4e7-a785-4f11-af07-a7680921bbb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:41.729141 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc56f4e7-a785-4f11-af07-a7680921bbb9 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:41.729620 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc56f4e7-a785-4f11-af07-a7680921bbb9 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:41.730053 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc56f4e7-a785-4f11-af07-a7680921bbb9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:41.739722 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc56f4e7-a785-4f11-af07-a7680921bbb9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:41.741661 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc56f4e7-a785-4f11-af07-a7680921bbb9 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:41.758471 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-bc56f4e7-a785-4f11-af07-a7680921bbb9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 20:11:41.758471 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:41.758471 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:41.758471 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:41.758471 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:41.758471 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:41.758471 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:41.758471 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:41.758471 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:41.758471 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:41.758471 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:41.758471 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:41.758471 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 20:11:41.758471 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 20:11:41.758471 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 20:11:41.759490 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 20:11:41.759490 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:41.759490 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:41.759490 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:41.759490 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:41.759490 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:41.759490 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:41.759490 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:41.759490 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:11:41.759490 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:41.759490 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:41.759490 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:41.759490 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:41.759490 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:41.759490 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:41.759490 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:41.759490 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:41.760531 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 20:11:41.760531 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 20:11:41.760531 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 20:11:41.760531 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 20:11:41.760531 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 20:11:41.760531 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 20:11:41.760531 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 20:11:41.760531 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:41.763285 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 341/678] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 9 20:11:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:41.771115 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc56f4e7-a785-4f11-af07-a7680921bbb9 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:41.805531 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b133db-390d-48e0-9676-dfe3d7cf98d1 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:41.841725 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cba183-031d-40a5-ab61-ac4b9c35f2c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:41.842892 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cba183-031d-40a5-ab61-ac4b9c35f2c4 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:41.842892 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cba183-031d-40a5-ab61-ac4b9c35f2c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:41.843114 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cba183-031d-40a5-ab61-ac4b9c35f2c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:41.854311 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cba183-031d-40a5-ab61-ac4b9c35f2c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:41.855832 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cba183-031d-40a5-ab61-ac4b9c35f2c4 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:41.874351 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-30cba183-031d-40a5-ab61-ac4b9c35f2c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:41.874351 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:41.874351 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:41.874351 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:41.874351 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:41.874351 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:41.874351 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:41.874351 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:41.874351 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:41.874351 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:41.874351 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:41.874351 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:41.874351 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 20:11:41.874351 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 20:11:41.874351 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 20:11:41.875312 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 20:11:41.875312 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:41.875312 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:41.875312 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:41.875312 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:41.875312 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:41.875312 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:41.875312 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:41.875312 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:11:41.875312 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:41.875312 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:41.875312 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:41.875312 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:41.875312 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:41.875312 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:41.875312 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:41.875312 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:41.876374 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 20:11:41.876374 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 20:11:41.876374 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:41.876374 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:11:41.876374 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 338/679] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:11:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:41.881738 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc56f4e7-a785-4f11-af07-a7680921bbb9 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:41.888509 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cba183-031d-40a5-ab61-ac4b9c35f2c4 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:41.946244 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c15104-576d-4ae0-90fe-b2943900f4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:41.947237 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c15104-576d-4ae0-90fe-b2943900f4dc None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:41.947756 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c15104-576d-4ae0-90fe-b2943900f4dc None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:41.948213 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c15104-576d-4ae0-90fe-b2943900f4dc None admin] PATH_INFO: `/v3/projects` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:41.949208 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c15104-576d-4ae0-90fe-b2943900f4dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:41.950233 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c15104-576d-4ae0-90fe-b2943900f4dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:41.952485 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c15104-576d-4ae0-90fe-b2943900f4dc None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:41.970170 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 342/680] 10.222.0.44 () {56 vars in 1148 bytes} [Mon May 9 20:11:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:41.972744 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbaf7dd-e971-4e5a-8f02-333efd8052de None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:41.973528 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbaf7dd-e971-4e5a-8f02-333efd8052de None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:41.974253 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbaf7dd-e971-4e5a-8f02-333efd8052de None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:41.976181 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 343/681] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:11:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:11:41.977107 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbaf7dd-e971-4e5a-8f02-333efd8052de None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:42.024138 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cba183-031d-40a5-ab61-ac4b9c35f2c4 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:42.066740 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da505da0-be08-40f7-9aa9-b9ee3db5cb47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:42.067424 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da505da0-be08-40f7-9aa9-b9ee3db5cb47 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:42.067698 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da505da0-be08-40f7-9aa9-b9ee3db5cb47 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:42.067967 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da505da0-be08-40f7-9aa9-b9ee3db5cb47 None admin] PATH_INFO: `/v3/domains` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:42.068680 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da505da0-be08-40f7-9aa9-b9ee3db5cb47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:42.068975 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da505da0-be08-40f7-9aa9-b9ee3db5cb47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:42.070346 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da505da0-be08-40f7-9aa9-b9ee3db5cb47 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:42.084807 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 339/682] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 9 20:11:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:42.086094 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea15691e-08fc-47d4-ae1d-8e7b14e71c30 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:42.086372 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea15691e-08fc-47d4-ae1d-8e7b14e71c30 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:42.086640 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea15691e-08fc-47d4-ae1d-8e7b14e71c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:42.104578 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbaf7dd-e971-4e5a-8f02-333efd8052de None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:42.110456 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-ea15691e-08fc-47d4-ae1d-8e7b14e71c30 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:11:42.112249 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-ea15691e-08fc-47d4-ae1d-8e7b14e71c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:11:42.145696 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d7e38-6f39-48b5-812c-87a23db89ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:42.146592 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d7e38-6f39-48b5-812c-87a23db89ec1 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:42.147014 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d7e38-6f39-48b5-812c-87a23db89ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:42.147474 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d7e38-6f39-48b5-812c-87a23db89ec1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:42.148462 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4d7e38-6f39-48b5-812c-87a23db89ec1 None admin] RBAC: Adding query filter params (role.id=1ec9314b191d4bd59d71fe4d635de747, scope.project.id=563db7f5a25f480e8e6568b92ec3f195, user.id=b2a13ad25f27471792ba0758602b6e63) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:42.148912 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4d7e38-6f39-48b5-812c-87a23db89ec1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:42.151503 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4d7e38-6f39-48b5-812c-87a23db89ec1 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:42.159268 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 344/683] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 9 20:11:41 2022] GET /identity/v3/role_assignments?user.id=b2a13ad25f27471792ba0758602b6e63&scope.project.id=563db7f5a25f480e8e6568b92ec3f195&role.id=1ec9314b191d4bd59d71fe4d635de747 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:42.160823 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d7e38-6f39-48b5-812c-87a23db89ec1 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:42.184408 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 340/684] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:11:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 20:11:42.219810 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea15691e-08fc-47d4-ae1d-8e7b14e71c30 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:42.334722 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d7e38-6f39-48b5-812c-87a23db89ec1 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:42.409818 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f814950c-aad1-445f-9730-b017dbd78527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:42.410534 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814950c-aad1-445f-9730-b017dbd78527 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:42.410811 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814950c-aad1-445f-9730-b017dbd78527 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:42.411080 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814950c-aad1-445f-9730-b017dbd78527 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:42.418024 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea15691e-08fc-47d4-ae1d-8e7b14e71c30 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:42.420594 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f814950c-aad1-445f-9730-b017dbd78527 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:42.421711 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f814950c-aad1-445f-9730-b017dbd78527 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:42.439611 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-f814950c-aad1-445f-9730-b017dbd78527 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 09 20:11:42.439611 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:42.439611 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:42.439611 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:42.439611 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:42.439611 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:42.439611 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:42.439611 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:42.439611 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:42.439611 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:42.439611 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:42.439611 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:42.439611 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 20:11:42.439611 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 20:11:42.439611 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 20:11:42.439611 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 20:11:42.440629 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:42.440629 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:42.440629 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 20:11:42.440629 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 20:11:42.440629 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 20:11:42.440629 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 20:11:42.440629 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:42.440629 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:42.440629 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:42.440629 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:42.440629 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:42.440629 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:11:42.440629 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:42.440629 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:42.440629 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:42.440629 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:42.440629 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:42.440629 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:42.441569 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:42.441569 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:42.441569 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 20:11:42.441569 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 20:11:42.441569 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 20:11:42.441569 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 20:11:42.441569 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 20:11:42.441569 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 20:11:42.441569 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 09 20:11:42.441569 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:42.441569 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 345/685] 10.222.0.44 () {56 vars in 1093 bytes} [Mon May 9 20:11:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:42.450902 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f814950c-aad1-445f-9730-b017dbd78527 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:42.478172 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca7bd7-2782-4e5f-9d08-153fe1a37120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:42.479284 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca7bd7-2782-4e5f-9d08-153fe1a37120 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:42.479781 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca7bd7-2782-4e5f-9d08-153fe1a37120 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:42.480201 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca7bd7-2782-4e5f-9d08-153fe1a37120 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:42.491276 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdca7bd7-2782-4e5f-9d08-153fe1a37120 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:11:42.499329 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-bdca7bd7-2782-4e5f-9d08-153fe1a37120 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 20:11:42.499329 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:42.499329 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:42.499329 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:42.499329 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:42.499329 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:42.499329 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:42.499329 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:42.499329 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:42.499329 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:42.499329 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:42.499329 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:42.499329 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:11:42.499329 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:11:42.499329 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:11:42.499329 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:11:42.500487 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:11:42.500487 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:11:42.500487 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:11:42.500487 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:11:42.500487 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:42.500487 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:42.500487 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:42.500487 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:42.500487 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:42.500487 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:42.500487 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:42.500487 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:11:42.500487 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:42.500487 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:42.500487 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:42.500487 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:42.501433 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:42.501433 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:42.501433 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:42.501433 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:42.501433 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:11:42.501433 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:11:42.501433 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:11:42.501433 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:11:42.501433 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:11:42.501433 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:11:42.501433 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 20:11:42.501433 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:11:42.504674 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 341/686] 10.222.0.44 () {56 vars in 1102 bytes} [Mon May 9 20:11:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 20:11:42.510439 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca7bd7-2782-4e5f-9d08-153fe1a37120 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:42.575877 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f814950c-aad1-445f-9730-b017dbd78527 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:42.648544 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4dd258-a874-44c1-98f6-ab75a4533616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:42.649222 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4dd258-a874-44c1-98f6-ab75a4533616 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:42.649496 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4dd258-a874-44c1-98f6-ab75a4533616 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:42.649767 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4dd258-a874-44c1-98f6-ab75a4533616 None admin] PATH_INFO: `/v3/users` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:42.650598 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4dd258-a874-44c1-98f6-ab75a4533616 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:42.650900 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4dd258-a874-44c1-98f6-ab75a4533616 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:42.652347 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4dd258-a874-44c1-98f6-ab75a4533616 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:42.658942 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca7bd7-2782-4e5f-9d08-153fe1a37120 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:42.685167 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 346/687] 10.222.0.44 () {56 vars in 1133 bytes} [Mon May 9 20:11:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:42.692407 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4dd258-a874-44c1-98f6-ab75a4533616 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:42.713976 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c35a8a1-afda-40b4-9468-f6fdefae90d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:42.714656 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c35a8a1-afda-40b4-9468-f6fdefae90d2 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:42.714930 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c35a8a1-afda-40b4-9468-f6fdefae90d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:42.715197 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c35a8a1-afda-40b4-9468-f6fdefae90d2 None admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:42.715984 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c35a8a1-afda-40b4-9468-f6fdefae90d2 None admin] RBAC: Adding query filter params (name=service) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:42.716284 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c35a8a1-afda-40b4-9468-f6fdefae90d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:42.717709 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c35a8a1-afda-40b4-9468-f6fdefae90d2 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:42.735719 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 342/688] 10.222.0.44 () {56 vars in 1103 bytes} [Mon May 9 20:11:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:11:42.740916 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c35a8a1-afda-40b4-9468-f6fdefae90d2 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:42.853326 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4dd258-a874-44c1-98f6-ab75a4533616 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:42.921210 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c35a8a1-afda-40b4-9468-f6fdefae90d2 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:42.922177 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c9c2c-b7f6-4509-a108-34824747be89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:42.923087 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c9c2c-b7f6-4509-a108-34824747be89 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:42.923621 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c9c2c-b7f6-4509-a108-34824747be89 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:42.924515 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c9c2c-b7f6-4509-a108-34824747be89 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:42.981218 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfd073b-fe51-4de8-a99e-31289eb178e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:42.982014 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd073b-fe51-4de8-a99e-31289eb178e6 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:42.982296 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd073b-fe51-4de8-a99e-31289eb178e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:42.982567 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd073b-fe51-4de8-a99e-31289eb178e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:43.004415 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfd073b-fe51-4de8-a99e-31289eb178e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:43.006142 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfd073b-fe51-4de8-a99e-31289eb178e6 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:43.016831 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30c9c2c-b7f6-4509-a108-34824747be89 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:43.018837 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30c9c2c-b7f6-4509-a108-34824747be89 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:43.043016 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-9dfd073b-fe51-4de8-a99e-31289eb178e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:43.043016 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:43.043016 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:43.043016 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:43.043016 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:43.043016 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:43.043016 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:43.043016 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:43.043016 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:43.043016 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:43.043016 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:43.043016 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:43.043016 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 20:11:43.043016 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 20:11:43.043016 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 20:11:43.044315 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 20:11:43.044315 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:43.044315 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:43.044315 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:43.044315 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:43.044315 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:43.044315 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:43.044315 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:43.044315 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:11:43.044315 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:43.044315 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:43.044315 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:43.044315 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:43.044315 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:43.044315 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:43.044315 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:43.044315 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:43.045874 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 20:11:43.045874 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 20:11:43.045874 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:43.045874 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:11:43.045874 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 343/689] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:11:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 20:11:43.050895 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfd073b-fe51-4de8-a99e-31289eb178e6 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:43.170794 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfd073b-fe51-4de8-a99e-31289eb178e6 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:43.177924 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 347/690] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 9 20:11:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 20:11:43.184432 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c9c2c-b7f6-4509-a108-34824747be89 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:43.216128 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54372dd4-4431-418e-9a20-42929ca4dec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:43.216802 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54372dd4-4431-418e-9a20-42929ca4dec2 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:43.217080 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54372dd4-4431-418e-9a20-42929ca4dec2 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:43.217351 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54372dd4-4431-418e-9a20-42929ca4dec2 None admin] PATH_INFO: `/v3/domains` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:43.218088 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54372dd4-4431-418e-9a20-42929ca4dec2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:43.218376 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54372dd4-4431-418e-9a20-42929ca4dec2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:43.219773 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54372dd4-4431-418e-9a20-42929ca4dec2 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:43.239605 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 344/691] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 9 20:11:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:43.243440 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54372dd4-4431-418e-9a20-42929ca4dec2 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:43.359111 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54372dd4-4431-418e-9a20-42929ca4dec2 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:43.384922 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c9c2c-b7f6-4509-a108-34824747be89 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:43.435712 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495af80c-16b6-44dd-b888-fac777051084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:43.436503 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495af80c-16b6-44dd-b888-fac777051084 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:43.436782 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495af80c-16b6-44dd-b888-fac777051084 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:43.437050 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495af80c-16b6-44dd-b888-fac777051084 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:43.456984 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495af80c-16b6-44dd-b888-fac777051084 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:43.458462 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495af80c-16b6-44dd-b888-fac777051084 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:43.464253 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b3ebc9-8c74-48f6-b5a6-7cfbf328ffe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:43.465043 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3ebc9-8c74-48f6-b5a6-7cfbf328ffe5 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:43.465321 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3ebc9-8c74-48f6-b5a6-7cfbf328ffe5 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:43.465593 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3ebc9-8c74-48f6-b5a6-7cfbf328ffe5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:43.478129 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b3ebc9-8c74-48f6-b5a6-7cfbf328ffe5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:43.479605 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b3ebc9-8c74-48f6-b5a6-7cfbf328ffe5 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:43.484055 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-495af80c-16b6-44dd-b888-fac777051084 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 09 20:11:43.484055 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:43.484055 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:43.484055 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:43.484055 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:43.484055 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:43.484055 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:43.484055 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:43.484055 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:43.484055 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:43.484055 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:43.484055 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:43.484055 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 20:11:43.484055 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 20:11:43.484055 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 20:11:43.484055 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 20:11:43.484989 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:43.484989 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:43.484989 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 20:11:43.484989 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 20:11:43.484989 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 20:11:43.484989 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 20:11:43.484989 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:43.484989 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:43.484989 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:43.484989 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:43.484989 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:43.484989 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:11:43.484989 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:43.484989 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:43.484989 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:43.484989 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:43.484989 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:43.484989 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:43.485952 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:43.485952 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:43.485952 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 20:11:43.485952 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 20:11:43.485952 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 20:11:43.485952 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 20:11:43.485952 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 20:11:43.485952 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 20:11:43.485952 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 09 20:11:43.485952 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:11:43.488675 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 345/692] 10.222.0.44 () {56 vars in 1096 bytes} [Mon May 9 20:11:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 20:11:43.504923 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495af80c-16b6-44dd-b888-fac777051084 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:43.513990 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-48b3ebc9-8c74-48f6-b5a6-7cfbf328ffe5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:43.513990 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:43.513990 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:43.513990 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:43.513990 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:43.513990 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:43.513990 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:43.513990 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:43.513990 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:43.513990 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:43.513990 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:43.513990 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:43.513990 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 20:11:43.513990 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 20:11:43.513990 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 20:11:43.514876 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 20:11:43.514876 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:43.514876 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:43.514876 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:43.514876 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:43.514876 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:43.514876 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:43.514876 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:43.514876 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:11:43.514876 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:43.514876 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:43.514876 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:43.514876 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:43.514876 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:43.514876 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:43.514876 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:43.514876 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:43.515794 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 20:11:43.515794 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 20:11:43.515794 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:43.515794 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:43.516407 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 348/693] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:11:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:43.527334 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b3ebc9-8c74-48f6-b5a6-7cfbf328ffe5 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:43.689362 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495af80c-16b6-44dd-b888-fac777051084 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:43.748924 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec90ed9-f46d-4c7d-9473-8e0cc6173729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:43.749895 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec90ed9-f46d-4c7d-9473-8e0cc6173729 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:43.750181 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec90ed9-f46d-4c7d-9473-8e0cc6173729 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:43.750454 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec90ed9-f46d-4c7d-9473-8e0cc6173729 None admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:43.751380 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec90ed9-f46d-4c7d-9473-8e0cc6173729 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:43.751719 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec90ed9-f46d-4c7d-9473-8e0cc6173729 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:43.753879 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b3ebc9-8c74-48f6-b5a6-7cfbf328ffe5 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:43.754030 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec90ed9-f46d-4c7d-9473-8e0cc6173729 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:43.785746 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 346/694] 10.222.0.44 () {56 vars in 1135 bytes} [Mon May 9 20:11:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:11:43.804690 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec90ed9-f46d-4c7d-9473-8e0cc6173729 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:43.833341 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e7af70-1f67-40a8-a879-9434befd48db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:43.834016 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7af70-1f67-40a8-a879-9434befd48db None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:43.834298 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7af70-1f67-40a8-a879-9434befd48db None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:43.834600 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7af70-1f67-40a8-a879-9434befd48db None admin] PATH_INFO: `/v3/domains` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:43.835757 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e7af70-1f67-40a8-a879-9434befd48db None admin] RBAC: Adding query filter params (name=Default) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:43.836224 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e7af70-1f67-40a8-a879-9434befd48db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:43.838385 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e7af70-1f67-40a8-a879-9434befd48db None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:43.870336 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 349/695] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 9 20:11:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:43.871761 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e7af70-1f67-40a8-a879-9434befd48db None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:44.013795 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e7af70-1f67-40a8-a879-9434befd48db None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:44.020837 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec90ed9-f46d-4c7d-9473-8e0cc6173729 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:44.056084 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f870379-0ef9-43d1-814e-781b81869088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:44.056682 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f870379-0ef9-43d1-814e-781b81869088 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:44.056909 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f870379-0ef9-43d1-814e-781b81869088 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:44.059415 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f870379-0ef9-43d1-814e-781b81869088 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:44.059540 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a181fb-6f1b-476a-86d3-ec073c26c0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:44.060225 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a181fb-6f1b-476a-86d3-ec073c26c0b4 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:44.061297 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a181fb-6f1b-476a-86d3-ec073c26c0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:44.061579 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a181fb-6f1b-476a-86d3-ec073c26c0b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:44.070522 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a181fb-6f1b-476a-86d3-ec073c26c0b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:44.072535 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a181fb-6f1b-476a-86d3-ec073c26c0b4 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:44.092962 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-b7a181fb-6f1b-476a-86d3-ec073c26c0b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 20:11:44.092962 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:44.092962 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:44.092962 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:44.092962 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:44.092962 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:44.092962 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:44.092962 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:44.092962 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:44.092962 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:44.092962 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:44.092962 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:44.092962 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 20:11:44.092962 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 20:11:44.092962 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 20:11:44.093884 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 20:11:44.093884 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:44.093884 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:44.093884 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:44.093884 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:44.093884 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:44.093884 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:44.093884 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:44.093884 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:11:44.093884 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:44.093884 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:44.093884 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:44.093884 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:44.093884 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:44.093884 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:44.093884 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:44.093884 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:44.094781 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 20:11:44.094781 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 20:11:44.094781 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 20:11:44.094781 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 20:11:44.094781 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 20:11:44.094781 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 20:11:44.094781 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 20:11:44.094781 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:44.099473 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 350/696] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 9 20:11:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:44.102673 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f04f36-b0d2-4599-82b9-823f2889b791 None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:44.103278 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f04f36-b0d2-4599-82b9-823f2889b791 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:44.103586 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f04f36-b0d2-4599-82b9-823f2889b791 None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:44.105603 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 351/697] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:11:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:11:44.106305 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f04f36-b0d2-4599-82b9-823f2889b791 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:44.132164 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f870379-0ef9-43d1-814e-781b81869088 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:44.133680 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f870379-0ef9-43d1-814e-781b81869088 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:44.226871 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f04f36-b0d2-4599-82b9-823f2889b791 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:44.236044 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 347/698] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 9 20:11:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 09 20:11:44.237588 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d778daab-b320-44a2-ae63-4d993a0b38d4 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:44.237875 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d778daab-b320-44a2-ae63-4d993a0b38d4 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:44.238145 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d778daab-b320-44a2-ae63-4d993a0b38d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:44.263123 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-d778daab-b320-44a2-ae63-4d993a0b38d4 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:11:44.264329 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-d778daab-b320-44a2-ae63-4d993a0b38d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:11:44.270482 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23037556-07ac-4699-b5ad-3c67603dba85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:44.271141 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23037556-07ac-4699-b5ad-3c67603dba85 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:44.271435 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23037556-07ac-4699-b5ad-3c67603dba85 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:44.271713 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23037556-07ac-4699-b5ad-3c67603dba85 None admin] PATH_INFO: `/v3/projects` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:44.272500 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23037556-07ac-4699-b5ad-3c67603dba85 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:44.272803 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23037556-07ac-4699-b5ad-3c67603dba85 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:44.274791 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23037556-07ac-4699-b5ad-3c67603dba85 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:44.291856 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 352/699] 10.222.0.44 () {56 vars in 1148 bytes} [Mon May 9 20:11:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:44.295152 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23037556-07ac-4699-b5ad-3c67603dba85 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:44.349917 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 348/700] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:11:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 20:11:44.350705 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d778daab-b320-44a2-ae63-4d993a0b38d4 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:44.421780 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23037556-07ac-4699-b5ad-3c67603dba85 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:44.459010 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def3017a-c097-4cd2-b4ae-1897817bd2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:44.459831 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3017a-c097-4cd2-b4ae-1897817bd2a6 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:44.460119 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3017a-c097-4cd2-b4ae-1897817bd2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:44.460393 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3017a-c097-4cd2-b4ae-1897817bd2a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:44.462900 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d778daab-b320-44a2-ae63-4d993a0b38d4 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:44.473825 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def3017a-c097-4cd2-b4ae-1897817bd2a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:44.475283 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def3017a-c097-4cd2-b4ae-1897817bd2a6 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:44.492123 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-def3017a-c097-4cd2-b4ae-1897817bd2a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:44.492123 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:44.492123 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:44.492123 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:44.492123 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:44.492123 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:44.492123 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:44.492123 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:44.492123 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:44.492123 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:44.492123 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:44.492123 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:44.492123 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 20:11:44.492123 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 20:11:44.492123 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 20:11:44.493075 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 20:11:44.493075 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:44.493075 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:44.493075 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:44.493075 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:44.493075 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:44.493075 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:44.493075 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:44.493075 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:11:44.493075 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:44.493075 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:44.493075 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:44.493075 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:44.493075 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:44.493075 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:44.493075 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:44.493075 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:44.494013 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 20:11:44.494013 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 20:11:44.494013 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:44.494013 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:44.494013 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 353/701] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:11:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:44.494993 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def3017a-c097-4cd2-b4ae-1897817bd2a6 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:44.498124 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06e696a-9af0-432b-b0de-eb390b96fbd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:44.498738 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06e696a-9af0-432b-b0de-eb390b96fbd2 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:44.499013 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06e696a-9af0-432b-b0de-eb390b96fbd2 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:44.499278 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06e696a-9af0-432b-b0de-eb390b96fbd2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:44.500132 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06e696a-9af0-432b-b0de-eb390b96fbd2 None admin] RBAC: Adding query filter params (role.id=274130b78e304bb88789c1b349263f3c, scope.project.id=563db7f5a25f480e8e6568b92ec3f195, user.id=eb59440b21074d9da15679dc2d745f72) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:44.500435 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06e696a-9af0-432b-b0de-eb390b96fbd2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:44.502564 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06e696a-9af0-432b-b0de-eb390b96fbd2 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:44.508794 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 349/702] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 9 20:11:44 2022] GET /identity/v3/role_assignments?user.id=eb59440b21074d9da15679dc2d745f72&scope.project.id=563db7f5a25f480e8e6568b92ec3f195&role.id=274130b78e304bb88789c1b349263f3c => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:44.510065 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5580ddc5-b122-4f4b-a9b7-af242c4677d7 None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:44.510350 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5580ddc5-b122-4f4b-a9b7-af242c4677d7 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:44.510620 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5580ddc5-b122-4f4b-a9b7-af242c4677d7 None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:44.512056 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 350/703] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:11:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:11:44.516634 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5580ddc5-b122-4f4b-a9b7-af242c4677d7 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:44.644789 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def3017a-c097-4cd2-b4ae-1897817bd2a6 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:44.650557 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5580ddc5-b122-4f4b-a9b7-af242c4677d7 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:44.684163 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e32c925-8704-4b3b-8dcc-90478cc0a56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:44.685212 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e32c925-8704-4b3b-8dcc-90478cc0a56a None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:44.685599 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e32c925-8704-4b3b-8dcc-90478cc0a56a None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:44.685948 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e32c925-8704-4b3b-8dcc-90478cc0a56a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:44.686959 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e32c925-8704-4b3b-8dcc-90478cc0a56a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:44.688388 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e32c925-8704-4b3b-8dcc-90478cc0a56a None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:44.693032 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa30196-cdde-40b9-ab00-b754fc135581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:44.693963 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa30196-cdde-40b9-ab00-b754fc135581 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:44.694413 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa30196-cdde-40b9-ab00-b754fc135581 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:44.694897 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa30196-cdde-40b9-ab00-b754fc135581 None admin] PATH_INFO: `/v3/domains` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:44.695886 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa30196-cdde-40b9-ab00-b754fc135581 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:44.696400 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa30196-cdde-40b9-ab00-b754fc135581 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:44.698004 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa30196-cdde-40b9-ab00-b754fc135581 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:44.706015 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-0e32c925-8704-4b3b-8dcc-90478cc0a56a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 09 20:11:44.706015 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:44.706015 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 20:11:44.706015 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 20:11:44.706015 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 20:11:44.706015 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 20:11:44.706015 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 20:11:44.706015 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 20:11:44.706015 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 09 20:11:44.706015 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:44.706015 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 20:11:44.706015 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:44.706015 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:44.706015 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:44.706015 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:44.706015 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:44.707041 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:44.707041 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:44.707041 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:44.707041 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:44.707041 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:44.707041 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:44.707041 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:44.707041 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 20:11:44.707041 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 20:11:44.707041 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 20:11:44.707041 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 20:11:44.707041 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:44.707041 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:44.707041 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:44.707041 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:44.707041 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:44.707938 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:44.707938 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:44.707938 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:11:44.707938 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:44.707938 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:44.707938 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:44.707938 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:44.707938 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:44.707938 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:44.707938 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:44.707938 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:44.707938 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 20:11:44.707938 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 20:11:44.707938 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 09 20:11:44.707938 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:44.707938 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 354/704] 10.222.0.44 () {56 vars in 1129 bytes} [Mon May 9 20:11:44 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:44.709341 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2051fe1-f16a-48c8-b082-178693b0c8cd None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:44.709626 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2051fe1-f16a-48c8-b082-178693b0c8cd None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:44.709897 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2051fe1-f16a-48c8-b082-178693b0c8cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:44.714792 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 351/705] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 9 20:11:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:44.720177 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa30196-cdde-40b9-ab00-b754fc135581 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:44.727626 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-c2051fe1-f16a-48c8-b082-178693b0c8cd None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:11:44.728854 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-c2051fe1-f16a-48c8-b082-178693b0c8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:11:44.803418 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 355/706] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:11:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 20:11:44.803418 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2051fe1-f16a-48c8-b082-178693b0c8cd None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:44.848247 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa30196-cdde-40b9-ab00-b754fc135581 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:44.884896 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aebbba-0dfb-4b04-930c-c9afb36f25e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:44.885587 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aebbba-0dfb-4b04-930c-c9afb36f25e5 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:44.885863 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aebbba-0dfb-4b04-930c-c9afb36f25e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:44.886130 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aebbba-0dfb-4b04-930c-c9afb36f25e5 None admin] PATH_INFO: `/v3/services` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:44.886830 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aebbba-0dfb-4b04-930c-c9afb36f25e5 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:44.887129 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aebbba-0dfb-4b04-930c-c9afb36f25e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:44.888520 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aebbba-0dfb-4b04-930c-c9afb36f25e5 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:44.897647 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 352/707] 10.222.0.44 () {56 vars in 1124 bytes} [Mon May 9 20:11:44 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:44.897647 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aebbba-0dfb-4b04-930c-c9afb36f25e5 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:44.910818 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2051fe1-f16a-48c8-b082-178693b0c8cd None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:44.944366 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a912ff95-8762-4375-adaf-53bdde76cccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:44.945168 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a912ff95-8762-4375-adaf-53bdde76cccb None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:44.945457 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a912ff95-8762-4375-adaf-53bdde76cccb None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:44.945712 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a912ff95-8762-4375-adaf-53bdde76cccb None admin] PATH_INFO: `/v3/projects/service` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:44.952103 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a912ff95-8762-4375-adaf-53bdde76cccb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:44.953540 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a912ff95-8762-4375-adaf-53bdde76cccb None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:44.966876 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-a912ff95-8762-4375-adaf-53bdde76cccb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 20:11:44.966876 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:44.966876 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:44.966876 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:44.966876 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:44.966876 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:44.966876 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:44.966876 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:44.966876 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:44.966876 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:44.966876 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:44.966876 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:44.966876 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 20:11:44.966876 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 20:11:44.966876 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 20:11:44.968002 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 20:11:44.968002 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:44.968002 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:44.968002 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:44.968002 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:44.968002 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:44.968002 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:44.968002 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:44.968002 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:11:44.968002 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:44.968002 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:44.968002 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:44.968002 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:44.968002 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:44.968002 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:44.968002 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:44.968002 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:44.968918 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 20:11:44.968918 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 20:11:44.968918 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 20:11:44.968918 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 20:11:44.968918 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 20:11:44.968918 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 20:11:44.968918 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 20:11:44.968918 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:44.968918 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 356/708] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 9 20:11:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:44.969798 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456b958-8fcc-409a-9d39-ea1608e35ac6 None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:44.969798 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456b958-8fcc-409a-9d39-ea1608e35ac6 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:44.969798 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456b958-8fcc-409a-9d39-ea1608e35ac6 None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:44.975792 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 357/709] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:11:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:11:44.976342 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e456b958-8fcc-409a-9d39-ea1608e35ac6 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:44.998163 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aebbba-0dfb-4b04-930c-c9afb36f25e5 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:45.033925 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31483fb1-4fbd-4aaa-9b3a-2762bd034135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:45.034720 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31483fb1-4fbd-4aaa-9b3a-2762bd034135 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:45.034998 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31483fb1-4fbd-4aaa-9b3a-2762bd034135 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:45.035266 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31483fb1-4fbd-4aaa-9b3a-2762bd034135 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:45.046000 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31483fb1-4fbd-4aaa-9b3a-2762bd034135 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:45.047465 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31483fb1-4fbd-4aaa-9b3a-2762bd034135 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:45.063913 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-31483fb1-4fbd-4aaa-9b3a-2762bd034135 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:45.063913 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:45.063913 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:45.063913 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:45.063913 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:45.063913 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:45.063913 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:45.063913 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:45.063913 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:45.063913 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:45.063913 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:45.063913 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:45.063913 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 20:11:45.063913 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 20:11:45.063913 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 20:11:45.065879 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 20:11:45.065879 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:45.065879 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:45.065879 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:45.065879 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:45.065879 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:45.065879 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:45.065879 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:45.065879 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:11:45.065879 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:45.065879 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:45.065879 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:45.065879 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:45.065879 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:45.065879 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:45.065879 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:45.065879 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:45.071859 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 20:11:45.071859 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 20:11:45.071859 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:45.071859 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:11:45.071859 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 353/710] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:11:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:45.071859 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31483fb1-4fbd-4aaa-9b3a-2762bd034135 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:45.090052 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e456b958-8fcc-409a-9d39-ea1608e35ac6 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:45.122865 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a698f1b-cda9-43ab-b82d-c2709c2c240c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:45.123548 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a698f1b-cda9-43ab-b82d-c2709c2c240c None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:45.123860 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a698f1b-cda9-43ab-b82d-c2709c2c240c None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:45.124093 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a698f1b-cda9-43ab-b82d-c2709c2c240c None admin] PATH_INFO: `/v3/services` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:45.124806 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a698f1b-cda9-43ab-b82d-c2709c2c240c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:45.125105 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a698f1b-cda9-43ab-b82d-c2709c2c240c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:45.126462 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a698f1b-cda9-43ab-b82d-c2709c2c240c None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:45.143616 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 358/711] 10.222.0.44 () {56 vars in 1124 bytes} [Mon May 9 20:11:44 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:45.143616 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7b7d3-a5d7-4847-97b7-5daa6ffb4f1c None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:45.143616 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7b7d3-a5d7-4847-97b7-5daa6ffb4f1c None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:45.143616 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7b7d3-a5d7-4847-97b7-5daa6ffb4f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:45.163770 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-44f7b7d3-a5d7-4847-97b7-5daa6ffb4f1c None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:11:45.164918 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-44f7b7d3-a5d7-4847-97b7-5daa6ffb4f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:11:45.201690 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31483fb1-4fbd-4aaa-9b3a-2762bd034135 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:45.241240 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 359/712] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:11:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 20:11:45.241888 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f7b7d3-a5d7-4847-97b7-5daa6ffb4f1c None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:45.248999 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ccf8d8-ebf0-482c-be84-825b689d8bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:45.249667 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ccf8d8-ebf0-482c-be84-825b689d8bc8 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:45.249946 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ccf8d8-ebf0-482c-be84-825b689d8bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:45.250217 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ccf8d8-ebf0-482c-be84-825b689d8bc8 None admin] PATH_INFO: `/v3/projects` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:45.251499 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ccf8d8-ebf0-482c-be84-825b689d8bc8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:45.252316 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ccf8d8-ebf0-482c-be84-825b689d8bc8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:45.254162 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ccf8d8-ebf0-482c-be84-825b689d8bc8 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:45.271860 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 354/713] 10.222.0.44 () {56 vars in 1148 bytes} [Mon May 9 20:11:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:45.280557 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ccf8d8-ebf0-482c-be84-825b689d8bc8 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:45.378104 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f7b7d3-a5d7-4847-97b7-5daa6ffb4f1c None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:45.401321 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ccf8d8-ebf0-482c-be84-825b689d8bc8 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:45.411950 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ef2fd-f6bb-49c8-b983-239b14db7248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:45.412604 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ef2fd-f6bb-49c8-b983-239b14db7248 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:45.412881 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ef2fd-f6bb-49c8-b983-239b14db7248 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:45.413154 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ef2fd-f6bb-49c8-b983-239b14db7248 None admin] PATH_INFO: `/v3/domains` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:45.413926 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941ef2fd-f6bb-49c8-b983-239b14db7248 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:45.414175 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941ef2fd-f6bb-49c8-b983-239b14db7248 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:45.415569 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941ef2fd-f6bb-49c8-b983-239b14db7248 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:45.431835 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 360/714] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 9 20:11:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:45.432896 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ef2fd-f6bb-49c8-b983-239b14db7248 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:45.443366 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b52dc8-f4fa-443f-8dba-cca72a90346f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:45.443366 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b52dc8-f4fa-443f-8dba-cca72a90346f None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:45.443366 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b52dc8-f4fa-443f-8dba-cca72a90346f None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:45.443366 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b52dc8-f4fa-443f-8dba-cca72a90346f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:45.443762 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b52dc8-f4fa-443f-8dba-cca72a90346f None admin] RBAC: Adding query filter params (role.id=1ec9314b191d4bd59d71fe4d635de747, scope.project.id=563db7f5a25f480e8e6568b92ec3f195, user.id=965089f1a92f49bd883b337d6042c69f) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:45.443762 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b52dc8-f4fa-443f-8dba-cca72a90346f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:45.443762 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b52dc8-f4fa-443f-8dba-cca72a90346f None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:45.449485 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 355/715] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 9 20:11:45 2022] GET /identity/v3/role_assignments?user.id=965089f1a92f49bd883b337d6042c69f&scope.project.id=563db7f5a25f480e8e6568b92ec3f195&role.id=1ec9314b191d4bd59d71fe4d635de747 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:45.450383 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b52dc8-f4fa-443f-8dba-cca72a90346f None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:45.583810 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b52dc8-f4fa-443f-8dba-cca72a90346f None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:45.599656 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ef2fd-f6bb-49c8-b983-239b14db7248 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:45.621557 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f1ab8-c372-4b4e-8cef-b7dcd617100f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:45.622240 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f1ab8-c372-4b4e-8cef-b7dcd617100f None admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:45.622584 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f1ab8-c372-4b4e-8cef-b7dcd617100f None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:45.622860 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f1ab8-c372-4b4e-8cef-b7dcd617100f None admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:45.623629 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526f1ab8-c372-4b4e-8cef-b7dcd617100f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:45.625121 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526f1ab8-c372-4b4e-8cef-b7dcd617100f None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:45.656736 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 356/716] 10.222.0.44 () {60 vars in 1132 bytes} [Mon May 9 20:11:45 2022] POST /identity/v3/users => generated 254 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:11:45.671849 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68834a4-0b77-41f2-8576-6c12146f67e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:45.672585 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68834a4-0b77-41f2-8576-6c12146f67e5 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:45.672865 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68834a4-0b77-41f2-8576-6c12146f67e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:45.673241 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68834a4-0b77-41f2-8576-6c12146f67e5 None admin] PATH_INFO: `/v3/services/network` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:45.675309 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68834a4-0b77-41f2-8576-6c12146f67e5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:45.676841 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68834a4-0b77-41f2-8576-6c12146f67e5 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:45.690622 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-f68834a4-0b77-41f2-8576-6c12146f67e5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 09 20:11:45.690622 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:45.690622 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 20:11:45.690622 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 20:11:45.690622 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 20:11:45.690622 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 20:11:45.690622 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 20:11:45.690622 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 20:11:45.690622 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 09 20:11:45.690622 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:45.690622 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 20:11:45.690622 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:45.690622 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:45.690622 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:45.690622 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:45.690622 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:45.690622 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:45.691800 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:45.691800 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:45.691800 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:45.691800 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:45.691800 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:45.691800 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:45.691800 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 20:11:45.691800 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 20:11:45.691800 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 20:11:45.691800 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 20:11:45.691800 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:45.691800 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:45.691800 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:45.691800 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:45.691800 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:45.691800 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:45.692662 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:45.692662 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:11:45.692662 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:45.692662 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:45.692662 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:45.692662 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:45.692662 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:45.692662 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:45.692662 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:45.692662 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:45.692662 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 20:11:45.692662 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 20:11:45.692662 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 09 20:11:45.692662 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:45.692662 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 361/717] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 9 20:11:45 2022] GET /identity/v3/services/network => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:45.698404 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f1ab8-c372-4b4e-8cef-b7dcd617100f None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:45.823374 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f1ab8-c372-4b4e-8cef-b7dcd617100f None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:45.862490 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7715c470-f577-4b7e-b56a-331b5c40118d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:45.863268 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7715c470-f577-4b7e-b56a-331b5c40118d None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:45.863578 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7715c470-f577-4b7e-b56a-331b5c40118d None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:45.863844 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7715c470-f577-4b7e-b56a-331b5c40118d None admin] PATH_INFO: `/v3/services` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:45.864556 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7715c470-f577-4b7e-b56a-331b5c40118d None admin] RBAC: Adding query filter params (name=network) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:45.864854 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7715c470-f577-4b7e-b56a-331b5c40118d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:45.866233 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7715c470-f577-4b7e-b56a-331b5c40118d None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:45.871069 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 357/718] 10.222.0.44 () {56 vars in 1112 bytes} [Mon May 9 20:11:45 2022] GET /identity/v3/services?name=network => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:45.877292 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68834a4-0b77-41f2-8576-6c12146f67e5 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:45.992964 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68834a4-0b77-41f2-8576-6c12146f67e5 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:46.029806 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598a63cb-bed9-480e-9e1b-88f79c37c303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:46.030569 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a63cb-bed9-480e-9e1b-88f79c37c303 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:46.030856 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a63cb-bed9-480e-9e1b-88f79c37c303 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:46.031132 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a63cb-bed9-480e-9e1b-88f79c37c303 None admin] PATH_INFO: `/v3/services` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:46.031880 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598a63cb-bed9-480e-9e1b-88f79c37c303 None admin] RBAC: Adding query filter params (type=network) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:46.032188 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598a63cb-bed9-480e-9e1b-88f79c37c303 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:46.034793 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598a63cb-bed9-480e-9e1b-88f79c37c303 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:46.039874 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 362/719] 10.222.0.44 () {56 vars in 1112 bytes} [Mon May 9 20:11:45 2022] GET /identity/v3/services?type=network => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:46.918461 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde26c07-6f22-4141-8d3a-a58c9c49564a None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:46.918972 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde26c07-6f22-4141-8d3a-a58c9c49564a None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:46.918972 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde26c07-6f22-4141-8d3a-a58c9c49564a None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:46.920619 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 358/720] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:11:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:11:46.926699 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed055c74-bddd-4a4d-b430-927dc2974ca2 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:46.927143 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed055c74-bddd-4a4d-b430-927dc2974ca2 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:46.927237 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed055c74-bddd-4a4d-b430-927dc2974ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:46.960395 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-ed055c74-bddd-4a4d-b430-927dc2974ca2 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:11:46.961590 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-ed055c74-bddd-4a4d-b430-927dc2974ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:11:47.073080 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 363/721] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:11:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 20:11:47.107968 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde26c07-6f22-4141-8d3a-a58c9c49564a None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:47.240075 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde26c07-6f22-4141-8d3a-a58c9c49564a None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:47.291719 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f3c373-d924-46b3-8d1f-53fd8a155f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:47.292504 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3c373-d924-46b3-8d1f-53fd8a155f67 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:47.292781 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3c373-d924-46b3-8d1f-53fd8a155f67 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:47.293040 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3c373-d924-46b3-8d1f-53fd8a155f67 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:47.308231 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f3c373-d924-46b3-8d1f-53fd8a155f67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:11:47.316701 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-54f3c373-d924-46b3-8d1f-53fd8a155f67 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 20:11:47.316701 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:47.316701 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:47.316701 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:47.316701 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:47.316701 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:47.316701 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:47.316701 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:47.316701 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:47.316701 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:47.316701 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:47.316701 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:47.316701 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:11:47.316701 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:11:47.316701 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:11:47.316701 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:11:47.317661 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:11:47.317661 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:11:47.317661 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:11:47.317661 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:11:47.317661 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:47.317661 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:47.317661 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:47.317661 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:47.317661 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:47.317661 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:47.317661 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:47.317661 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:11:47.317661 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:47.317661 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:47.317661 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:47.317661 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:47.318511 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:47.318511 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:47.318511 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:47.318511 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:47.318511 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:11:47.318511 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:11:47.318511 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:11:47.318511 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:11:47.318511 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:11:47.318511 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:11:47.318511 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 20:11:47.318511 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:11:47.318511 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 359/722] 10.222.0.44 () {56 vars in 1096 bytes} [Mon May 9 20:11:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:47.324495 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed055c74-bddd-4a4d-b430-927dc2974ca2 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:47.451096 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed055c74-bddd-4a4d-b430-927dc2974ca2 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:47.496723 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaed692-8808-4fc8-b5fe-48d950d3007c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:47.497308 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaed692-8808-4fc8-b5fe-48d950d3007c None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:47.497588 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaed692-8808-4fc8-b5fe-48d950d3007c None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:47.497859 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaed692-8808-4fc8-b5fe-48d950d3007c None admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:47.498607 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaed692-8808-4fc8-b5fe-48d950d3007c None admin] RBAC: Adding query filter params (name=admin) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:47.498908 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaed692-8808-4fc8-b5fe-48d950d3007c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:47.500308 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaed692-8808-4fc8-b5fe-48d950d3007c None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:47.514906 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 364/723] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 9 20:11:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:47.521001 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f3c373-d924-46b3-8d1f-53fd8a155f67 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:47.657791 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f3c373-d924-46b3-8d1f-53fd8a155f67 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:47.704961 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0948a956-ed32-446a-8c84-f0b73d66a352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:47.705743 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0948a956-ed32-446a-8c84-f0b73d66a352 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:47.706020 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0948a956-ed32-446a-8c84-f0b73d66a352 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:47.706286 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0948a956-ed32-446a-8c84-f0b73d66a352 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:47.719234 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0948a956-ed32-446a-8c84-f0b73d66a352 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:47.720737 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0948a956-ed32-446a-8c84-f0b73d66a352 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:47.743045 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-0948a956-ed32-446a-8c84-f0b73d66a352 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:47.743045 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:47.743045 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:47.743045 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:47.743045 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:47.743045 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:47.743045 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:47.743045 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:47.743045 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:47.743045 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:47.743045 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:47.743045 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:47.743045 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 20:11:47.743045 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 20:11:47.743045 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 20:11:47.744075 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 20:11:47.744075 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:47.744075 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:47.744075 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:47.744075 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:47.744075 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:47.744075 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:47.744075 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:47.744075 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:11:47.744075 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:47.744075 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:47.744075 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:47.744075 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:47.744075 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:47.744075 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:47.744075 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:47.744075 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:47.745613 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 20:11:47.745613 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 20:11:47.745613 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:47.745613 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:11:47.745613 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 360/724] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:11:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:47.750186 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaed692-8808-4fc8-b5fe-48d950d3007c None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:47.881628 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaed692-8808-4fc8-b5fe-48d950d3007c None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:47.918989 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a3a44-1e49-48a4-86e2-155bd455c522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:47.920061 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a3a44-1e49-48a4-86e2-155bd455c522 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:47.920548 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a3a44-1e49-48a4-86e2-155bd455c522 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:47.921042 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a3a44-1e49-48a4-86e2-155bd455c522 None admin] PATH_INFO: `/v3/domains` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:47.922009 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56a3a44-1e49-48a4-86e2-155bd455c522 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:47.922535 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56a3a44-1e49-48a4-86e2-155bd455c522 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:47.924683 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56a3a44-1e49-48a4-86e2-155bd455c522 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:47.937736 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 365/725] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 9 20:11:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:47.942903 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0948a956-ed32-446a-8c84-f0b73d66a352 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:48.053669 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0948a956-ed32-446a-8c84-f0b73d66a352 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:48.080279 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e4ede-7702-4e76-aeb9-d5a2a26e58fe None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:48.080614 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e4ede-7702-4e76-aeb9-d5a2a26e58fe None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:48.080827 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e4ede-7702-4e76-aeb9-d5a2a26e58fe None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:48.082459 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 366/726] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:11:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:11:48.089393 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad5e526-7635-4c8e-8c0f-48c324a1899a None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:48.089955 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad5e526-7635-4c8e-8c0f-48c324a1899a None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:48.090429 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad5e526-7635-4c8e-8c0f-48c324a1899a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:48.093581 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37079140-d239-4d1f-aa5d-672e235d81ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:48.094598 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37079140-d239-4d1f-aa5d-672e235d81ae None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:48.095075 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37079140-d239-4d1f-aa5d-672e235d81ae None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:48.096133 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37079140-d239-4d1f-aa5d-672e235d81ae None admin] PATH_INFO: `/v3/users/nova` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:48.114641 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37079140-d239-4d1f-aa5d-672e235d81ae None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:48.116489 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37079140-d239-4d1f-aa5d-672e235d81ae None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:48.129197 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-8ad5e526-7635-4c8e-8c0f-48c324a1899a None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:11:48.130712 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-8ad5e526-7635-4c8e-8c0f-48c324a1899a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:11:48.141322 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-37079140-d239-4d1f-aa5d-672e235d81ae None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 09 20:11:48.141322 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:48.141322 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:48.141322 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:48.141322 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:48.141322 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:48.141322 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:48.141322 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:48.141322 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:48.141322 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:48.141322 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:48.141322 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:48.141322 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 20:11:48.141322 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 20:11:48.141322 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 20:11:48.141322 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 20:11:48.142373 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:48.142373 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:48.142373 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 20:11:48.142373 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 20:11:48.142373 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 20:11:48.142373 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 20:11:48.142373 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:48.142373 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:48.142373 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:48.142373 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:48.142373 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:48.142373 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:11:48.142373 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:48.142373 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:48.142373 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:48.142373 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:48.142373 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:48.142373 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:48.143343 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:48.143343 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:48.143343 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 20:11:48.143343 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 20:11:48.143343 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 20:11:48.143343 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 20:11:48.143343 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 20:11:48.143343 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 20:11:48.143343 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 09 20:11:48.143343 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:11:48.156215 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 361/727] 10.222.0.44 () {56 vars in 1093 bytes} [Mon May 9 20:11:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:48.162634 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37079140-d239-4d1f-aa5d-672e235d81ae None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:48.295423 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 367/728] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:11:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 20:11:48.300908 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37079140-d239-4d1f-aa5d-672e235d81ae None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:48.327036 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad5e526-7635-4c8e-8c0f-48c324a1899a None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:48.396266 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f35ff9-2f92-4d61-b314-17018f40325e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:48.397266 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f35ff9-2f92-4d61-b314-17018f40325e None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:48.397266 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f35ff9-2f92-4d61-b314-17018f40325e None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:48.397567 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f35ff9-2f92-4d61-b314-17018f40325e None admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:48.398390 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f35ff9-2f92-4d61-b314-17018f40325e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:48.398779 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f35ff9-2f92-4d61-b314-17018f40325e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:48.400217 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f35ff9-2f92-4d61-b314-17018f40325e None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:48.444423 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad5e526-7635-4c8e-8c0f-48c324a1899a None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:48.483882 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af71783e-05f9-439a-8a39-1d281a33ce21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:48.484953 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af71783e-05f9-439a-8a39-1d281a33ce21 None admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:48.485437 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af71783e-05f9-439a-8a39-1d281a33ce21 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:48.485909 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af71783e-05f9-439a-8a39-1d281a33ce21 None admin] PATH_INFO: `/v3/services` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:48.487376 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af71783e-05f9-439a-8a39-1d281a33ce21 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:48.489066 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af71783e-05f9-439a-8a39-1d281a33ce21 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:48.517175 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 368/729] 10.222.0.44 () {60 vars in 1141 bytes} [Mon May 9 20:11:48 2022] POST /identity/v3/services => generated 251 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 20:11:48.561388 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e286a078-8cb3-40da-8ea3-8137a0e25a60 None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:48.562061 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e286a078-8cb3-40da-8ea3-8137a0e25a60 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:48.562937 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e286a078-8cb3-40da-8ea3-8137a0e25a60 None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:48.572872 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 369/730] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:11:48 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 20:11:48.578865 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be62f8-54a0-4c6d-8ce2-9ae571f5b314 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:48.578865 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be62f8-54a0-4c6d-8ce2-9ae571f5b314 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:48.578865 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be62f8-54a0-4c6d-8ce2-9ae571f5b314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:48.586753 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 362/731] 10.222.0.44 () {56 vars in 1133 bytes} [Mon May 9 20:11:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 421 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:48.588956 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f35ff9-2f92-4d61-b314-17018f40325e None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:48.640592 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-14be62f8-54a0-4c6d-8ce2-9ae571f5b314 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:11:48.645256 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-14be62f8-54a0-4c6d-8ce2-9ae571f5b314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:11:48.726872 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f35ff9-2f92-4d61-b314-17018f40325e None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:48.731944 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 370/732] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:11:48 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 20:11:48.733410 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78aeb05-f4c1-4a22-98a9-2e8cdf8a5d21 None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:48.733684 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78aeb05-f4c1-4a22-98a9-2e8cdf8a5d21 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:48.734009 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78aeb05-f4c1-4a22-98a9-2e8cdf8a5d21 None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:48.739645 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 371/733] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:11:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:11:48.741874 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31693cef-c4af-4ab2-8143-1d060e45f654 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:48.742161 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31693cef-c4af-4ab2-8143-1d060e45f654 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:48.742431 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31693cef-c4af-4ab2-8143-1d060e45f654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:48.760215 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-31693cef-c4af-4ab2-8143-1d060e45f654 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:11:48.761423 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-31693cef-c4af-4ab2-8143-1d060e45f654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:11:48.769440 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801e9524-9f8d-4d26-a164-2f53b24bfc9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:48.770729 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e9524-9f8d-4d26-a164-2f53b24bfc9b None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:48.771063 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e9524-9f8d-4d26-a164-2f53b24bfc9b None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:48.771354 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e9524-9f8d-4d26-a164-2f53b24bfc9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:48.782276 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801e9524-9f8d-4d26-a164-2f53b24bfc9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:48.784710 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801e9524-9f8d-4d26-a164-2f53b24bfc9b None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:48.801908 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-801e9524-9f8d-4d26-a164-2f53b24bfc9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:48.801908 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:48.801908 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:48.801908 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:48.801908 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:48.801908 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:48.801908 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:48.801908 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:48.801908 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:48.801908 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:48.801908 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:48.801908 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:48.801908 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 20:11:48.801908 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 20:11:48.801908 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 20:11:48.802835 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 20:11:48.802835 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:48.802835 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:48.802835 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:48.802835 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:48.802835 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:48.802835 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:48.802835 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:48.802835 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:11:48.802835 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:48.802835 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:48.802835 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:48.802835 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:48.802835 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:48.802835 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:48.802835 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:48.802835 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:48.804145 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 20:11:48.804145 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 20:11:48.804145 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:48.804145 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:11:48.804145 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 363/734] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:11:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:48.804428 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801e9524-9f8d-4d26-a164-2f53b24bfc9b None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:48.851496 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 372/735] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:11:48 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 20:11:48.851496 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31693cef-c4af-4ab2-8143-1d060e45f654 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:48.946498 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801e9524-9f8d-4d26-a164-2f53b24bfc9b None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:48.962975 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31693cef-c4af-4ab2-8143-1d060e45f654 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:48.982862 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86131f3f-058b-4edd-aeac-158a798a69dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:48.983681 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86131f3f-058b-4edd-aeac-158a798a69dd None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:48.983962 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86131f3f-058b-4edd-aeac-158a798a69dd None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:48.984235 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86131f3f-058b-4edd-aeac-158a798a69dd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:48.996134 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86131f3f-058b-4edd-aeac-158a798a69dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:11:48.998978 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1f1641-6685-4731-849e-629a22635e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:48.999671 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1f1641-6685-4731-849e-629a22635e15 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:48.999954 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1f1641-6685-4731-849e-629a22635e15 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:49.000224 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1f1641-6685-4731-849e-629a22635e15 None admin] PATH_INFO: `/v3/domains` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:49.000947 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1f1641-6685-4731-849e-629a22635e15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:49.001251 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1f1641-6685-4731-849e-629a22635e15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:49.003025 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1f1641-6685-4731-849e-629a22635e15 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:49.004179 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-86131f3f-058b-4edd-aeac-158a798a69dd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 20:11:49.004179 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:49.004179 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:49.004179 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:49.004179 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:49.004179 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:49.004179 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:49.004179 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:49.004179 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:49.004179 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:49.004179 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:49.004179 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:49.004179 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:11:49.004179 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:11:49.004179 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:11:49.004179 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:11:49.005091 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:11:49.005091 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:11:49.005091 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:11:49.005091 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:11:49.005091 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:49.005091 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:49.005091 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:49.005091 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:49.005091 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:49.005091 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:49.005091 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:49.005091 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:11:49.005091 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:49.005091 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:49.005091 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:49.005091 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:49.006189 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:49.006189 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:49.006189 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:49.006189 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:49.006189 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:11:49.006189 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:11:49.006189 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:11:49.006189 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:11:49.006189 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:11:49.006189 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:11:49.006189 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 20:11:49.006189 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:11:49.006189 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 364/736] 10.222.0.44 () {56 vars in 1096 bytes} [Mon May 9 20:11:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:49.006891 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86131f3f-058b-4edd-aeac-158a798a69dd None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:49.015225 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 373/737] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 9 20:11:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:49.020222 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1f1641-6685-4731-849e-629a22635e15 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:49.119942 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86131f3f-058b-4edd-aeac-158a798a69dd None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:49.120710 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1f1641-6685-4731-849e-629a22635e15 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:49.156155 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126f223d-e222-4fef-8ada-40a0eab6d370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:49.156834 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f223d-e222-4fef-8ada-40a0eab6d370 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:49.157113 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f223d-e222-4fef-8ada-40a0eab6d370 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:49.157388 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f223d-e222-4fef-8ada-40a0eab6d370 None admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:49.158725 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126f223d-e222-4fef-8ada-40a0eab6d370 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:49.159622 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126f223d-e222-4fef-8ada-40a0eab6d370 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:49.160685 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126f223d-e222-4fef-8ada-40a0eab6d370 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:49.162046 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba18372c-9fa7-435a-ab15-efed892dc9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:49.163110 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba18372c-9fa7-435a-ab15-efed892dc9b1 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:49.163673 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba18372c-9fa7-435a-ab15-efed892dc9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:49.164172 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba18372c-9fa7-435a-ab15-efed892dc9b1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:49.175431 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 374/738] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 9 20:11:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:49.175431 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126f223d-e222-4fef-8ada-40a0eab6d370 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:49.182334 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba18372c-9fa7-435a-ab15-efed892dc9b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:11:49.191381 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-ba18372c-9fa7-435a-ab15-efed892dc9b1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 20:11:49.191381 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:49.191381 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:49.191381 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:49.191381 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:49.191381 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:49.191381 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:49.191381 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:49.191381 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:49.191381 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:49.191381 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:49.191381 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:49.191381 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:11:49.191381 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:11:49.191381 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:11:49.191381 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:11:49.192384 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:11:49.192384 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:11:49.192384 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:11:49.192384 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:11:49.192384 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:49.192384 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:49.192384 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:49.192384 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:49.192384 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:49.192384 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:49.192384 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:49.192384 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:11:49.192384 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:49.192384 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:49.192384 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:49.192384 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:49.193217 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:49.193217 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:49.193217 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:49.193217 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:49.193217 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:11:49.193217 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:11:49.193217 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:11:49.193217 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:11:49.193217 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:11:49.193217 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:11:49.193217 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 20:11:49.193217 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:11:49.200524 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 365/739] 10.222.0.44 () {56 vars in 1102 bytes} [Mon May 9 20:11:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:49.201649 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba18372c-9fa7-435a-ab15-efed892dc9b1 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:49.283731 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126f223d-e222-4fef-8ada-40a0eab6d370 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:49.320634 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b482a-8b33-46bf-ba91-6838e0fd53d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:49.321421 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b482a-8b33-46bf-ba91-6838e0fd53d8 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:49.321703 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b482a-8b33-46bf-ba91-6838e0fd53d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:49.321974 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b482a-8b33-46bf-ba91-6838e0fd53d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:49.328817 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81b482a-8b33-46bf-ba91-6838e0fd53d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:49.329798 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba18372c-9fa7-435a-ab15-efed892dc9b1 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:49.330483 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81b482a-8b33-46bf-ba91-6838e0fd53d8 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:49.366548 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d65c1d-179e-4f97-aed6-6eff6264505c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:49.367361 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d65c1d-179e-4f97-aed6-6eff6264505c None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:49.367684 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d65c1d-179e-4f97-aed6-6eff6264505c None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:49.367955 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d65c1d-179e-4f97-aed6-6eff6264505c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:49.380322 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d65c1d-179e-4f97-aed6-6eff6264505c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:49.382035 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d65c1d-179e-4f97-aed6-6eff6264505c None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:49.400392 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-e4d65c1d-179e-4f97-aed6-6eff6264505c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:49.400392 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:49.400392 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:49.400392 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:49.400392 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:49.400392 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:49.400392 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:49.400392 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:49.400392 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:49.400392 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:49.400392 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:49.400392 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:49.400392 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 20:11:49.400392 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 20:11:49.400392 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 20:11:49.401393 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 20:11:49.401393 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:49.401393 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:49.401393 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:49.401393 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:49.401393 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:49.401393 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:49.401393 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:49.401393 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:11:49.401393 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:49.401393 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:49.401393 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:49.401393 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:49.401393 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:49.401393 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:49.401393 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:49.401393 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:49.402986 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 20:11:49.402986 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 20:11:49.402986 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:49.402986 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:11:49.402986 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 366/740] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:11:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:49.402986 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d65c1d-179e-4f97-aed6-6eff6264505c None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:49.465738 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-e81b482a-8b33-46bf-ba91-6838e0fd53d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 20:11:49.465738 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:49.465738 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:49.465738 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:49.465738 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:49.465738 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:49.465738 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:49.465738 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:49.465738 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:49.465738 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:49.465738 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:49.465738 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:49.465738 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 20:11:49.465738 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 20:11:49.465738 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 20:11:49.466761 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 20:11:49.466761 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:49.466761 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:49.466761 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:49.466761 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:49.466761 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:49.466761 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:49.466761 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:49.466761 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:11:49.466761 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:49.466761 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:49.466761 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:49.466761 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:49.466761 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:49.466761 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:49.466761 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:49.466761 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:49.467724 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 20:11:49.467724 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 20:11:49.467724 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 20:11:49.467724 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 20:11:49.467724 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 20:11:49.467724 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 20:11:49.467724 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 20:11:49.467724 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:49.471918 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 375/741] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 9 20:11:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:49.472926 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96432e9-cbef-453e-b756-5b918465510a None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:49.473203 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96432e9-cbef-453e-b756-5b918465510a None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:49.473479 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96432e9-cbef-453e-b756-5b918465510a None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:49.474735 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 376/742] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:11:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:11:49.475905 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96432e9-cbef-453e-b756-5b918465510a None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:49.517598 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d65c1d-179e-4f97-aed6-6eff6264505c None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:49.552619 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a84d847-e23b-4c27-9ff8-c8cd2becb84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:49.553293 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84d847-e23b-4c27-9ff8-c8cd2becb84e None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:49.553566 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84d847-e23b-4c27-9ff8-c8cd2becb84e None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:49.553833 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84d847-e23b-4c27-9ff8-c8cd2becb84e None admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:49.554559 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a84d847-e23b-4c27-9ff8-c8cd2becb84e None admin] RBAC: Adding query filter params (name=service) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:49.554856 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a84d847-e23b-4c27-9ff8-c8cd2becb84e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:49.556235 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a84d847-e23b-4c27-9ff8-c8cd2becb84e None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:49.568123 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 367/743] 10.222.0.44 () {56 vars in 1103 bytes} [Mon May 9 20:11:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:49.568123 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a84d847-e23b-4c27-9ff8-c8cd2becb84e None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:49.585253 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96432e9-cbef-453e-b756-5b918465510a None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:49.618756 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c25daa-be81-44a6-a8af-75eb7808c867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:49.619587 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c25daa-be81-44a6-a8af-75eb7808c867 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:49.619959 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c25daa-be81-44a6-a8af-75eb7808c867 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:49.620336 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c25daa-be81-44a6-a8af-75eb7808c867 None admin] PATH_INFO: `/v3/domains` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:49.621129 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c25daa-be81-44a6-a8af-75eb7808c867 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:49.621495 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c25daa-be81-44a6-a8af-75eb7808c867 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:49.622916 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c25daa-be81-44a6-a8af-75eb7808c867 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:49.639282 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 377/744] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 9 20:11:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:49.641492 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac72568-c7b1-46d3-b5ab-62d4dee338fc None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:49.641935 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac72568-c7b1-46d3-b5ab-62d4dee338fc None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:49.642828 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac72568-c7b1-46d3-b5ab-62d4dee338fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:49.659229 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-6ac72568-c7b1-46d3-b5ab-62d4dee338fc None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:11:49.660489 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-6ac72568-c7b1-46d3-b5ab-62d4dee338fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:11:49.664221 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a84d847-e23b-4c27-9ff8-c8cd2becb84e None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:49.697296 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166f59a9-ea77-41a8-9275-071d6658241a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:49.697945 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f59a9-ea77-41a8-9275-071d6658241a None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:49.698212 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f59a9-ea77-41a8-9275-071d6658241a None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:49.698477 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f59a9-ea77-41a8-9275-071d6658241a None admin] PATH_INFO: `/v3/projects` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:49.699247 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166f59a9-ea77-41a8-9275-071d6658241a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:49.699578 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166f59a9-ea77-41a8-9275-071d6658241a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:49.700995 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166f59a9-ea77-41a8-9275-071d6658241a None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:49.713115 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 368/745] 10.222.0.44 () {56 vars in 1148 bytes} [Mon May 9 20:11:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:49.713903 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166f59a9-ea77-41a8-9275-071d6658241a None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:49.739125 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 378/746] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:11:49 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 20:11:49.740704 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac72568-c7b1-46d3-b5ab-62d4dee338fc None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:49.814775 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166f59a9-ea77-41a8-9275-071d6658241a None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:49.847299 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beed0528-6319-4c54-8ed7-2e637680cdbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:49.848102 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed0528-6319-4c54-8ed7-2e637680cdbc None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:49.848379 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed0528-6319-4c54-8ed7-2e637680cdbc None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:49.848544 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac72568-c7b1-46d3-b5ab-62d4dee338fc None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:49.848643 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed0528-6319-4c54-8ed7-2e637680cdbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:49.859462 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beed0528-6319-4c54-8ed7-2e637680cdbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:49.861563 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beed0528-6319-4c54-8ed7-2e637680cdbc None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:49.879675 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-beed0528-6319-4c54-8ed7-2e637680cdbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:49.879675 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:49.879675 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:49.879675 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:49.879675 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:49.879675 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:49.879675 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:49.879675 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:49.879675 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:49.879675 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:49.879675 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:49.879675 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:49.879675 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 20:11:49.879675 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 20:11:49.879675 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 20:11:49.880620 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 20:11:49.880620 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:49.880620 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:49.880620 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:49.880620 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:49.880620 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:49.880620 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:49.880620 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:49.880620 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:11:49.880620 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:49.880620 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:49.880620 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:49.880620 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:49.880620 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:49.880620 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:49.880620 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:49.880620 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:49.881762 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 20:11:49.881762 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 20:11:49.881762 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:49.881762 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:11:49.881762 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 369/747] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:11:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:49.882376 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beed0528-6319-4c54-8ed7-2e637680cdbc None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:49.888387 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f98017-835f-4bfb-af77-5aed913ad876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:49.889179 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f98017-835f-4bfb-af77-5aed913ad876 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:49.889507 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f98017-835f-4bfb-af77-5aed913ad876 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:49.889749 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f98017-835f-4bfb-af77-5aed913ad876 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:49.897885 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f98017-835f-4bfb-af77-5aed913ad876 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:49.899310 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f98017-835f-4bfb-af77-5aed913ad876 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:49.913379 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-f9f98017-835f-4bfb-af77-5aed913ad876 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 09 20:11:49.913379 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:49.913379 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:49.913379 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:49.913379 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:49.913379 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:49.913379 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:49.913379 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:49.913379 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:49.913379 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:49.913379 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:49.913379 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:49.913379 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 20:11:49.913379 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 20:11:49.913379 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 20:11:49.913379 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 20:11:49.914327 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:49.914327 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:49.914327 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 20:11:49.914327 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 20:11:49.914327 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 20:11:49.914327 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 20:11:49.914327 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:49.914327 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:49.914327 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:49.914327 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:49.914327 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:49.914327 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:11:49.914327 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:49.914327 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:49.914327 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:49.914327 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:49.914327 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:49.914327 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:49.915292 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:49.915292 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:49.915292 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 20:11:49.915292 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 20:11:49.915292 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 20:11:49.915292 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 20:11:49.915292 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 20:11:49.915292 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 20:11:49.915292 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 09 20:11:49.915292 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:49.915292 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 379/748] 10.222.0.44 () {56 vars in 1096 bytes} [Mon May 9 20:11:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:49.915292 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f98017-835f-4bfb-af77-5aed913ad876 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:49.982741 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beed0528-6319-4c54-8ed7-2e637680cdbc None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:50.012813 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f98017-835f-4bfb-af77-5aed913ad876 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:50.014917 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db50bee-47e5-4a62-8642-b241fae8dbbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:50.015708 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db50bee-47e5-4a62-8642-b241fae8dbbe None admin] REQUEST_METHOD: `PUT` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:50.016582 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db50bee-47e5-4a62-8642-b241fae8dbbe None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:50.016582 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db50bee-47e5-4a62-8642-b241fae8dbbe None admin] PATH_INFO: `/v3/projects/563db7f5a25f480e8e6568b92ec3f195/users/eb59440b21074d9da15679dc2d745f72/roles/274130b78e304bb88789c1b349263f3c` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:50.018724 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db50bee-47e5-4a62-8642-b241fae8dbbe None admin] RBAC: Authorizing `identity:create_grant(project_id=563db7f5a25f480e8e6568b92ec3f195, user_id=eb59440b21074d9da15679dc2d745f72, role_id=274130b78e304bb88789c1b349263f3c)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:50.020180 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db50bee-47e5-4a62-8642-b241fae8dbbe None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:50.032752 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 370/749] 10.222.0.44 () {58 vars in 1439 bytes} [Mon May 9 20:11:49 2022] PUT /identity/v3/projects/563db7f5a25f480e8e6568b92ec3f195/users/eb59440b21074d9da15679dc2d745f72/roles/274130b78e304bb88789c1b349263f3c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:11:50.034160 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db50bee-47e5-4a62-8642-b241fae8dbbe None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:50.050041 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fd5734-8c70-4935-9eb9-1a71c55e04a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:50.051003 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd5734-8c70-4935-9eb9-1a71c55e04a6 None admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:50.051494 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd5734-8c70-4935-9eb9-1a71c55e04a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:50.051910 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd5734-8c70-4935-9eb9-1a71c55e04a6 None admin] PATH_INFO: `/v3/services` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:50.053285 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fd5734-8c70-4935-9eb9-1a71c55e04a6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:50.054891 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fd5734-8c70-4935-9eb9-1a71c55e04a6 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:50.071579 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 380/750] 10.222.0.44 () {60 vars in 1141 bytes} [Mon May 9 20:11:49 2022] POST /identity/v3/services => generated 240 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:11:50.072764 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fd5734-8c70-4935-9eb9-1a71c55e04a6 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:50.139924 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db50bee-47e5-4a62-8642-b241fae8dbbe None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:50.181955 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46551532-6622-4b4c-8d15-afc08f293ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:50.182585 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46551532-6622-4b4c-8d15-afc08f293ed8 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:50.182861 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46551532-6622-4b4c-8d15-afc08f293ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:50.183128 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46551532-6622-4b4c-8d15-afc08f293ed8 None admin] PATH_INFO: `/v3/domains` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:50.183896 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46551532-6622-4b4c-8d15-afc08f293ed8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:50.184199 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46551532-6622-4b4c-8d15-afc08f293ed8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:50.185639 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46551532-6622-4b4c-8d15-afc08f293ed8 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:50.188965 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fd5734-8c70-4935-9eb9-1a71c55e04a6 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:50.198467 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 371/751] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 9 20:11:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:50.204036 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46551532-6622-4b4c-8d15-afc08f293ed8 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:50.227649 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ac884e-451e-4a8d-b34a-d52b530ad414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:50.228639 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac884e-451e-4a8d-b34a-d52b530ad414 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:50.229061 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac884e-451e-4a8d-b34a-d52b530ad414 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:50.229503 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac884e-451e-4a8d-b34a-d52b530ad414 None admin] PATH_INFO: `/v3/users` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:50.230576 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ac884e-451e-4a8d-b34a-d52b530ad414 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:50.231043 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ac884e-451e-4a8d-b34a-d52b530ad414 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:50.232923 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ac884e-451e-4a8d-b34a-d52b530ad414 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:50.253355 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 381/752] 10.222.0.44 () {56 vars in 1135 bytes} [Mon May 9 20:11:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:50.258957 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ac884e-451e-4a8d-b34a-d52b530ad414 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:50.378985 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46551532-6622-4b4c-8d15-afc08f293ed8 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:50.382766 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ac884e-451e-4a8d-b34a-d52b530ad414 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:50.421440 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98747d2a-c6cf-4193-9cb2-d8747f08951e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:50.422194 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98747d2a-c6cf-4193-9cb2-d8747f08951e None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:50.422501 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98747d2a-c6cf-4193-9cb2-d8747f08951e None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:50.422722 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98747d2a-c6cf-4193-9cb2-d8747f08951e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:50.424768 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b33cc4c-8385-4f4a-8505-b17b5285eb73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:50.425524 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b33cc4c-8385-4f4a-8505-b17b5285eb73 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:50.425922 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b33cc4c-8385-4f4a-8505-b17b5285eb73 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:50.426290 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b33cc4c-8385-4f4a-8505-b17b5285eb73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:50.432260 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98747d2a-c6cf-4193-9cb2-d8747f08951e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:50.433913 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98747d2a-c6cf-4193-9cb2-d8747f08951e None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:50.453258 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-98747d2a-c6cf-4193-9cb2-d8747f08951e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 20:11:50.453258 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:50.453258 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:50.453258 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:50.453258 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:50.453258 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:50.453258 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:50.453258 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:50.453258 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:50.453258 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:50.453258 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:50.453258 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:50.453258 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 20:11:50.453258 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 20:11:50.453258 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 20:11:50.453258 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 20:11:50.454432 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:50.454432 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:50.454432 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 20:11:50.454432 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 20:11:50.454432 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 20:11:50.454432 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 20:11:50.454432 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:50.454432 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:50.454432 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:50.454432 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:50.454432 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:50.454432 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:11:50.454432 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:50.454432 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:50.454432 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:50.454432 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:50.454432 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:50.454432 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:50.455753 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:50.455753 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:50.455753 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 20:11:50.455753 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 20:11:50.455753 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 20:11:50.455753 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 20:11:50.455753 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 20:11:50.455753 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 20:11:50.455753 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 20:11:50.455753 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:11:50.458728 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 372/753] 10.222.0.44 () {56 vars in 1117 bytes} [Mon May 9 20:11:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 20:11:50.464332 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98747d2a-c6cf-4193-9cb2-d8747f08951e None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:50.504074 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b33cc4c-8385-4f4a-8505-b17b5285eb73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:50.505552 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b33cc4c-8385-4f4a-8505-b17b5285eb73 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:50.599483 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98747d2a-c6cf-4193-9cb2-d8747f08951e None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:50.615445 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 382/754] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 9 20:11:50 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 09 20:11:50.619595 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b33cc4c-8385-4f4a-8505-b17b5285eb73 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:50.665610 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e9be61-0fd3-46a3-9913-bfcf5d992f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:50.666276 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e9be61-0fd3-46a3-9913-bfcf5d992f93 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:50.666552 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e9be61-0fd3-46a3-9913-bfcf5d992f93 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:50.666815 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e9be61-0fd3-46a3-9913-bfcf5d992f93 None admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:50.667679 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e9be61-0fd3-46a3-9913-bfcf5d992f93 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:50.667976 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e9be61-0fd3-46a3-9913-bfcf5d992f93 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:50.669414 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e9be61-0fd3-46a3-9913-bfcf5d992f93 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:50.693102 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 373/755] 10.222.0.44 () {56 vars in 1149 bytes} [Mon May 9 20:11:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:11:50.698659 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e9be61-0fd3-46a3-9913-bfcf5d992f93 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:50.807164 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b33cc4c-8385-4f4a-8505-b17b5285eb73 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:50.811751 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e9be61-0fd3-46a3-9913-bfcf5d992f93 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:50.873493 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4528418-3a1e-40bd-84d8-c27d15d2daf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:50.874138 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4528418-3a1e-40bd-84d8-c27d15d2daf3 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:50.874416 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4528418-3a1e-40bd-84d8-c27d15d2daf3 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:50.874683 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4528418-3a1e-40bd-84d8-c27d15d2daf3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:50.876825 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88c85c6-5122-498c-ae6d-a9a5a7e4e260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:50.877769 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c85c6-5122-498c-ae6d-a9a5a7e4e260 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:50.878043 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c85c6-5122-498c-ae6d-a9a5a7e4e260 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:50.878314 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c85c6-5122-498c-ae6d-a9a5a7e4e260 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:50.897924 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88c85c6-5122-498c-ae6d-a9a5a7e4e260 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:50.899371 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88c85c6-5122-498c-ae6d-a9a5a7e4e260 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:50.928224 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-f88c85c6-5122-498c-ae6d-a9a5a7e4e260 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:50.928224 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:50.928224 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:50.928224 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:50.928224 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:50.928224 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:50.928224 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:50.928224 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:50.928224 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:50.928224 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:50.928224 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:50.928224 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:50.928224 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 20:11:50.928224 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 20:11:50.928224 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 20:11:50.929162 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 20:11:50.929162 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:50.929162 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:50.929162 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:50.929162 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:50.929162 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:50.929162 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:50.929162 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:50.929162 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:11:50.929162 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:50.929162 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:50.929162 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:50.929162 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:50.929162 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:50.929162 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:50.929162 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:50.929162 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:50.930054 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 20:11:50.930054 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 20:11:50.930054 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:50.930054 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:50.930701 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 383/756] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:11:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:50.943931 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88c85c6-5122-498c-ae6d-a9a5a7e4e260 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:51.002395 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4528418-3a1e-40bd-84d8-c27d15d2daf3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:51.003943 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4528418-3a1e-40bd-84d8-c27d15d2daf3 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:51.073658 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88c85c6-5122-498c-ae6d-a9a5a7e4e260 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:51.110743 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 374/757] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 9 20:11:50 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 20:11:51.112302 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd540e31-e295-4766-be84-0c2a949d6dd9 None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:51.112594 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd540e31-e295-4766-be84-0c2a949d6dd9 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:51.112861 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd540e31-e295-4766-be84-0c2a949d6dd9 None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:51.115928 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 375/758] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:11:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:11:51.116686 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd540e31-e295-4766-be84-0c2a949d6dd9 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:51.126329 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f76598-2ca0-44e6-b49a-1cbc4f02b79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:51.127554 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f76598-2ca0-44e6-b49a-1cbc4f02b79a None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:51.127832 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f76598-2ca0-44e6-b49a-1cbc4f02b79a None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:51.128108 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f76598-2ca0-44e6-b49a-1cbc4f02b79a None admin] PATH_INFO: `/v3/domains` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:51.128830 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f76598-2ca0-44e6-b49a-1cbc4f02b79a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:51.129134 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f76598-2ca0-44e6-b49a-1cbc4f02b79a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:51.130502 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f76598-2ca0-44e6-b49a-1cbc4f02b79a None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:51.143953 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 384/759] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 9 20:11:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:51.145232 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a1035-280b-44c4-9364-f4d3432434e0 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:51.145517 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a1035-280b-44c4-9364-f4d3432434e0 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:51.145788 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a1035-280b-44c4-9364-f4d3432434e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:51.166686 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-857a1035-280b-44c4-9364-f4d3432434e0 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:11:51.168011 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-857a1035-280b-44c4-9364-f4d3432434e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:11:51.223433 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd540e31-e295-4766-be84-0c2a949d6dd9 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:51.233955 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 385/760] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:11:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 20:11:51.234804 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a1035-280b-44c4-9364-f4d3432434e0 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:51.278966 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa064d07-0c20-4a28-bfe9-7a6b184660c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:51.279794 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa064d07-0c20-4a28-bfe9-7a6b184660c5 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:51.280074 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa064d07-0c20-4a28-bfe9-7a6b184660c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:51.280341 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa064d07-0c20-4a28-bfe9-7a6b184660c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:51.293772 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa064d07-0c20-4a28-bfe9-7a6b184660c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:51.295245 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa064d07-0c20-4a28-bfe9-7a6b184660c5 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:51.315630 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-fa064d07-0c20-4a28-bfe9-7a6b184660c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:51.315630 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:51.315630 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:51.315630 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:51.315630 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:51.315630 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:51.315630 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:51.315630 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:51.315630 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:51.315630 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:51.315630 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:51.315630 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:51.315630 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 20:11:51.315630 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 20:11:51.315630 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 20:11:51.316560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 20:11:51.316560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:51.316560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:51.316560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:51.316560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:51.316560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:51.316560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:51.316560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:51.316560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:11:51.316560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:51.316560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:51.316560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:51.316560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:51.316560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:51.316560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:51.316560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:51.316560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:51.317463 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 20:11:51.317463 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 20:11:51.317463 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:51.317463 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:11:51.317463 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 376/761] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:11:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:51.318166 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa064d07-0c20-4a28-bfe9-7a6b184660c5 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:51.337126 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a1035-280b-44c4-9364-f4d3432434e0 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:51.370218 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9392e608-df73-4335-8470-89d023491122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:51.370989 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9392e608-df73-4335-8470-89d023491122 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:51.371265 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9392e608-df73-4335-8470-89d023491122 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:51.371579 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9392e608-df73-4335-8470-89d023491122 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:51.380146 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9392e608-df73-4335-8470-89d023491122 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:51.381992 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9392e608-df73-4335-8470-89d023491122 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:51.400370 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-9392e608-df73-4335-8470-89d023491122 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 20:11:51.400370 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:51.400370 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:51.400370 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:51.400370 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:51.400370 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:51.400370 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:51.400370 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:51.400370 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:51.400370 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:51.400370 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:51.400370 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:51.400370 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 20:11:51.400370 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 20:11:51.400370 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 20:11:51.402360 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 20:11:51.402360 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:51.402360 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:51.402360 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:51.402360 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:51.402360 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:51.402360 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:51.402360 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:51.402360 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:11:51.402360 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:51.402360 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:51.402360 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:51.402360 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:51.402360 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:51.402360 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:51.402360 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:51.402360 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:51.403714 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 20:11:51.403714 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 20:11:51.403714 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 20:11:51.403714 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 20:11:51.403714 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 20:11:51.403714 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 20:11:51.403714 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 20:11:51.403714 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:51.408780 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 386/762] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 9 20:11:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:51.408780 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9392e608-df73-4335-8470-89d023491122 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:51.419058 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa064d07-0c20-4a28-bfe9-7a6b184660c5 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:51.453066 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598c549a-4c36-42f1-84c7-2314153d93ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:51.453954 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c549a-4c36-42f1-84c7-2314153d93ac None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:51.454323 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c549a-4c36-42f1-84c7-2314153d93ac None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:51.455183 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c549a-4c36-42f1-84c7-2314153d93ac None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:51.456007 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598c549a-4c36-42f1-84c7-2314153d93ac None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:51.457505 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598c549a-4c36-42f1-84c7-2314153d93ac None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:51.473173 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-598c549a-4c36-42f1-84c7-2314153d93ac None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 09 20:11:51.473173 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:51.473173 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 20:11:51.473173 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 20:11:51.473173 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 20:11:51.473173 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 20:11:51.473173 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 20:11:51.473173 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 20:11:51.473173 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 09 20:11:51.473173 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:11:51.473173 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 20:11:51.473173 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:11:51.473173 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:51.473173 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:51.473173 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:51.473173 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:51.475071 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:51.475071 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:51.475071 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:51.475071 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:51.475071 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:51.475071 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:51.475071 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:51.475071 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 20:11:51.475071 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 20:11:51.475071 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 20:11:51.475071 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 20:11:51.475071 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:51.475071 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:51.475071 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:51.475071 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:51.475071 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:51.477142 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:51.477142 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:51.477142 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:11:51.477142 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:51.477142 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:51.477142 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:51.477142 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:51.477142 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:51.477142 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:51.477142 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:51.477142 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:51.477142 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 20:11:51.477142 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 20:11:51.477142 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 09 20:11:51.477142 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:11:51.487484 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 377/763] 10.222.0.44 () {56 vars in 1129 bytes} [Mon May 9 20:11:51 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:51.487484 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598c549a-4c36-42f1-84c7-2314153d93ac None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:51.527851 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9392e608-df73-4335-8470-89d023491122 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:51.566058 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f915ee-5828-43e3-b073-29eba2b9e7af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:51.569196 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f915ee-5828-43e3-b073-29eba2b9e7af None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:51.569196 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f915ee-5828-43e3-b073-29eba2b9e7af None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:51.569196 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f915ee-5828-43e3-b073-29eba2b9e7af None admin] PATH_INFO: `/v3/domains` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:51.569196 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f915ee-5828-43e3-b073-29eba2b9e7af None admin] RBAC: Adding query filter params (name=Default) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:51.569196 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f915ee-5828-43e3-b073-29eba2b9e7af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:51.575434 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f915ee-5828-43e3-b073-29eba2b9e7af None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:51.586054 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598c549a-4c36-42f1-84c7-2314153d93ac None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:51.590878 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 387/764] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 9 20:11:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:51.600388 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f915ee-5828-43e3-b073-29eba2b9e7af None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:51.622347 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0077706c-d2f2-4cb8-ae6d-0cac7327ff43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:51.623409 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0077706c-d2f2-4cb8-ae6d-0cac7327ff43 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:51.623883 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0077706c-d2f2-4cb8-ae6d-0cac7327ff43 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:51.624380 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0077706c-d2f2-4cb8-ae6d-0cac7327ff43 None admin] PATH_INFO: `/v3/projects` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:51.625386 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0077706c-d2f2-4cb8-ae6d-0cac7327ff43 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:51.625867 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0077706c-d2f2-4cb8-ae6d-0cac7327ff43 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:51.627934 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0077706c-d2f2-4cb8-ae6d-0cac7327ff43 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:51.644364 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 378/765] 10.222.0.44 () {56 vars in 1148 bytes} [Mon May 9 20:11:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:51.645400 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0077706c-d2f2-4cb8-ae6d-0cac7327ff43 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:51.711753 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f915ee-5828-43e3-b073-29eba2b9e7af None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:51.752571 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838dc43d-51fd-45d4-ba01-d1e298540d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:51.753147 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838dc43d-51fd-45d4-ba01-d1e298540d32 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:51.753856 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838dc43d-51fd-45d4-ba01-d1e298540d32 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:51.754133 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838dc43d-51fd-45d4-ba01-d1e298540d32 None admin] PATH_INFO: `/v3/services` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:51.755114 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838dc43d-51fd-45d4-ba01-d1e298540d32 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:51.755435 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838dc43d-51fd-45d4-ba01-d1e298540d32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:51.757518 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838dc43d-51fd-45d4-ba01-d1e298540d32 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:51.763520 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 388/766] 10.222.0.44 () {56 vars in 1124 bytes} [Mon May 9 20:11:51 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:51.764313 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838dc43d-51fd-45d4-ba01-d1e298540d32 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:51.770164 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0077706c-d2f2-4cb8-ae6d-0cac7327ff43 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:51.816159 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27434290-5c23-4a67-b7fc-05a9f1b64ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:51.817796 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27434290-5c23-4a67-b7fc-05a9f1b64ed9 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:51.818289 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27434290-5c23-4a67-b7fc-05a9f1b64ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:51.818767 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27434290-5c23-4a67-b7fc-05a9f1b64ed9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:51.827906 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27434290-5c23-4a67-b7fc-05a9f1b64ed9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:51.829585 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27434290-5c23-4a67-b7fc-05a9f1b64ed9 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:51.849161 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-27434290-5c23-4a67-b7fc-05a9f1b64ed9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 20:11:51.849161 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:51.849161 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:51.849161 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:51.849161 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:51.849161 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:51.849161 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:51.849161 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:51.849161 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:51.849161 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:51.849161 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:51.849161 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:51.849161 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 20:11:51.849161 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 20:11:51.849161 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 20:11:51.850079 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 20:11:51.850079 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:51.850079 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:51.850079 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:51.850079 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:51.850079 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:51.850079 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:51.850079 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:51.850079 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:11:51.850079 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:51.850079 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:51.850079 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:51.850079 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:51.850079 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:51.850079 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:51.850079 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:51.850079 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:51.850976 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 20:11:51.850976 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 20:11:51.850976 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 20:11:51.850976 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 20:11:51.850976 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 20:11:51.850976 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 20:11:51.850976 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 20:11:51.850976 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:11:51.853874 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 379/767] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 9 20:11:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:51.855290 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27434290-5c23-4a67-b7fc-05a9f1b64ed9 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:51.880629 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838dc43d-51fd-45d4-ba01-d1e298540d32 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:51.920404 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879cf0f1-5488-46c6-aae4-20c9cb06813c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:51.921047 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879cf0f1-5488-46c6-aae4-20c9cb06813c None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:51.921320 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879cf0f1-5488-46c6-aae4-20c9cb06813c None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:51.921586 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879cf0f1-5488-46c6-aae4-20c9cb06813c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:51.922406 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879cf0f1-5488-46c6-aae4-20c9cb06813c None admin] RBAC: Adding query filter params (role.id=274130b78e304bb88789c1b349263f3c, scope.project.id=563db7f5a25f480e8e6568b92ec3f195, user.id=965089f1a92f49bd883b337d6042c69f) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:51.922712 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879cf0f1-5488-46c6-aae4-20c9cb06813c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:51.925004 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879cf0f1-5488-46c6-aae4-20c9cb06813c None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:51.935473 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 389/768] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 9 20:11:51 2022] GET /identity/v3/role_assignments?user.id=965089f1a92f49bd883b337d6042c69f&scope.project.id=563db7f5a25f480e8e6568b92ec3f195&role.id=274130b78e304bb88789c1b349263f3c => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:51.936720 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879cf0f1-5488-46c6-aae4-20c9cb06813c None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:52.023049 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27434290-5c23-4a67-b7fc-05a9f1b64ed9 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:52.065513 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce7978-9749-434d-9e7f-7205ca542a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:52.066803 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce7978-9749-434d-9e7f-7205ca542a4e None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:52.067293 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce7978-9749-434d-9e7f-7205ca542a4e None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:52.067940 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce7978-9749-434d-9e7f-7205ca542a4e None admin] PATH_INFO: `/v3/services` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:52.068861 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ce7978-9749-434d-9e7f-7205ca542a4e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:52.069730 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ce7978-9749-434d-9e7f-7205ca542a4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:52.071496 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ce7978-9749-434d-9e7f-7205ca542a4e None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:52.084177 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 380/769] 10.222.0.44 () {56 vars in 1124 bytes} [Mon May 9 20:11:51 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:52.086401 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce7978-9749-434d-9e7f-7205ca542a4e None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:52.167786 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879cf0f1-5488-46c6-aae4-20c9cb06813c None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:52.205816 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce7978-9749-434d-9e7f-7205ca542a4e None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:52.223747 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c03bb4d-7bba-4d4d-98f0-ff743b3679b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:52.224410 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03bb4d-7bba-4d4d-98f0-ff743b3679b2 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:52.224685 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03bb4d-7bba-4d4d-98f0-ff743b3679b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:52.224970 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03bb4d-7bba-4d4d-98f0-ff743b3679b2 None admin] PATH_INFO: `/v3/projects` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:52.225743 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c03bb4d-7bba-4d4d-98f0-ff743b3679b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:52.226047 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c03bb4d-7bba-4d4d-98f0-ff743b3679b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:52.227492 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c03bb4d-7bba-4d4d-98f0-ff743b3679b2 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:52.241635 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 390/770] 10.222.0.44 () {56 vars in 1148 bytes} [Mon May 9 20:11:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:52.247560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78fab1f-678d-422a-a43a-094414d4447b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:52.248523 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78fab1f-678d-422a-a43a-094414d4447b None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:52.249045 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78fab1f-678d-422a-a43a-094414d4447b None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:52.249328 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78fab1f-678d-422a-a43a-094414d4447b None admin] PATH_INFO: `/v3/endpoints` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:52.250120 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78fab1f-678d-422a-a43a-094414d4447b None admin] RBAC: Adding query filter params (interface=public, service_id=eca07582610d4be78b0b786a80b12b0e, region_id=RegionOne) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:52.250428 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78fab1f-678d-422a-a43a-094414d4447b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:52.252425 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78fab1f-678d-422a-a43a-094414d4447b None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:52.253305 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c03bb4d-7bba-4d4d-98f0-ff743b3679b2 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:52.263510 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 381/771] 10.222.0.44 () {56 vars in 1251 bytes} [Mon May 9 20:11:52 2022] GET /identity/v3/endpoints?service_id=eca07582610d4be78b0b786a80b12b0e&interface=public®ion_id=RegionOne => generated 194 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:52.269480 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78fab1f-678d-422a-a43a-094414d4447b None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:52.370913 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78fab1f-678d-422a-a43a-094414d4447b None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:52.404348 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a338e71a-c391-45e4-8359-54457ffbda81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:52.405009 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338e71a-c391-45e4-8359-54457ffbda81 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:52.405288 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338e71a-c391-45e4-8359-54457ffbda81 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:52.405552 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338e71a-c391-45e4-8359-54457ffbda81 None admin] PATH_INFO: `/v3/services` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:52.406222 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a338e71a-c391-45e4-8359-54457ffbda81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:52.407605 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a338e71a-c391-45e4-8359-54457ffbda81 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:52.413371 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 382/772] 10.222.0.44 () {56 vars in 1087 bytes} [Mon May 9 20:11:52 2022] GET /identity/v3/services => generated 772 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:52.473890 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c03bb4d-7bba-4d4d-98f0-ff743b3679b2 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:52.533674 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fe4aca-ea65-400a-bb3f-035cdba174ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:52.534605 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe4aca-ea65-400a-bb3f-035cdba174ec None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:52.535035 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe4aca-ea65-400a-bb3f-035cdba174ec None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:52.535514 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe4aca-ea65-400a-bb3f-035cdba174ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:52.536532 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fe4aca-ea65-400a-bb3f-035cdba174ec None admin] RBAC: Adding query filter params (role.id=1ec9314b191d4bd59d71fe4d635de747, scope.project.id=563db7f5a25f480e8e6568b92ec3f195, user.id=0227b2954e61426388214e96e1741eb2) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:52.537004 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fe4aca-ea65-400a-bb3f-035cdba174ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:52.538622 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fe4aca-ea65-400a-bb3f-035cdba174ec None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:52.548315 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 391/773] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 9 20:11:52 2022] GET /identity/v3/role_assignments?user.id=0227b2954e61426388214e96e1741eb2&scope.project.id=563db7f5a25f480e8e6568b92ec3f195&role.id=1ec9314b191d4bd59d71fe4d635de747 => generated 259 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:52.673145 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c754fb-dec9-4e03-a2d6-1cfe1488e770 None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:52.673350 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c754fb-dec9-4e03-a2d6-1cfe1488e770 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:52.673766 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c754fb-dec9-4e03-a2d6-1cfe1488e770 None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:52.675574 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 383/774] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:11:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:11:52.681473 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf8bb4f-4a67-4f28-bc00-64e33bda8f12 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:52.682072 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf8bb4f-4a67-4f28-bc00-64e33bda8f12 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:52.682548 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf8bb4f-4a67-4f28-bc00-64e33bda8f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:52.702117 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-4bf8bb4f-4a67-4f28-bc00-64e33bda8f12 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:11:52.703708 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-4bf8bb4f-4a67-4f28-bc00-64e33bda8f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:11:52.781407 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 392/775] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:11:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 20:11:52.811041 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c754fb-dec9-4e03-a2d6-1cfe1488e770 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:52.934477 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c754fb-dec9-4e03-a2d6-1cfe1488e770 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:52.978038 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3963acd-fd55-4fd9-aef3-21171cf47d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:52.979299 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3963acd-fd55-4fd9-aef3-21171cf47d2e None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:52.979888 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3963acd-fd55-4fd9-aef3-21171cf47d2e None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:52.980377 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a14c9b1-5188-48f6-a738-37bfe667e34d None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:52.980489 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3963acd-fd55-4fd9-aef3-21171cf47d2e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:52.980647 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a14c9b1-5188-48f6-a738-37bfe667e34d None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:52.980919 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a14c9b1-5188-48f6-a738-37bfe667e34d None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:52.982634 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 393/776] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:11:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:11:52.989076 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a5e23-69aa-4388-bd5c-f47b9bcba0ae None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:52.989579 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a5e23-69aa-4388-bd5c-f47b9bcba0ae None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:52.989970 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a5e23-69aa-4388-bd5c-f47b9bcba0ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:53.001568 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3963acd-fd55-4fd9-aef3-21171cf47d2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:11:53.009938 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-d3963acd-fd55-4fd9-aef3-21171cf47d2e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 20:11:53.009938 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:53.009938 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:53.009938 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:53.009938 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:53.009938 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:53.009938 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:53.009938 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:53.009938 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:53.009938 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:53.009938 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:53.009938 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:53.009938 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:11:53.009938 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:11:53.009938 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:11:53.009938 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:11:53.010998 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:11:53.010998 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:11:53.010998 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:11:53.010998 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:11:53.010998 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:53.010998 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:53.010998 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:53.010998 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:53.010998 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:53.010998 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:53.010998 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:53.010998 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:11:53.010998 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:53.010998 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:53.010998 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:53.010998 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:53.011890 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:53.011890 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:53.011890 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:53.011890 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:53.011890 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:11:53.011890 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:11:53.011890 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:11:53.011890 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:11:53.011890 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:11:53.011890 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:11:53.011890 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 20:11:53.011890 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:11:53.014595 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 384/777] 10.222.0.44 () {56 vars in 1096 bytes} [Mon May 9 20:11:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:53.021792 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3963acd-fd55-4fd9-aef3-21171cf47d2e None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:53.023605 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-453a5e23-69aa-4388-bd5c-f47b9bcba0ae None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:11:53.024833 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-453a5e23-69aa-4388-bd5c-f47b9bcba0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:11:53.138251 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3963acd-fd55-4fd9-aef3-21171cf47d2e None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:53.164919 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 394/778] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:11:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 20:11:53.187167 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453a5e23-69aa-4388-bd5c-f47b9bcba0ae None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:53.208117 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8bedab-2318-408c-a322-ee4683eb345b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:53.208778 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8bedab-2318-408c-a322-ee4683eb345b None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:53.209055 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8bedab-2318-408c-a322-ee4683eb345b None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:53.209328 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8bedab-2318-408c-a322-ee4683eb345b None admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:53.210059 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8bedab-2318-408c-a322-ee4683eb345b None admin] RBAC: Adding query filter params (name=admin) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:53.210354 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8bedab-2318-408c-a322-ee4683eb345b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:53.219826 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8bedab-2318-408c-a322-ee4683eb345b None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:53.234888 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 385/779] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 9 20:11:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:11:53.252226 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8bedab-2318-408c-a322-ee4683eb345b None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:53.295871 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453a5e23-69aa-4388-bd5c-f47b9bcba0ae None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:53.337785 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629640e2-b92f-41e4-a42a-d29e0013b473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:53.338869 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629640e2-b92f-41e4-a42a-d29e0013b473 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:53.339323 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629640e2-b92f-41e4-a42a-d29e0013b473 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:53.339778 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629640e2-b92f-41e4-a42a-d29e0013b473 None admin] PATH_INFO: `/v3/services/network` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:53.340582 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629640e2-b92f-41e4-a42a-d29e0013b473 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:53.342097 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629640e2-b92f-41e4-a42a-d29e0013b473 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:53.356827 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-629640e2-b92f-41e4-a42a-d29e0013b473 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 09 20:11:53.356827 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:53.356827 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 20:11:53.356827 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 20:11:53.356827 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 20:11:53.356827 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 20:11:53.356827 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 20:11:53.356827 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 20:11:53.356827 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 09 20:11:53.356827 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:53.356827 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 20:11:53.356827 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:53.356827 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:53.356827 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:53.356827 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:53.356827 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:53.356827 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:53.357903 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:53.357903 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:53.357903 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:53.357903 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:53.357903 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:53.357903 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:53.357903 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 20:11:53.357903 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 20:11:53.357903 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 20:11:53.357903 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 20:11:53.357903 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:53.357903 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:53.357903 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:53.357903 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:53.357903 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:53.357903 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:53.358747 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:53.358747 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:11:53.358747 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:53.358747 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:53.358747 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:53.358747 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:53.358747 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:53.358747 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:53.358747 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:53.358747 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:53.358747 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 20:11:53.358747 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 20:11:53.358747 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 09 20:11:53.358747 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:53.362417 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 395/780] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 9 20:11:53 2022] GET /identity/v3/services/network => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 20:11:53.374560 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629640e2-b92f-41e4-a42a-d29e0013b473 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:53.457354 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8bedab-2318-408c-a322-ee4683eb345b None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:53.509621 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15326c71-3cb0-426d-b19f-c75845400882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:53.510414 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15326c71-3cb0-426d-b19f-c75845400882 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:53.510687 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15326c71-3cb0-426d-b19f-c75845400882 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:53.510954 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15326c71-3cb0-426d-b19f-c75845400882 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:53.532186 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15326c71-3cb0-426d-b19f-c75845400882 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:53.535363 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15326c71-3cb0-426d-b19f-c75845400882 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:53.553307 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629640e2-b92f-41e4-a42a-d29e0013b473 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:53.568247 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-15326c71-3cb0-426d-b19f-c75845400882 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:53.568247 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:53.568247 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:53.568247 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:53.568247 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:53.568247 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:53.568247 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:53.568247 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:53.568247 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:53.568247 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:53.568247 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:53.568247 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:53.568247 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 20:11:53.568247 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 20:11:53.568247 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 20:11:53.569175 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 20:11:53.569175 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:53.569175 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:53.569175 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:53.569175 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:53.569175 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:53.569175 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:53.569175 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:53.569175 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:11:53.569175 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:53.569175 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:53.569175 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:53.569175 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:53.569175 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:53.569175 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:53.569175 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:53.569175 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:53.570060 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 20:11:53.570060 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 20:11:53.570060 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:53.570060 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:11:53.570874 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 386/781] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:11:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 20:11:53.584455 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15326c71-3cb0-426d-b19f-c75845400882 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:53.603367 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8202e3ee-90d5-4415-b9d1-3b15ed27dd16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:53.604413 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8202e3ee-90d5-4415-b9d1-3b15ed27dd16 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:53.604895 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8202e3ee-90d5-4415-b9d1-3b15ed27dd16 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:53.605374 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8202e3ee-90d5-4415-b9d1-3b15ed27dd16 None admin] PATH_INFO: `/v3/services` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:53.606279 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8202e3ee-90d5-4415-b9d1-3b15ed27dd16 None admin] RBAC: Adding query filter params (name=network) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:53.606778 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8202e3ee-90d5-4415-b9d1-3b15ed27dd16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:53.608387 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8202e3ee-90d5-4415-b9d1-3b15ed27dd16 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:53.616164 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 396/782] 10.222.0.44 () {56 vars in 1112 bytes} [Mon May 9 20:11:53 2022] GET /identity/v3/services?name=network => generated 124 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:11:53.622139 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8202e3ee-90d5-4415-b9d1-3b15ed27dd16 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:53.758561 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15326c71-3cb0-426d-b19f-c75845400882 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:53.806820 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8202e3ee-90d5-4415-b9d1-3b15ed27dd16 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:53.824012 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a30ebcd-998e-4792-a442-849dae82f793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:53.824996 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a30ebcd-998e-4792-a442-849dae82f793 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:53.825478 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a30ebcd-998e-4792-a442-849dae82f793 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:53.825958 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a30ebcd-998e-4792-a442-849dae82f793 None admin] PATH_INFO: `/v3/domains` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:53.826875 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a30ebcd-998e-4792-a442-849dae82f793 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:53.828416 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a30ebcd-998e-4792-a442-849dae82f793 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:53.830341 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a30ebcd-998e-4792-a442-849dae82f793 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:53.861381 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 387/783] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 9 20:11:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:53.864967 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a30ebcd-998e-4792-a442-849dae82f793 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:53.865810 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b331de-fbfb-43d8-a1bd-519de4c1edc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:53.866812 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b331de-fbfb-43d8-a1bd-519de4c1edc0 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:53.867537 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b331de-fbfb-43d8-a1bd-519de4c1edc0 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:53.868012 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b331de-fbfb-43d8-a1bd-519de4c1edc0 None admin] PATH_INFO: `/v3/services` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:53.868939 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b331de-fbfb-43d8-a1bd-519de4c1edc0 None admin] RBAC: Adding query filter params (type=network) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:53.869459 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b331de-fbfb-43d8-a1bd-519de4c1edc0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:53.871036 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b331de-fbfb-43d8-a1bd-519de4c1edc0 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:53.877536 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 397/784] 10.222.0.44 () {56 vars in 1112 bytes} [Mon May 9 20:11:53 2022] GET /identity/v3/services?type=network => generated 350 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:53.884357 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b331de-fbfb-43d8-a1bd-519de4c1edc0 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:54.042409 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a30ebcd-998e-4792-a442-849dae82f793 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:54.059573 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b331de-fbfb-43d8-a1bd-519de4c1edc0 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:54.106976 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f27de49-b5e5-413f-9582-8e0de60dfef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:54.107782 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27de49-b5e5-413f-9582-8e0de60dfef4 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:54.108055 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27de49-b5e5-413f-9582-8e0de60dfef4 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:54.108319 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27de49-b5e5-413f-9582-8e0de60dfef4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:54.115285 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bd297e-4d48-4c47-bd7a-a378418cdad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:54.115966 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd297e-4d48-4c47-bd7a-a378418cdad9 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:54.116240 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd297e-4d48-4c47-bd7a-a378418cdad9 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:54.116509 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd297e-4d48-4c47-bd7a-a378418cdad9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:54.117296 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bd297e-4d48-4c47-bd7a-a378418cdad9 None admin] RBAC: Adding query filter params (interface=public, service_id=8318e3caa97c409db90ba6628b752b94, region_id=RegionOne) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:54.117600 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bd297e-4d48-4c47-bd7a-a378418cdad9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:54.118958 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bd297e-4d48-4c47-bd7a-a378418cdad9 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:54.120506 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f27de49-b5e5-413f-9582-8e0de60dfef4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:54.121960 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f27de49-b5e5-413f-9582-8e0de60dfef4 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:54.135772 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 398/785] 10.222.0.44 () {56 vars in 1251 bytes} [Mon May 9 20:11:53 2022] GET /identity/v3/endpoints?service_id=8318e3caa97c409db90ba6628b752b94&interface=public®ion_id=RegionOne => generated 194 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:54.136667 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bd297e-4d48-4c47-bd7a-a378418cdad9 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:54.149902 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-7f27de49-b5e5-413f-9582-8e0de60dfef4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 09 20:11:54.149902 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:54.149902 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:54.149902 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:54.149902 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:54.149902 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:54.149902 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:54.149902 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:54.149902 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:54.149902 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:54.149902 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:54.149902 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:54.149902 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 20:11:54.149902 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 20:11:54.149902 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 20:11:54.149902 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 20:11:54.151178 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:54.151178 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:54.151178 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 20:11:54.151178 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 20:11:54.151178 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 20:11:54.151178 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 20:11:54.151178 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:54.151178 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:54.151178 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:54.151178 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:54.151178 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:54.151178 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:11:54.151178 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:54.151178 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:54.151178 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:54.151178 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:54.151178 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:54.151178 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:54.152170 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:54.152170 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:54.152170 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 20:11:54.152170 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 20:11:54.152170 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 20:11:54.152170 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 20:11:54.152170 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 20:11:54.152170 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 20:11:54.152170 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 09 20:11:54.152170 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:11:54.152170 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 388/786] 10.222.0.44 () {56 vars in 1093 bytes} [Mon May 9 20:11:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:54.158399 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f27de49-b5e5-413f-9582-8e0de60dfef4 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:54.313357 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f27de49-b5e5-413f-9582-8e0de60dfef4 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:54.332177 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bd297e-4d48-4c47-bd7a-a378418cdad9 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:54.378426 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e280fe-1f36-42ff-bca7-bae93555dc36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:54.379097 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e280fe-1f36-42ff-bca7-bae93555dc36 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:54.379368 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e280fe-1f36-42ff-bca7-bae93555dc36 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:54.379675 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e280fe-1f36-42ff-bca7-bae93555dc36 None admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:54.381155 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e280fe-1f36-42ff-bca7-bae93555dc36 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:54.381472 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e280fe-1f36-42ff-bca7-bae93555dc36 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:54.382946 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e280fe-1f36-42ff-bca7-bae93555dc36 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:54.391471 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f4f3dc-d7f9-4bd8-aa58-76157dc9a57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:54.392679 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4f3dc-d7f9-4bd8-aa58-76157dc9a57a None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:54.392973 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4f3dc-d7f9-4bd8-aa58-76157dc9a57a None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:54.393221 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4f3dc-d7f9-4bd8-aa58-76157dc9a57a None admin] PATH_INFO: `/v3/services` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:54.393911 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f4f3dc-d7f9-4bd8-aa58-76157dc9a57a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:54.395308 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f4f3dc-d7f9-4bd8-aa58-76157dc9a57a None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:54.407561 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 399/787] 10.222.0.44 () {56 vars in 1087 bytes} [Mon May 9 20:11:54 2022] GET /identity/v3/services => generated 772 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:54.426505 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 389/788] 10.222.0.44 () {56 vars in 1133 bytes} [Mon May 9 20:11:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:54.432173 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f4f3dc-d7f9-4bd8-aa58-76157dc9a57a None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:54.594476 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19959ef5-ac3c-4292-b487-684042a4fce5 None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:54.594779 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19959ef5-ac3c-4292-b487-684042a4fce5 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:54.595019 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19959ef5-ac3c-4292-b487-684042a4fce5 None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:54.596945 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 390/789] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:11:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:11:54.603013 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f4f3dc-d7f9-4bd8-aa58-76157dc9a57a None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:54.604864 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa252599-337e-470e-af1d-6602722ae15f None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:54.605142 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa252599-337e-470e-af1d-6602722ae15f None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:54.605412 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa252599-337e-470e-af1d-6602722ae15f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:54.633531 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-fa252599-337e-470e-af1d-6602722ae15f None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:11:54.634704 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-fa252599-337e-470e-af1d-6602722ae15f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:11:54.649134 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8526d477-3605-448f-944b-f1e40a290a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:54.649798 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8526d477-3605-448f-944b-f1e40a290a5e None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:54.650078 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8526d477-3605-448f-944b-f1e40a290a5e None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:54.650350 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8526d477-3605-448f-944b-f1e40a290a5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:54.736530 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 391/790] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:11:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 20:11:54.738461 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8526d477-3605-448f-944b-f1e40a290a5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:54.740878 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8526d477-3605-448f-944b-f1e40a290a5e None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:54.759660 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa252599-337e-470e-af1d-6602722ae15f None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:54.842473 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 400/791] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 9 20:11:54 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 20:11:54.852450 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8526d477-3605-448f-944b-f1e40a290a5e None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:54.858519 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa252599-337e-470e-af1d-6602722ae15f None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:54.896882 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab97841-5d18-4e2d-8a60-fd2dabd9e8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:54.898038 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab97841-5d18-4e2d-8a60-fd2dabd9e8fa None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:54.898515 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab97841-5d18-4e2d-8a60-fd2dabd9e8fa None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:54.898976 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab97841-5d18-4e2d-8a60-fd2dabd9e8fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:54.917092 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab97841-5d18-4e2d-8a60-fd2dabd9e8fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:11:54.925855 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-fab97841-5d18-4e2d-8a60-fd2dabd9e8fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 20:11:54.925855 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:54.925855 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:54.925855 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:54.925855 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:54.925855 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:54.925855 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:54.925855 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:54.925855 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:54.925855 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:54.925855 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:54.925855 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:54.925855 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:11:54.925855 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:11:54.925855 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:11:54.925855 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:11:54.926847 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:11:54.926847 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:11:54.926847 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:11:54.926847 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:11:54.926847 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:54.926847 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:54.926847 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:54.926847 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:54.926847 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:54.926847 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:54.926847 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:54.926847 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:11:54.926847 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:54.926847 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:54.926847 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:54.926847 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:54.927724 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:54.927724 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:54.927724 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:54.927724 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:54.927724 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:11:54.927724 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:11:54.927724 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:11:54.927724 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:11:54.927724 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:11:54.927724 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:11:54.927724 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 20:11:54.927724 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:11:54.942108 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 392/792] 10.222.0.44 () {56 vars in 1096 bytes} [Mon May 9 20:11:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:54.951452 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab97841-5d18-4e2d-8a60-fd2dabd9e8fa None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:55.050312 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8526d477-3605-448f-944b-f1e40a290a5e None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:55.110429 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caaba32-b229-4a2b-91b0-d0ab3a656df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:55.111721 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caaba32-b229-4a2b-91b0-d0ab3a656df8 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:55.111997 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caaba32-b229-4a2b-91b0-d0ab3a656df8 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:55.112263 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caaba32-b229-4a2b-91b0-d0ab3a656df8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:55.123889 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caaba32-b229-4a2b-91b0-d0ab3a656df8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:55.125364 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caaba32-b229-4a2b-91b0-d0ab3a656df8 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:55.145354 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-4caaba32-b229-4a2b-91b0-d0ab3a656df8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:55.145354 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:55.145354 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:55.145354 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:55.145354 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:55.145354 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:55.145354 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:55.145354 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:55.145354 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:55.145354 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:55.145354 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:55.145354 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:55.145354 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 20:11:55.145354 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 20:11:55.145354 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 20:11:55.146327 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 20:11:55.146327 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:55.146327 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:55.146327 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:55.146327 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:55.146327 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:55.146327 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:55.146327 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:55.146327 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:11:55.146327 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:55.146327 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:55.146327 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:55.146327 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:55.146327 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:55.146327 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:55.146327 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:55.146327 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:55.147662 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 20:11:55.147662 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 20:11:55.147662 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:55.147662 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:55.147662 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 401/793] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:11:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:55.148233 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff057f-29db-49ea-aa96-1c5f3aabb7ef None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:55.148397 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff057f-29db-49ea-aa96-1c5f3aabb7ef None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:55.148657 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff057f-29db-49ea-aa96-1c5f3aabb7ef None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:55.150036 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 402/794] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:11:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:11:55.150135 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab97841-5d18-4e2d-8a60-fd2dabd9e8fa None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:55.155620 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ff057f-29db-49ea-aa96-1c5f3aabb7ef None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:55.188805 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340e84e8-bfc8-4b78-a582-463392dcb5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:55.189899 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e84e8-bfc8-4b78-a582-463392dcb5f0 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:55.190382 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e84e8-bfc8-4b78-a582-463392dcb5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:55.190849 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e84e8-bfc8-4b78-a582-463392dcb5f0 None admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:55.191841 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340e84e8-bfc8-4b78-a582-463392dcb5f0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:55.192344 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340e84e8-bfc8-4b78-a582-463392dcb5f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:55.193915 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340e84e8-bfc8-4b78-a582-463392dcb5f0 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:55.202969 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 393/795] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 9 20:11:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:55.205106 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e1c866-990e-4cd0-afca-27dca7271a99 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:55.205670 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e1c866-990e-4cd0-afca-27dca7271a99 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:55.206168 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e1c866-990e-4cd0-afca-27dca7271a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:55.225653 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-80e1c866-990e-4cd0-afca-27dca7271a99 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:11:55.227158 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-80e1c866-990e-4cd0-afca-27dca7271a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:11:55.264135 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ff057f-29db-49ea-aa96-1c5f3aabb7ef None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:55.299673 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 394/796] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:11:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 20:11:55.303498 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e1c866-990e-4cd0-afca-27dca7271a99 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:55.303610 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112e195f-5303-45cd-8c9c-304af5758635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:55.304055 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e195f-5303-45cd-8c9c-304af5758635 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:55.304338 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e195f-5303-45cd-8c9c-304af5758635 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:55.304614 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e195f-5303-45cd-8c9c-304af5758635 None admin] PATH_INFO: `/v3/domains` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:55.305489 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112e195f-5303-45cd-8c9c-304af5758635 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:55.305667 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112e195f-5303-45cd-8c9c-304af5758635 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:55.307054 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112e195f-5303-45cd-8c9c-304af5758635 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:55.318996 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 403/797] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 9 20:11:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:11:55.320362 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45819df-b937-43ff-8fb8-7a485649590f None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:55.320648 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45819df-b937-43ff-8fb8-7a485649590f None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:55.320926 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45819df-b937-43ff-8fb8-7a485649590f None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:55.326203 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 404/798] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:11:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:11:55.326960 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45819df-b937-43ff-8fb8-7a485649590f None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:55.407237 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e1c866-990e-4cd0-afca-27dca7271a99 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:55.431444 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45819df-b937-43ff-8fb8-7a485649590f None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:55.440937 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a22f09-e80b-424f-b9ef-1c6d5cf154ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:55.441729 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a22f09-e80b-424f-b9ef-1c6d5cf154ac None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:55.442008 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a22f09-e80b-424f-b9ef-1c6d5cf154ac None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:55.442513 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a22f09-e80b-424f-b9ef-1c6d5cf154ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:55.452079 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a22f09-e80b-424f-b9ef-1c6d5cf154ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:55.453547 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a22f09-e80b-424f-b9ef-1c6d5cf154ac None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:55.464232 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f764376-c078-4fe8-b24e-edb9ad665642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:55.465010 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f764376-c078-4fe8-b24e-edb9ad665642 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:55.465285 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f764376-c078-4fe8-b24e-edb9ad665642 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:55.465550 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f764376-c078-4fe8-b24e-edb9ad665642 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:55.471204 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-f4a22f09-e80b-424f-b9ef-1c6d5cf154ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:55.471204 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:55.471204 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:55.471204 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:55.471204 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:55.471204 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:55.471204 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:55.471204 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:55.471204 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:55.471204 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:55.471204 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:55.471204 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:55.471204 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 20:11:55.471204 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 20:11:55.471204 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 20:11:55.472107 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 20:11:55.472107 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:55.472107 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:55.472107 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:55.472107 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:55.472107 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:55.472107 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:55.472107 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:55.472107 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:11:55.472107 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:55.472107 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:55.472107 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:55.472107 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:55.472107 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:55.472107 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:55.472107 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:55.472107 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:55.473097 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 20:11:55.473097 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 20:11:55.473097 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:55.473097 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:11:55.473097 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 395/799] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:11:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:55.473381 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a22f09-e80b-424f-b9ef-1c6d5cf154ac None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:55.476587 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f764376-c078-4fe8-b24e-edb9ad665642 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:55.478072 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f764376-c078-4fe8-b24e-edb9ad665642 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:55.496350 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-8f764376-c078-4fe8-b24e-edb9ad665642 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 20:11:55.496350 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:55.496350 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:55.496350 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:55.496350 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:55.496350 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:55.496350 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:55.496350 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:55.496350 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:55.496350 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:55.496350 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:55.496350 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:55.496350 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 20:11:55.496350 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 20:11:55.496350 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 20:11:55.497311 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 20:11:55.497311 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:55.497311 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:55.497311 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:55.497311 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:55.497311 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:55.497311 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:55.497311 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:55.497311 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:11:55.497311 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:55.497311 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:55.497311 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:55.497311 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:55.497311 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:55.497311 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:55.497311 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:55.497311 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:55.498199 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 20:11:55.498199 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 20:11:55.498199 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 20:11:55.498199 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 20:11:55.498199 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 20:11:55.498199 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 20:11:55.498199 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 20:11:55.498199 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:55.499759 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 405/800] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 9 20:11:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:55.502210 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a162a-1e79-4c12-a710-f3edaffb2ecf None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:55.502677 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a162a-1e79-4c12-a710-f3edaffb2ecf None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:55.503443 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a162a-1e79-4c12-a710-f3edaffb2ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:55.520402 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-2e5a162a-1e79-4c12-a710-f3edaffb2ecf None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:11:55.521574 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-2e5a162a-1e79-4c12-a710-f3edaffb2ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:11:55.578130 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a22f09-e80b-424f-b9ef-1c6d5cf154ac None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:55.597178 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 406/801] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:11:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 20:11:55.598031 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5a162a-1e79-4c12-a710-f3edaffb2ecf None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:55.637851 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a424cd07-596f-4b90-97cd-c6d67ff199e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:55.639056 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a424cd07-596f-4b90-97cd-c6d67ff199e2 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:55.639465 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a424cd07-596f-4b90-97cd-c6d67ff199e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:55.639815 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a424cd07-596f-4b90-97cd-c6d67ff199e2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:55.640888 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a424cd07-596f-4b90-97cd-c6d67ff199e2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:55.643708 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a424cd07-596f-4b90-97cd-c6d67ff199e2 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:55.663945 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-a424cd07-596f-4b90-97cd-c6d67ff199e2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 09 20:11:55.663945 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:55.663945 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 20:11:55.663945 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 20:11:55.663945 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 20:11:55.663945 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 20:11:55.663945 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 20:11:55.663945 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 20:11:55.663945 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 09 20:11:55.663945 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:11:55.663945 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 20:11:55.663945 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:11:55.663945 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:55.663945 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:55.663945 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:55.663945 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:55.664873 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:55.664873 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:55.664873 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:55.664873 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:55.664873 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:55.664873 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:55.664873 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:55.664873 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 20:11:55.664873 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 20:11:55.664873 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 20:11:55.664873 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 20:11:55.664873 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:55.664873 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:55.664873 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:55.664873 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:55.664873 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:55.665734 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:55.665734 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:55.665734 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:11:55.665734 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:55.665734 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:55.665734 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:55.665734 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:55.665734 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:55.665734 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:55.665734 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:55.665734 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:55.665734 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 20:11:55.665734 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 20:11:55.665734 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 09 20:11:55.665734 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:11:55.665734 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 396/802] 10.222.0.44 () {56 vars in 1129 bytes} [Mon May 9 20:11:55 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:55.667153 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a424cd07-596f-4b90-97cd-c6d67ff199e2 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:55.726755 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5a162a-1e79-4c12-a710-f3edaffb2ecf None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:55.760794 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bb8f8b-a299-4a4c-86b0-123946ecd7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:55.761771 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb8f8b-a299-4a4c-86b0-123946ecd7db None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:55.761888 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a424cd07-596f-4b90-97cd-c6d67ff199e2 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:55.762406 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb8f8b-a299-4a4c-86b0-123946ecd7db None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:55.762880 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb8f8b-a299-4a4c-86b0-123946ecd7db None admin] PATH_INFO: `/v3/domains` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:55.763860 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bb8f8b-a299-4a4c-86b0-123946ecd7db None admin] RBAC: Adding query filter params (name=Default) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:55.764263 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bb8f8b-a299-4a4c-86b0-123946ecd7db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:55.765724 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bb8f8b-a299-4a4c-86b0-123946ecd7db None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:55.781348 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 407/803] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 9 20:11:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:55.781348 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bb8f8b-a299-4a4c-86b0-123946ecd7db None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:55.800017 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0358b1-2e87-48e1-beec-aa6aa65fd93b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:55.800520 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0358b1-2e87-48e1-beec-aa6aa65fd93b None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:55.800854 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0358b1-2e87-48e1-beec-aa6aa65fd93b None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:55.801174 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0358b1-2e87-48e1-beec-aa6aa65fd93b None admin] PATH_INFO: `/v3/projects` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:55.802011 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0358b1-2e87-48e1-beec-aa6aa65fd93b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:55.802341 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0358b1-2e87-48e1-beec-aa6aa65fd93b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:55.804093 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0358b1-2e87-48e1-beec-aa6aa65fd93b None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:55.817873 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 397/804] 10.222.0.44 () {56 vars in 1148 bytes} [Mon May 9 20:11:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:55.819066 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0358b1-2e87-48e1-beec-aa6aa65fd93b None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:55.891738 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bb8f8b-a299-4a4c-86b0-123946ecd7db None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:55.922939 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0358b1-2e87-48e1-beec-aa6aa65fd93b None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:55.926596 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c700f230-d7a8-4926-864b-7c5c672c24c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:55.927381 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700f230-d7a8-4926-864b-7c5c672c24c2 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:55.927688 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700f230-d7a8-4926-864b-7c5c672c24c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:55.927957 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700f230-d7a8-4926-864b-7c5c672c24c2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:55.937814 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c700f230-d7a8-4926-864b-7c5c672c24c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:11:55.945489 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-c700f230-d7a8-4926-864b-7c5c672c24c2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 20:11:55.945489 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:55.945489 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:55.945489 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:55.945489 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:55.945489 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:55.945489 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:55.945489 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:55.945489 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:55.945489 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:55.945489 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:55.945489 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:55.945489 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:11:55.945489 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:11:55.945489 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:11:55.945489 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:11:55.946618 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:11:55.946618 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:11:55.946618 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:11:55.946618 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:11:55.946618 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:55.946618 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:55.946618 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:55.946618 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:55.946618 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:55.946618 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:55.946618 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:55.946618 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:11:55.946618 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:55.946618 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:55.946618 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:55.946618 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:55.947744 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:55.947744 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:55.947744 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:55.947744 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:55.947744 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:11:55.947744 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:11:55.947744 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:11:55.947744 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:11:55.947744 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:11:55.947744 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:11:55.947744 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 20:11:55.947744 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:55.951502 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 408/805] 10.222.0.44 () {56 vars in 1102 bytes} [Mon May 9 20:11:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:55.952162 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c700f230-d7a8-4926-864b-7c5c672c24c2 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:55.962494 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e2f9d1-a6b3-48ca-b070-95c267636c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:55.963286 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e2f9d1-a6b3-48ca-b070-95c267636c38 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:55.963691 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e2f9d1-a6b3-48ca-b070-95c267636c38 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:55.964066 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e2f9d1-a6b3-48ca-b070-95c267636c38 None admin] PATH_INFO: `/v3/services` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:55.964866 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e2f9d1-a6b3-48ca-b070-95c267636c38 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:55.965507 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e2f9d1-a6b3-48ca-b070-95c267636c38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:55.966737 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e2f9d1-a6b3-48ca-b070-95c267636c38 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:55.975435 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 398/806] 10.222.0.44 () {56 vars in 1124 bytes} [Mon May 9 20:11:55 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:55.975435 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e2f9d1-a6b3-48ca-b070-95c267636c38 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:56.060905 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c700f230-d7a8-4926-864b-7c5c672c24c2 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:56.066491 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e2f9d1-a6b3-48ca-b070-95c267636c38 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:56.093629 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40eb686-2565-4c97-94ce-e8f15c4d226a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:56.094579 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40eb686-2565-4c97-94ce-e8f15c4d226a None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:56.094960 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40eb686-2565-4c97-94ce-e8f15c4d226a None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:56.095935 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40eb686-2565-4c97-94ce-e8f15c4d226a None admin] PATH_INFO: `/v3/users/swift` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:56.099979 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8120183d-8f5d-4784-8547-34b4cb7d338e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:56.100613 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120183d-8f5d-4784-8547-34b4cb7d338e None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:56.100886 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120183d-8f5d-4784-8547-34b4cb7d338e None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:56.101151 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120183d-8f5d-4784-8547-34b4cb7d338e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:56.101966 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8120183d-8f5d-4784-8547-34b4cb7d338e None admin] RBAC: Adding query filter params (role.id=274130b78e304bb88789c1b349263f3c, scope.project.id=563db7f5a25f480e8e6568b92ec3f195, user.id=eb59440b21074d9da15679dc2d745f72) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:56.102267 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8120183d-8f5d-4784-8547-34b4cb7d338e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:56.103700 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8120183d-8f5d-4784-8547-34b4cb7d338e None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:56.104406 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40eb686-2565-4c97-94ce-e8f15c4d226a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:56.105987 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40eb686-2565-4c97-94ce-e8f15c4d226a None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:56.109315 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 399/807] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 9 20:11:55 2022] GET /identity/v3/role_assignments?user.id=eb59440b21074d9da15679dc2d745f72&scope.project.id=563db7f5a25f480e8e6568b92ec3f195&role.id=274130b78e304bb88789c1b349263f3c => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:56.110113 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8120183d-8f5d-4784-8547-34b4cb7d338e None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:56.140113 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-a40eb686-2565-4c97-94ce-e8f15c4d226a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 09 20:11:56.140113 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:56.140113 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:56.140113 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:56.140113 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:56.140113 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:56.140113 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:56.140113 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:56.140113 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:56.140113 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:56.140113 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:56.140113 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:56.140113 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 20:11:56.140113 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 20:11:56.140113 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 20:11:56.140113 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 20:11:56.141142 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:56.141142 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:56.141142 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 20:11:56.141142 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 20:11:56.141142 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 20:11:56.141142 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 20:11:56.141142 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:56.141142 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:56.141142 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:56.141142 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:56.141142 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:56.141142 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:11:56.141142 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:56.141142 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:56.141142 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:56.141142 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:56.141142 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:56.141142 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:56.142848 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:56.142848 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:56.142848 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 20:11:56.142848 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 20:11:56.142848 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 20:11:56.142848 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 20:11:56.142848 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 20:11:56.142848 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 20:11:56.142848 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 09 20:11:56.142848 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:56.142848 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 409/808] 10.222.0.44 () {56 vars in 1096 bytes} [Mon May 9 20:11:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:56.142848 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40eb686-2565-4c97-94ce-e8f15c4d226a None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:56.238703 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8120183d-8f5d-4784-8547-34b4cb7d338e None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:56.257773 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40eb686-2565-4c97-94ce-e8f15c4d226a None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:56.276372 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6e5766-4e72-4ecb-b9d8-5d8fb3b84509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:56.277237 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e5766-4e72-4ecb-b9d8-5d8fb3b84509 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:56.277539 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e5766-4e72-4ecb-b9d8-5d8fb3b84509 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:56.277817 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e5766-4e72-4ecb-b9d8-5d8fb3b84509 None admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:56.278905 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6e5766-4e72-4ecb-b9d8-5d8fb3b84509 None admin] RBAC: Adding query filter params (name=service) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:56.279213 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6e5766-4e72-4ecb-b9d8-5d8fb3b84509 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:56.280671 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6e5766-4e72-4ecb-b9d8-5d8fb3b84509 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:56.293918 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 400/809] 10.222.0.44 () {56 vars in 1103 bytes} [Mon May 9 20:11:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:56.294799 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6e5766-4e72-4ecb-b9d8-5d8fb3b84509 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:56.296832 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead9b63b-3208-4446-8676-925c09ba20b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:56.297576 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead9b63b-3208-4446-8676-925c09ba20b6 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:56.297921 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead9b63b-3208-4446-8676-925c09ba20b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:56.298293 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead9b63b-3208-4446-8676-925c09ba20b6 None admin] PATH_INFO: `/v3/services` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:56.299172 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead9b63b-3208-4446-8676-925c09ba20b6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:56.299581 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead9b63b-3208-4446-8676-925c09ba20b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:56.301477 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead9b63b-3208-4446-8676-925c09ba20b6 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:56.307250 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 410/810] 10.222.0.44 () {56 vars in 1124 bytes} [Mon May 9 20:11:56 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:56.309560 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead9b63b-3208-4446-8676-925c09ba20b6 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:56.427377 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6e5766-4e72-4ecb-b9d8-5d8fb3b84509 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:56.433799 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead9b63b-3208-4446-8676-925c09ba20b6 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:56.469603 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c14ba1-90cb-4957-9024-5297bbdaca86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:56.469840 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064b83ae-e98f-4707-8ca8-f2b51ce62c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:56.470870 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b83ae-e98f-4707-8ca8-f2b51ce62c0f None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:56.471156 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b83ae-e98f-4707-8ca8-f2b51ce62c0f None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:56.471491 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b83ae-e98f-4707-8ca8-f2b51ce62c0f None admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:56.471954 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c14ba1-90cb-4957-9024-5297bbdaca86 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:56.472381 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064b83ae-e98f-4707-8ca8-f2b51ce62c0f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:56.472578 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c14ba1-90cb-4957-9024-5297bbdaca86 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:56.472674 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064b83ae-e98f-4707-8ca8-f2b51ce62c0f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:56.473095 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c14ba1-90cb-4957-9024-5297bbdaca86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:56.474111 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064b83ae-e98f-4707-8ca8-f2b51ce62c0f None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:56.484369 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c14ba1-90cb-4957-9024-5297bbdaca86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:56.486666 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c14ba1-90cb-4957-9024-5297bbdaca86 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:56.499546 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 401/811] 10.222.0.44 () {56 vars in 1135 bytes} [Mon May 9 20:11:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:56.500667 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064b83ae-e98f-4707-8ca8-f2b51ce62c0f None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:56.509256 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-66c14ba1-90cb-4957-9024-5297bbdaca86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:56.509256 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:56.509256 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:56.509256 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:56.509256 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:56.509256 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:56.509256 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:56.509256 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:56.509256 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:56.509256 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:56.509256 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:56.509256 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:56.509256 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 20:11:56.509256 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 20:11:56.509256 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 20:11:56.510181 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 20:11:56.510181 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:56.510181 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:56.510181 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:56.510181 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:56.510181 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:56.510181 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:56.510181 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:56.510181 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:11:56.510181 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:56.510181 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:56.510181 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:56.510181 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:56.510181 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:56.510181 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:56.510181 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:56.510181 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:56.511074 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 20:11:56.511074 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 20:11:56.511074 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:56.511074 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:56.513026 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 411/812] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:11:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:56.518416 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c14ba1-90cb-4957-9024-5297bbdaca86 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:56.630208 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064b83ae-e98f-4707-8ca8-f2b51ce62c0f None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:56.636339 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c14ba1-90cb-4957-9024-5297bbdaca86 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:56.670235 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023c1900-e8dd-4db2-be78-9b8465eb63b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:56.671028 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c1900-e8dd-4db2-be78-9b8465eb63b2 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:56.671314 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c1900-e8dd-4db2-be78-9b8465eb63b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:56.671615 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c1900-e8dd-4db2-be78-9b8465eb63b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:56.674444 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff2f566-c6e5-4ef4-870f-c4280add291a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:56.675591 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2f566-c6e5-4ef4-870f-c4280add291a None admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:56.676021 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2f566-c6e5-4ef4-870f-c4280add291a None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:56.676456 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2f566-c6e5-4ef4-870f-c4280add291a None admin] PATH_INFO: `/v3/endpoints` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:56.677336 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff2f566-c6e5-4ef4-870f-c4280add291a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:56.678858 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff2f566-c6e5-4ef4-870f-c4280add291a None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:56.683877 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023c1900-e8dd-4db2-be78-9b8465eb63b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:56.685418 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023c1900-e8dd-4db2-be78-9b8465eb63b2 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:56.703350 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 402/813] 10.222.0.44 () {60 vars in 1144 bytes} [Mon May 9 20:11:56 2022] POST /identity/v3/endpoints => generated 346 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:11:56.704489 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff2f566-c6e5-4ef4-870f-c4280add291a None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:56.714640 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-023c1900-e8dd-4db2-be78-9b8465eb63b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:56.714640 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:56.714640 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:56.714640 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:56.714640 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:56.714640 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:56.714640 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:56.714640 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:56.714640 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:56.714640 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:56.714640 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:56.714640 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:56.714640 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 20:11:56.714640 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 20:11:56.714640 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 20:11:56.715824 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 20:11:56.715824 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:56.715824 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:56.715824 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:56.715824 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:56.715824 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:56.715824 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:56.715824 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:56.715824 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:11:56.715824 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:56.715824 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:56.715824 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:56.715824 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:56.715824 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:56.715824 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:56.715824 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:56.715824 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:56.716923 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 20:11:56.716923 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 20:11:56.716923 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:56.716923 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:56.716923 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 412/814] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:11:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:56.722765 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023c1900-e8dd-4db2-be78-9b8465eb63b2 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:56.878730 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff2f566-c6e5-4ef4-870f-c4280add291a None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:56.940120 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023c1900-e8dd-4db2-be78-9b8465eb63b2 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:56.950256 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee465ca2-af7c-4ea1-b45d-368e08f1b127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:56.951420 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee465ca2-af7c-4ea1-b45d-368e08f1b127 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:56.951860 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee465ca2-af7c-4ea1-b45d-368e08f1b127 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:56.952137 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee465ca2-af7c-4ea1-b45d-368e08f1b127 None admin] PATH_INFO: `/v3/domains` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:56.952871 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee465ca2-af7c-4ea1-b45d-368e08f1b127 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:56.953362 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee465ca2-af7c-4ea1-b45d-368e08f1b127 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:56.955205 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee465ca2-af7c-4ea1-b45d-368e08f1b127 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:56.969533 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 403/815] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 9 20:11:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:56.971719 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48815c-7683-4e8f-b077-585cd12dc12d None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:56.972004 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48815c-7683-4e8f-b077-585cd12dc12d None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:56.972276 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48815c-7683-4e8f-b077-585cd12dc12d None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:56.973541 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 404/816] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:11:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:11:56.975376 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b48815c-7683-4e8f-b077-585cd12dc12d None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:56.996432 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7e2f1d-5cc1-4dae-9b4b-6499e5641caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:56.997102 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e2f1d-5cc1-4dae-9b4b-6499e5641caa None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:56.997379 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e2f1d-5cc1-4dae-9b4b-6499e5641caa None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:56.997650 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e2f1d-5cc1-4dae-9b4b-6499e5641caa None admin] PATH_INFO: `/v3/domains` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:56.998381 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7e2f1d-5cc1-4dae-9b4b-6499e5641caa None admin] RBAC: Adding query filter params (name=Default) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:56.998682 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7e2f1d-5cc1-4dae-9b4b-6499e5641caa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:57.000421 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7e2f1d-5cc1-4dae-9b4b-6499e5641caa None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:57.014635 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 413/817] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 9 20:11:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:11:57.016185 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfbf59a-e070-4721-80d8-b66ab0777693 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:57.016467 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfbf59a-e070-4721-80d8-b66ab0777693 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:57.016740 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfbf59a-e070-4721-80d8-b66ab0777693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:57.042346 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-bdfbf59a-e070-4721-80d8-b66ab0777693 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:11:57.044600 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-bdfbf59a-e070-4721-80d8-b66ab0777693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:11:57.083885 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b48815c-7683-4e8f-b077-585cd12dc12d None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:57.122452 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb36dddf-187b-4193-a0f7-4cbfd3870374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:57.123564 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36dddf-187b-4193-a0f7-4cbfd3870374 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:57.124040 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36dddf-187b-4193-a0f7-4cbfd3870374 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:57.124313 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36dddf-187b-4193-a0f7-4cbfd3870374 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:57.134374 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb36dddf-187b-4193-a0f7-4cbfd3870374 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:57.134374 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb36dddf-187b-4193-a0f7-4cbfd3870374 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:57.134739 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 414/818] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:11:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 20:11:57.135893 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfbf59a-e070-4721-80d8-b66ab0777693 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:57.150234 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-bb36dddf-187b-4193-a0f7-4cbfd3870374 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 20:11:57.150234 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:57.150234 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:57.150234 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:57.150234 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:57.150234 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:57.150234 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:57.150234 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:57.150234 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:57.150234 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:57.150234 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:57.150234 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:57.150234 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 20:11:57.150234 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 20:11:57.150234 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 20:11:57.150234 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 20:11:57.151427 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:57.151427 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:57.151427 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 20:11:57.151427 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 20:11:57.151427 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 20:11:57.151427 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 20:11:57.151427 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:57.151427 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:57.151427 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:57.151427 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:57.151427 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:57.151427 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:11:57.151427 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:57.151427 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:57.151427 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:57.151427 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:57.151427 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:57.151427 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:57.152672 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:57.152672 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:57.152672 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 20:11:57.152672 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 20:11:57.152672 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 20:11:57.152672 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 20:11:57.152672 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 20:11:57.152672 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 20:11:57.152672 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 20:11:57.152672 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:11:57.154133 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 405/819] 10.222.0.44 () {56 vars in 1117 bytes} [Mon May 9 20:11:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:57.160276 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb36dddf-187b-4193-a0f7-4cbfd3870374 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:57.249976 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfbf59a-e070-4721-80d8-b66ab0777693 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:57.260282 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb36dddf-187b-4193-a0f7-4cbfd3870374 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:57.285843 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9fceec-1e14-48b8-99a1-e91ce6d1a1c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:57.286866 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9fceec-1e14-48b8-99a1-e91ce6d1a1c0 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:57.287291 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9fceec-1e14-48b8-99a1-e91ce6d1a1c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:57.287735 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9fceec-1e14-48b8-99a1-e91ce6d1a1c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:57.294589 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1710edae-7f52-4d5c-b7bf-198db40415d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:57.295101 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9fceec-1e14-48b8-99a1-e91ce6d1a1c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:57.295404 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1710edae-7f52-4d5c-b7bf-198db40415d2 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:57.295757 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1710edae-7f52-4d5c-b7bf-198db40415d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:57.296101 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1710edae-7f52-4d5c-b7bf-198db40415d2 None admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:57.297056 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1710edae-7f52-4d5c-b7bf-198db40415d2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:57.297382 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9fceec-1e14-48b8-99a1-e91ce6d1a1c0 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:57.297495 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1710edae-7f52-4d5c-b7bf-198db40415d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:57.299166 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1710edae-7f52-4d5c-b7bf-198db40415d2 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:57.313060 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-9f9fceec-1e14-48b8-99a1-e91ce6d1a1c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 20:11:57.313060 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:57.313060 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:57.313060 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:57.313060 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:57.313060 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:57.313060 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:57.313060 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:57.313060 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:57.313060 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:57.313060 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:57.313060 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:57.313060 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 20:11:57.313060 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 20:11:57.313060 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 20:11:57.314444 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 20:11:57.314444 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:57.314444 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:57.314444 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:57.314444 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:57.314444 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:57.314444 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:57.314444 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:57.314444 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:11:57.314444 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:57.314444 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:57.314444 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:57.314444 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:57.314444 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:57.314444 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:57.314444 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:57.314444 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:57.315585 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 20:11:57.315585 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 20:11:57.315585 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 20:11:57.315585 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 20:11:57.315585 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 20:11:57.315585 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 20:11:57.315585 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 20:11:57.315585 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:57.317700 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 415/820] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 9 20:11:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:57.318636 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9fceec-1e14-48b8-99a1-e91ce6d1a1c0 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:57.323526 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 406/821] 10.222.0.44 () {56 vars in 1149 bytes} [Mon May 9 20:11:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:57.323690 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1710edae-7f52-4d5c-b7bf-198db40415d2 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:57.426613 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9fceec-1e14-48b8-99a1-e91ce6d1a1c0 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:57.440137 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1710edae-7f52-4d5c-b7bf-198db40415d2 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:57.461223 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b26f5-4c19-497b-9ecb-1f27d48e25a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:57.462662 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b26f5-4c19-497b-9ecb-1f27d48e25a5 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:57.463123 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b26f5-4c19-497b-9ecb-1f27d48e25a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:57.463614 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b26f5-4c19-497b-9ecb-1f27d48e25a5 None admin] PATH_INFO: `/v3/services/network` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:57.464443 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247b26f5-4c19-497b-9ecb-1f27d48e25a5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:57.466138 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247b26f5-4c19-497b-9ecb-1f27d48e25a5 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:57.474794 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24198959-991b-46d7-82ab-03bfe11cd8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:57.475466 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24198959-991b-46d7-82ab-03bfe11cd8d4 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:57.475747 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24198959-991b-46d7-82ab-03bfe11cd8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:57.476019 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24198959-991b-46d7-82ab-03bfe11cd8d4 None admin] PATH_INFO: `/v3/projects` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:57.476792 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24198959-991b-46d7-82ab-03bfe11cd8d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:57.477095 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24198959-991b-46d7-82ab-03bfe11cd8d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:57.478561 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24198959-991b-46d7-82ab-03bfe11cd8d4 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:57.481146 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-247b26f5-4c19-497b-9ecb-1f27d48e25a5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 09 20:11:57.481146 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:57.481146 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 20:11:57.481146 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 20:11:57.481146 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 20:11:57.481146 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 20:11:57.481146 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 20:11:57.481146 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 20:11:57.481146 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 09 20:11:57.481146 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:57.481146 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 20:11:57.481146 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:57.481146 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:57.481146 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:57.481146 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:57.481146 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:57.481146 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:57.482122 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:57.482122 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:57.482122 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:57.482122 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:57.482122 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:57.482122 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:57.482122 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 20:11:57.482122 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 20:11:57.482122 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 20:11:57.482122 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 20:11:57.482122 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:57.482122 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:57.482122 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:57.482122 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:57.482122 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:57.482122 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:57.482959 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:57.482959 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:11:57.482959 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:57.482959 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:57.482959 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:57.482959 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:57.482959 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:57.482959 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:57.482959 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:57.482959 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:57.482959 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 20:11:57.482959 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 20:11:57.482959 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 09 20:11:57.482959 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:57.485988 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 416/822] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 9 20:11:57 2022] GET /identity/v3/services/network => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:57.486971 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b26f5-4c19-497b-9ecb-1f27d48e25a5 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:57.495658 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 407/823] 10.222.0.44 () {56 vars in 1148 bytes} [Mon May 9 20:11:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:57.496821 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24198959-991b-46d7-82ab-03bfe11cd8d4 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:57.596708 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b26f5-4c19-497b-9ecb-1f27d48e25a5 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:57.606254 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24198959-991b-46d7-82ab-03bfe11cd8d4 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:57.631126 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9662c3d0-4049-47e3-84a8-e20b20cccb43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:57.631950 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9662c3d0-4049-47e3-84a8-e20b20cccb43 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:57.632225 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9662c3d0-4049-47e3-84a8-e20b20cccb43 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:57.632496 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9662c3d0-4049-47e3-84a8-e20b20cccb43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:57.644266 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9662c3d0-4049-47e3-84a8-e20b20cccb43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:57.645903 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9662c3d0-4049-47e3-84a8-e20b20cccb43 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:57.647101 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c05548-4c87-42dc-9cd7-2e3cf907d89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:57.648022 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c05548-4c87-42dc-9cd7-2e3cf907d89c None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:57.648667 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c05548-4c87-42dc-9cd7-2e3cf907d89c None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:57.649007 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c05548-4c87-42dc-9cd7-2e3cf907d89c None admin] PATH_INFO: `/v3/services` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:57.649778 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c05548-4c87-42dc-9cd7-2e3cf907d89c None admin] RBAC: Adding query filter params (name=network) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:57.650146 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c05548-4c87-42dc-9cd7-2e3cf907d89c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:57.651584 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c05548-4c87-42dc-9cd7-2e3cf907d89c None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:57.657566 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 408/824] 10.222.0.44 () {56 vars in 1112 bytes} [Mon May 9 20:11:57 2022] GET /identity/v3/services?name=network => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:57.658596 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c05548-4c87-42dc-9cd7-2e3cf907d89c None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:57.663038 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-9662c3d0-4049-47e3-84a8-e20b20cccb43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:57.663038 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:57.663038 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:57.663038 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:57.663038 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:57.663038 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:57.663038 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:57.663038 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:57.663038 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:57.663038 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:57.663038 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:57.663038 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:57.663038 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 20:11:57.663038 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 20:11:57.663038 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 20:11:57.664659 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 20:11:57.664659 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:57.664659 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:57.664659 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:57.664659 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:57.664659 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:57.664659 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:57.664659 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:57.664659 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:11:57.664659 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:57.664659 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:57.664659 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:57.664659 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:57.664659 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:57.664659 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:57.664659 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:57.664659 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:57.666491 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 20:11:57.666491 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 20:11:57.666491 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:11:57.666491 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:57.666491 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 417/825] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:11:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:57.666491 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9662c3d0-4049-47e3-84a8-e20b20cccb43 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:57.776693 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c05548-4c87-42dc-9cd7-2e3cf907d89c None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:57.777502 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9662c3d0-4049-47e3-84a8-e20b20cccb43 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:57.809999 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfb8717-4527-4171-a807-49946afaefe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:57.811478 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb8717-4527-4171-a807-49946afaefe9 None admin] REQUEST_METHOD: `PUT` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:57.811760 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb8717-4527-4171-a807-49946afaefe9 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:57.812031 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb8717-4527-4171-a807-49946afaefe9 None admin] PATH_INFO: `/v3/projects/563db7f5a25f480e8e6568b92ec3f195/users/965089f1a92f49bd883b337d6042c69f/roles/274130b78e304bb88789c1b349263f3c` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:57.815479 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfb8717-4527-4171-a807-49946afaefe9 None admin] RBAC: Authorizing `identity:create_grant(project_id=563db7f5a25f480e8e6568b92ec3f195, user_id=965089f1a92f49bd883b337d6042c69f, role_id=274130b78e304bb88789c1b349263f3c)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:57.816916 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfb8717-4527-4171-a807-49946afaefe9 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:57.818964 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe4e14c-22d6-4eca-89f7-5ec5edf42a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:57.819896 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4e14c-22d6-4eca-89f7-5ec5edf42a73 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:57.820580 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4e14c-22d6-4eca-89f7-5ec5edf42a73 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:57.821110 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4e14c-22d6-4eca-89f7-5ec5edf42a73 None admin] PATH_INFO: `/v3/services` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:57.822309 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe4e14c-22d6-4eca-89f7-5ec5edf42a73 None admin] RBAC: Adding query filter params (type=network) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:57.822752 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe4e14c-22d6-4eca-89f7-5ec5edf42a73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:57.824494 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe4e14c-22d6-4eca-89f7-5ec5edf42a73 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:57.830779 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 418/826] 10.222.0.44 () {56 vars in 1112 bytes} [Mon May 9 20:11:57 2022] GET /identity/v3/services?type=network => generated 350 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:57.831679 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe4e14c-22d6-4eca-89f7-5ec5edf42a73 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:57.833220 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 409/827] 10.222.0.44 () {58 vars in 1439 bytes} [Mon May 9 20:11:57 2022] PUT /identity/v3/projects/563db7f5a25f480e8e6568b92ec3f195/users/965089f1a92f49bd883b337d6042c69f/roles/274130b78e304bb88789c1b349263f3c => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:11:57.840696 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfb8717-4527-4171-a807-49946afaefe9 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:57.960786 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfb8717-4527-4171-a807-49946afaefe9 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:58.000625 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d606b01-d529-4f80-a4ac-20439419e9d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:58.002804 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d606b01-d529-4f80-a4ac-20439419e9d2 None admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:58.003299 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d606b01-d529-4f80-a4ac-20439419e9d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:58.003794 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d606b01-d529-4f80-a4ac-20439419e9d2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:58.004918 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d606b01-d529-4f80-a4ac-20439419e9d2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:58.006786 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d606b01-d529-4f80-a4ac-20439419e9d2 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:58.036237 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 410/828] 10.222.0.44 () {60 vars in 1144 bytes} [Mon May 9 20:11:57 2022] POST /identity/v3/endpoints => generated 327 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 20:11:58.067667 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe4e14c-22d6-4eca-89f7-5ec5edf42a73 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:58.115379 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d609b6-157a-4d33-9411-21171733977d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:58.116506 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d609b6-157a-4d33-9411-21171733977d None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:58.117009 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d609b6-157a-4d33-9411-21171733977d None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:58.117576 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d609b6-157a-4d33-9411-21171733977d None admin] PATH_INFO: `/v3/domains` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:58.118576 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d609b6-157a-4d33-9411-21171733977d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:58.119083 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d609b6-157a-4d33-9411-21171733977d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:58.120721 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d609b6-157a-4d33-9411-21171733977d None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:58.135330 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 419/829] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 9 20:11:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:58.141084 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d606b01-d529-4f80-a4ac-20439419e9d2 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:58.271901 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d606b01-d529-4f80-a4ac-20439419e9d2 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:58.307109 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459c2c2c-afc2-4608-a3f2-077e8d3824e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:58.308274 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c2c2c-afc2-4608-a3f2-077e8d3824e3 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:58.308849 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c2c2c-afc2-4608-a3f2-077e8d3824e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:58.309335 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c2c2c-afc2-4608-a3f2-077e8d3824e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:58.316505 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459c2c2c-afc2-4608-a3f2-077e8d3824e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:58.318198 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459c2c2c-afc2-4608-a3f2-077e8d3824e3 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:58.333716 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-459c2c2c-afc2-4608-a3f2-077e8d3824e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 20:11:58.333716 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:58.333716 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:58.333716 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:58.333716 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:58.333716 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:58.333716 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:58.333716 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:58.333716 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:58.333716 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:58.333716 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:58.333716 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:58.333716 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 20:11:58.333716 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 20:11:58.333716 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 20:11:58.334656 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 20:11:58.334656 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:58.334656 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:58.334656 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:58.334656 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:58.334656 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:58.334656 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:58.334656 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:58.334656 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:11:58.334656 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:58.334656 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:58.334656 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:58.334656 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:58.334656 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:58.334656 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:58.334656 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:58.334656 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:58.335560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 20:11:58.335560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 20:11:58.335560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 20:11:58.335560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 20:11:58.335560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 20:11:58.335560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 20:11:58.335560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 20:11:58.335560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:11:58.338029 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 411/830] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 9 20:11:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 20:11:58.343286 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d609b6-157a-4d33-9411-21171733977d None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:58.451821 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d609b6-157a-4d33-9411-21171733977d None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:58.490064 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8116711-7ffd-4ae2-b182-dfc0ceb46077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:58.491582 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8116711-7ffd-4ae2-b182-dfc0ceb46077 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:58.492081 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8116711-7ffd-4ae2-b182-dfc0ceb46077 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:58.492552 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8116711-7ffd-4ae2-b182-dfc0ceb46077 None admin] PATH_INFO: `/v3/projects` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:58.493556 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8116711-7ffd-4ae2-b182-dfc0ceb46077 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:58.494062 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8116711-7ffd-4ae2-b182-dfc0ceb46077 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:58.495721 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8116711-7ffd-4ae2-b182-dfc0ceb46077 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:58.509962 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 420/831] 10.222.0.44 () {56 vars in 1148 bytes} [Mon May 9 20:11:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:11:58.516459 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459c2c2c-afc2-4608-a3f2-077e8d3824e3 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:58.622366 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730a630-fac9-4b14-abe9-af36344d413e None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:58.622690 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730a630-fac9-4b14-abe9-af36344d413e None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:58.622926 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730a630-fac9-4b14-abe9-af36344d413e None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:58.625226 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 421/832] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:11:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:11:58.632547 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cdbcb4-cc8c-4346-b3bb-63f23d7ba55f None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:58.632830 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cdbcb4-cc8c-4346-b3bb-63f23d7ba55f None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:58.633103 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cdbcb4-cc8c-4346-b3bb-63f23d7ba55f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:58.647430 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459c2c2c-afc2-4608-a3f2-077e8d3824e3 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:58.653933 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-f8cdbcb4-cc8c-4346-b3bb-63f23d7ba55f None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:11:58.655705 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-f8cdbcb4-cc8c-4346-b3bb-63f23d7ba55f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:11:58.674805 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e797a23-e360-4331-82ac-f346a93986a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:58.675750 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e797a23-e360-4331-82ac-f346a93986a8 None admin] REQUEST_METHOD: `PUT` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:58.676024 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e797a23-e360-4331-82ac-f346a93986a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:58.676289 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e797a23-e360-4331-82ac-f346a93986a8 None admin] PATH_INFO: `/v3/projects/563db7f5a25f480e8e6568b92ec3f195/users/0227b2954e61426388214e96e1741eb2/roles/1ec9314b191d4bd59d71fe4d635de747` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:58.690997 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e797a23-e360-4331-82ac-f346a93986a8 None admin] RBAC: Authorizing `identity:create_grant(project_id=563db7f5a25f480e8e6568b92ec3f195, user_id=0227b2954e61426388214e96e1741eb2, role_id=1ec9314b191d4bd59d71fe4d635de747)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:58.692480 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e797a23-e360-4331-82ac-f346a93986a8 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:58.707750 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 412/833] 10.222.0.44 () {58 vars in 1439 bytes} [Mon May 9 20:11:58 2022] PUT /identity/v3/projects/563db7f5a25f480e8e6568b92ec3f195/users/0227b2954e61426388214e96e1741eb2/roles/1ec9314b191d4bd59d71fe4d635de747 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:11:58.740628 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 422/834] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:11:58 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 20:11:58.763117 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e797a23-e360-4331-82ac-f346a93986a8 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:58.874675 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e797a23-e360-4331-82ac-f346a93986a8 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:58.910676 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c022192e-f2d1-48fd-90e9-70697ce9c84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:58.911772 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c022192e-f2d1-48fd-90e9-70697ce9c84c None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:58.912210 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c022192e-f2d1-48fd-90e9-70697ce9c84c None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:58.912621 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c022192e-f2d1-48fd-90e9-70697ce9c84c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:58.913435 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c022192e-f2d1-48fd-90e9-70697ce9c84c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:58.914947 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c022192e-f2d1-48fd-90e9-70697ce9c84c None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:58.927619 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-c022192e-f2d1-48fd-90e9-70697ce9c84c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 09 20:11:58.927619 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:58.927619 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 20:11:58.927619 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 20:11:58.927619 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 20:11:58.927619 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 20:11:58.927619 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 20:11:58.927619 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 20:11:58.927619 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 09 20:11:58.927619 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:11:58.927619 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 20:11:58.927619 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:11:58.927619 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:58.927619 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:58.927619 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:58.927619 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:58.928813 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:58.928813 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:58.928813 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:58.928813 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:58.928813 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:58.928813 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:58.928813 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:58.928813 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 20:11:58.928813 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 20:11:58.928813 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 20:11:58.928813 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 20:11:58.928813 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:58.928813 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:58.928813 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:58.928813 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:58.928813 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:58.929794 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:58.929794 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:58.929794 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:11:58.929794 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:58.929794 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:58.929794 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:58.929794 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:58.929794 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:58.929794 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:58.929794 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:58.929794 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:58.929794 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 20:11:58.929794 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 20:11:58.929794 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 09 20:11:58.929794 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:11:58.932424 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 413/835] 10.222.0.44 () {56 vars in 1132 bytes} [Mon May 9 20:11:58 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:58.938588 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cdbcb4-cc8c-4346-b3bb-63f23d7ba55f None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:59.041057 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cdbcb4-cc8c-4346-b3bb-63f23d7ba55f None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:59.074269 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f9576f-082b-45cf-a37e-0ec72df51714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:59.074926 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f9576f-082b-45cf-a37e-0ec72df51714 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:59.075206 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f9576f-082b-45cf-a37e-0ec72df51714 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:59.075505 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f9576f-082b-45cf-a37e-0ec72df51714 None admin] PATH_INFO: `/v3/services` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:59.076210 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f9576f-082b-45cf-a37e-0ec72df51714 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:59.076514 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f9576f-082b-45cf-a37e-0ec72df51714 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:59.077869 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f9576f-082b-45cf-a37e-0ec72df51714 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:59.083234 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 423/836] 10.222.0.44 () {56 vars in 1126 bytes} [Mon May 9 20:11:58 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:59.088671 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c022192e-f2d1-48fd-90e9-70697ce9c84c None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:59.194753 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c022192e-f2d1-48fd-90e9-70697ce9c84c None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:59.228808 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40349f1-2800-415b-a480-b346a7393074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:59.229895 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40349f1-2800-415b-a480-b346a7393074 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:59.230371 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40349f1-2800-415b-a480-b346a7393074 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:59.230837 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40349f1-2800-415b-a480-b346a7393074 None admin] PATH_INFO: `/v3/services` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:59.231794 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40349f1-2800-415b-a480-b346a7393074 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:59.232334 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40349f1-2800-415b-a480-b346a7393074 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:59.233967 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40349f1-2800-415b-a480-b346a7393074 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:59.240751 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 414/837] 10.222.0.44 () {56 vars in 1126 bytes} [Mon May 9 20:11:59 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:59.341544 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a69fbf-d08c-468b-9186-fdd4ec2289a1 None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:59.341865 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a69fbf-d08c-468b-9186-fdd4ec2289a1 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:59.342104 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a69fbf-d08c-468b-9186-fdd4ec2289a1 None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:59.343904 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 424/838] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:11:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:11:59.350737 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db934f9-8280-4065-99f1-06c71c695553 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:59.351240 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db934f9-8280-4065-99f1-06c71c695553 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:59.351343 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db934f9-8280-4065-99f1-06c71c695553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:59.377594 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-8db934f9-8280-4065-99f1-06c71c695553 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:11:59.378908 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-8db934f9-8280-4065-99f1-06c71c695553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:11:59.457596 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 415/839] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:11:59 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 20:11:59.480453 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a69fbf-d08c-468b-9186-fdd4ec2289a1 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:59.586521 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a69fbf-d08c-468b-9186-fdd4ec2289a1 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:59.620285 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73709a7-be1d-4db6-b762-4cf68744d0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:59.621079 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73709a7-be1d-4db6-b762-4cf68744d0f9 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:59.621360 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73709a7-be1d-4db6-b762-4cf68744d0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:59.621630 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73709a7-be1d-4db6-b762-4cf68744d0f9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:59.622281 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73709a7-be1d-4db6-b762-4cf68744d0f9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:59.623674 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73709a7-be1d-4db6-b762-4cf68744d0f9 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:59.635904 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-e73709a7-be1d-4db6-b762-4cf68744d0f9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 09 20:11:59.635904 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:59.635904 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 20:11:59.635904 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 20:11:59.635904 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 20:11:59.635904 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 20:11:59.635904 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 20:11:59.635904 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 20:11:59.635904 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 09 20:11:59.635904 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:59.635904 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 20:11:59.635904 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:59.635904 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:11:59.635904 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:11:59.635904 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:11:59.635904 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:11:59.635904 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:11:59.636922 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:11:59.636922 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:11:59.636922 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:11:59.636922 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:11:59.636922 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:11:59.636922 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:11:59.636922 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 20:11:59.636922 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 20:11:59.636922 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 20:11:59.636922 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 20:11:59.636922 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:11:59.636922 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:11:59.636922 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:11:59.636922 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:11:59.636922 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:11:59.636922 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:11:59.638172 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:11:59.638172 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:11:59.638172 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:11:59.638172 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:11:59.638172 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:11:59.638172 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:11:59.638172 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:11:59.638172 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:11:59.638172 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:11:59.638172 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:11:59.638172 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 20:11:59.638172 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 20:11:59.638172 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 09 20:11:59.638172 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:11:59.638172 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 425/840] 10.222.0.44 () {56 vars in 1114 bytes} [Mon May 9 20:11:59 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:11:59.646119 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db934f9-8280-4065-99f1-06c71c695553 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:59.752671 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db934f9-8280-4065-99f1-06c71c695553 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:59.787121 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553186cd-3adf-475b-982e-117489a21070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:59.788198 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553186cd-3adf-475b-982e-117489a21070 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:59.788736 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553186cd-3adf-475b-982e-117489a21070 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:59.789210 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553186cd-3adf-475b-982e-117489a21070 None admin] PATH_INFO: `/v3/services` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:59.790119 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553186cd-3adf-475b-982e-117489a21070 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:59.790623 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553186cd-3adf-475b-982e-117489a21070 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:59.792239 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553186cd-3adf-475b-982e-117489a21070 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:59.802297 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 416/841] 10.222.0.44 () {56 vars in 1114 bytes} [Mon May 9 20:11:59 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:11:59.804465 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73709a7-be1d-4db6-b762-4cf68744d0f9 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:11:59.905123 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73709a7-be1d-4db6-b762-4cf68744d0f9 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:11:59.940086 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fb77ea-fac7-4957-b7db-56b1dcbd267e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:11:59.940774 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fb77ea-fac7-4957-b7db-56b1dcbd267e None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:11:59.941057 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fb77ea-fac7-4957-b7db-56b1dcbd267e None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:11:59.941332 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fb77ea-fac7-4957-b7db-56b1dcbd267e None admin] PATH_INFO: `/v3/services` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:11:59.942062 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fb77ea-fac7-4957-b7db-56b1dcbd267e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:11:59.942369 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fb77ea-fac7-4957-b7db-56b1dcbd267e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:11:59.943891 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fb77ea-fac7-4957-b7db-56b1dcbd267e None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:11:59.949522 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 426/842] 10.222.0.44 () {56 vars in 1114 bytes} [Mon May 9 20:11:59 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:00.377916 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604629e7-6a3b-4333-bd1d-49a77026dc8d None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:00.378437 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604629e7-6a3b-4333-bd1d-49a77026dc8d None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:00.378437 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604629e7-6a3b-4333-bd1d-49a77026dc8d None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:00.380123 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 417/843] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:12:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:12:00.386028 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd9e53-30af-40f1-8b50-22c61ff1a112 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:00.386568 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd9e53-30af-40f1-8b50-22c61ff1a112 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:00.387048 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd9e53-30af-40f1-8b50-22c61ff1a112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:00.404466 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-b7bd9e53-30af-40f1-8b50-22c61ff1a112 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:12:00.405941 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-b7bd9e53-30af-40f1-8b50-22c61ff1a112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:12:00.476294 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 427/844] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:12:00 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 20:12:00.502723 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604629e7-6a3b-4333-bd1d-49a77026dc8d None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:00.615344 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604629e7-6a3b-4333-bd1d-49a77026dc8d None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:00.649233 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7782418d-af6c-4bdb-b594-3b7ffaf16129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:00.649983 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782418d-af6c-4bdb-b594-3b7ffaf16129 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:00.650266 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782418d-af6c-4bdb-b594-3b7ffaf16129 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:00.650535 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782418d-af6c-4bdb-b594-3b7ffaf16129 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:00.661042 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7782418d-af6c-4bdb-b594-3b7ffaf16129 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:12:00.668735 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-7782418d-af6c-4bdb-b594-3b7ffaf16129 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 20:12:00.668735 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:12:00.668735 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:12:00.668735 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:12:00.668735 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:12:00.668735 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:12:00.668735 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:12:00.668735 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:12:00.668735 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:12:00.668735 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:12:00.668735 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:12:00.668735 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:12:00.668735 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:12:00.668735 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:12:00.668735 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:12:00.668735 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:12:00.669674 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:12:00.669674 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:12:00.669674 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:12:00.669674 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:12:00.669674 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:12:00.669674 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:12:00.669674 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:12:00.669674 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:12:00.669674 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:12:00.669674 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:12:00.669674 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:12:00.669674 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:12:00.669674 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:12:00.669674 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:12:00.669674 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:12:00.669674 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:12:00.670914 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:12:00.670914 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:12:00.670914 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:12:00.670914 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:12:00.670914 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:12:00.670914 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:12:00.670914 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:12:00.670914 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:12:00.670914 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:12:00.670914 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:12:00.670914 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 20:12:00.670914 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:12:00.670914 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 418/845] 10.222.0.44 () {56 vars in 1096 bytes} [Mon May 9 20:12:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 20:12:00.676766 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bd9e53-30af-40f1-8b50-22c61ff1a112 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:00.775726 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bd9e53-30af-40f1-8b50-22c61ff1a112 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:00.812699 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c01b5f-3390-446d-8481-ab643557fe48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:00.813411 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c01b5f-3390-446d-8481-ab643557fe48 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:00.813691 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c01b5f-3390-446d-8481-ab643557fe48 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:00.814629 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c01b5f-3390-446d-8481-ab643557fe48 None admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:00.815530 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c01b5f-3390-446d-8481-ab643557fe48 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:00.815841 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c01b5f-3390-446d-8481-ab643557fe48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:00.817363 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c01b5f-3390-446d-8481-ab643557fe48 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:00.825970 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 428/846] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 9 20:12:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:00.831854 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7782418d-af6c-4bdb-b594-3b7ffaf16129 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:00.942057 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7782418d-af6c-4bdb-b594-3b7ffaf16129 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:00.976532 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb11ccf2-5350-442d-b556-f6b36a2b4b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:00.977317 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11ccf2-5350-442d-b556-f6b36a2b4b9e None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:00.977597 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11ccf2-5350-442d-b556-f6b36a2b4b9e None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:00.977867 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11ccf2-5350-442d-b556-f6b36a2b4b9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:00.989263 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb11ccf2-5350-442d-b556-f6b36a2b4b9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:00.990788 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb11ccf2-5350-442d-b556-f6b36a2b4b9e None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:01.009069 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-fb11ccf2-5350-442d-b556-f6b36a2b4b9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:12:01.009069 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:12:01.009069 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:12:01.009069 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:12:01.009069 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:12:01.009069 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:12:01.009069 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:12:01.009069 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:12:01.009069 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:12:01.009069 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:12:01.009069 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:12:01.009069 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:12:01.009069 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 20:12:01.009069 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 20:12:01.009069 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 20:12:01.011250 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 20:12:01.011250 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:12:01.011250 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:12:01.011250 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:12:01.011250 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:12:01.011250 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:12:01.011250 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:12:01.011250 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:12:01.011250 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:12:01.011250 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:12:01.011250 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:12:01.011250 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:12:01.011250 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:12:01.011250 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:12:01.011250 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:12:01.011250 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:12:01.011250 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:12:01.013488 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 20:12:01.013488 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 20:12:01.013488 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:12:01.013488 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:12:01.013488 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 419/847] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:12:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:12:01.016360 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c01b5f-3390-446d-8481-ab643557fe48 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:01.075591 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23878347-40dc-4ba6-ad20-06d54a89ab40 None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:01.075925 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23878347-40dc-4ba6-ad20-06d54a89ab40 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:01.076132 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23878347-40dc-4ba6-ad20-06d54a89ab40 None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:01.077830 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 420/848] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:12:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 20:12:01.083071 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9317d07-70cd-43e8-9839-ee9a2be19421 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:01.083342 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9317d07-70cd-43e8-9839-ee9a2be19421 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:01.083639 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9317d07-70cd-43e8-9839-ee9a2be19421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:01.101683 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-c9317d07-70cd-43e8-9839-ee9a2be19421 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:12:01.102828 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-c9317d07-70cd-43e8-9839-ee9a2be19421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:12:01.131357 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c01b5f-3390-446d-8481-ab643557fe48 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:01.168816 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8913195e-f475-41f8-a92b-59e204f54d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:01.169485 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8913195e-f475-41f8-a92b-59e204f54d57 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:01.169761 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8913195e-f475-41f8-a92b-59e204f54d57 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:01.170080 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8913195e-f475-41f8-a92b-59e204f54d57 None admin] PATH_INFO: `/v3/domains` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:01.170813 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8913195e-f475-41f8-a92b-59e204f54d57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:01.171108 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8913195e-f475-41f8-a92b-59e204f54d57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:01.173006 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8913195e-f475-41f8-a92b-59e204f54d57 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:01.188508 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 421/849] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:12:01 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 20:12:01.191542 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 429/850] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 9 20:12:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:01.200771 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9317d07-70cd-43e8-9839-ee9a2be19421 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:01.212018 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8913195e-f475-41f8-a92b-59e204f54d57 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:01.321659 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8913195e-f475-41f8-a92b-59e204f54d57 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:01.322830 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9317d07-70cd-43e8-9839-ee9a2be19421 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:01.357701 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10449264-ced5-4ee6-a833-b311007d1cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:01.358478 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10449264-ced5-4ee6-a833-b311007d1cd0 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:01.358753 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10449264-ced5-4ee6-a833-b311007d1cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:01.359017 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10449264-ced5-4ee6-a833-b311007d1cd0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:01.359649 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549ae1b3-fc54-4c9c-a78a-968ac9f465d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:01.361157 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ae1b3-fc54-4c9c-a78a-968ac9f465d8 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:01.362193 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ae1b3-fc54-4c9c-a78a-968ac9f465d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:01.362700 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ae1b3-fc54-4c9c-a78a-968ac9f465d8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:01.366684 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10449264-ced5-4ee6-a833-b311007d1cd0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:01.369199 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10449264-ced5-4ee6-a833-b311007d1cd0 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:01.373922 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549ae1b3-fc54-4c9c-a78a-968ac9f465d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:12:01.382782 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-549ae1b3-fc54-4c9c-a78a-968ac9f465d8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 20:12:01.382782 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:12:01.382782 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:12:01.382782 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:12:01.382782 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:12:01.382782 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:12:01.382782 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:12:01.382782 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:12:01.382782 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:12:01.382782 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:12:01.382782 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:12:01.382782 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:12:01.382782 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:12:01.382782 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:12:01.382782 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:12:01.382782 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:12:01.383778 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:12:01.383778 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:12:01.383778 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:12:01.383778 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:12:01.383778 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:12:01.383778 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:12:01.383778 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:12:01.383778 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:12:01.383778 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:12:01.383778 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:12:01.383778 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:12:01.383778 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:12:01.383778 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:12:01.383778 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:12:01.383778 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:12:01.383778 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:12:01.384637 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:12:01.384637 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:12:01.384637 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:12:01.384637 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:12:01.384637 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:12:01.384637 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:12:01.384637 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:12:01.384637 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:12:01.384637 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:12:01.384637 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:12:01.384637 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 20:12:01.384637 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:12:01.385287 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-10449264-ced5-4ee6-a833-b311007d1cd0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 09 20:12:01.385287 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:12:01.385287 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:12:01.385287 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:12:01.385287 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:12:01.385287 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:12:01.385287 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:12:01.385287 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:12:01.385287 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:12:01.385287 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:12:01.385287 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:12:01.385287 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:12:01.385287 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 20:12:01.385287 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 20:12:01.385287 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 20:12:01.385287 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 20:12:01.386560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:12:01.386560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:12:01.386560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 20:12:01.386560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 20:12:01.386560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 20:12:01.386560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 20:12:01.386560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:12:01.386560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:12:01.386560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:12:01.386560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:12:01.386560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:12:01.386560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:12:01.386560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:12:01.386560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:12:01.386560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:12:01.386560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:12:01.386560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:12:01.386560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:12:01.394675 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:12:01.394675 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:12:01.394675 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 20:12:01.394675 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 20:12:01.394675 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 20:12:01.394675 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 20:12:01.394675 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 20:12:01.394675 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 20:12:01.394675 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 09 20:12:01.394675 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:12:01.394675 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 422/851] 10.222.0.44 () {56 vars in 1096 bytes} [Mon May 9 20:12:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:12:01.395281 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 430/852] 10.222.0.44 () {56 vars in 1102 bytes} [Mon May 9 20:12:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 20:12:01.395354 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10449264-ced5-4ee6-a833-b311007d1cd0 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:01.396359 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549ae1b3-fc54-4c9c-a78a-968ac9f465d8 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:01.511426 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549ae1b3-fc54-4c9c-a78a-968ac9f465d8 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:01.527199 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10449264-ced5-4ee6-a833-b311007d1cd0 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:01.545560 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083e0513-472b-4ba0-b4f6-b5a3006b3297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:01.546215 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e0513-472b-4ba0-b4f6-b5a3006b3297 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:01.546718 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e0513-472b-4ba0-b4f6-b5a3006b3297 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:01.546829 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e0513-472b-4ba0-b4f6-b5a3006b3297 None admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:01.547509 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083e0513-472b-4ba0-b4f6-b5a3006b3297 None admin] RBAC: Adding query filter params (name=service) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:01.547812 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083e0513-472b-4ba0-b4f6-b5a3006b3297 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:01.549524 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083e0513-472b-4ba0-b4f6-b5a3006b3297 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:01.562188 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 431/853] 10.222.0.44 () {56 vars in 1103 bytes} [Mon May 9 20:12:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:01.563078 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083e0513-472b-4ba0-b4f6-b5a3006b3297 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:01.572305 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90937ce2-7be8-41fe-90ec-e2495de3d677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:01.573304 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90937ce2-7be8-41fe-90ec-e2495de3d677 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:01.573834 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90937ce2-7be8-41fe-90ec-e2495de3d677 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:01.574325 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90937ce2-7be8-41fe-90ec-e2495de3d677 None admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:01.581706 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90937ce2-7be8-41fe-90ec-e2495de3d677 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:01.582255 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90937ce2-7be8-41fe-90ec-e2495de3d677 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:01.583973 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90937ce2-7be8-41fe-90ec-e2495de3d677 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:01.603103 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 423/854] 10.222.0.44 () {56 vars in 1135 bytes} [Mon May 9 20:12:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:12:01.604722 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b43a41-939b-4bc1-a28e-b096dedec6b2 None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:01.605166 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b43a41-939b-4bc1-a28e-b096dedec6b2 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:01.605585 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b43a41-939b-4bc1-a28e-b096dedec6b2 None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:01.607212 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 424/855] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:12:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:12:01.613566 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5035300-f340-4b78-895a-882856ad945b None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:01.613849 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5035300-f340-4b78-895a-882856ad945b None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:01.614124 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5035300-f340-4b78-895a-882856ad945b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:01.630419 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-e5035300-f340-4b78-895a-882856ad945b None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:12:01.631953 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-e5035300-f340-4b78-895a-882856ad945b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:12:01.668252 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083e0513-472b-4ba0-b4f6-b5a3006b3297 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:01.703646 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 425/856] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:12:01 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 20:12:01.703646 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5035300-f340-4b78-895a-882856ad945b None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:01.708656 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0144ad3-161d-4f16-8172-3c6d0989b490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:01.710316 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0144ad3-161d-4f16-8172-3c6d0989b490 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:01.710757 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0144ad3-161d-4f16-8172-3c6d0989b490 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:01.711527 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0144ad3-161d-4f16-8172-3c6d0989b490 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:01.725689 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0144ad3-161d-4f16-8172-3c6d0989b490 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:01.728277 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0144ad3-161d-4f16-8172-3c6d0989b490 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:01.747167 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-c0144ad3-161d-4f16-8172-3c6d0989b490 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:12:01.747167 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:12:01.747167 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:12:01.747167 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:12:01.747167 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:12:01.747167 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:12:01.747167 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:12:01.747167 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:12:01.747167 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:12:01.747167 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:12:01.747167 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:12:01.747167 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:12:01.747167 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 20:12:01.747167 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 20:12:01.747167 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 20:12:01.748275 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 20:12:01.748275 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:12:01.748275 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:12:01.748275 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:12:01.748275 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:12:01.748275 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:12:01.748275 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:12:01.748275 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:12:01.748275 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:12:01.748275 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:12:01.748275 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:12:01.748275 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:12:01.748275 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:12:01.748275 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:12:01.748275 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:12:01.748275 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:12:01.748275 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:12:01.749167 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 20:12:01.749167 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 20:12:01.749167 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:12:01.749167 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:12:01.749167 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 432/857] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:12:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:12:01.749436 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0144ad3-161d-4f16-8172-3c6d0989b490 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:01.807579 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5035300-f340-4b78-895a-882856ad945b None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:01.843336 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f2a62e-e386-4284-9ba3-eda4f6209493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:01.844013 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2a62e-e386-4284-9ba3-eda4f6209493 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:01.844304 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2a62e-e386-4284-9ba3-eda4f6209493 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:01.844562 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2a62e-e386-4284-9ba3-eda4f6209493 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:01.849458 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0144ad3-161d-4f16-8172-3c6d0989b490 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:01.886337 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf3ecd8-f0c8-4e96-9bd7-b55585d29194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:01.886994 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf3ecd8-f0c8-4e96-9bd7-b55585d29194 None admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:01.887306 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf3ecd8-f0c8-4e96-9bd7-b55585d29194 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:01.887607 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf3ecd8-f0c8-4e96-9bd7-b55585d29194 None admin] PATH_INFO: `/v3/services` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:01.888333 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf3ecd8-f0c8-4e96-9bd7-b55585d29194 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:01.889683 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf3ecd8-f0c8-4e96-9bd7-b55585d29194 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:01.902588 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 433/858] 10.222.0.44 () {60 vars in 1141 bytes} [Mon May 9 20:12:01 2022] POST /identity/v3/services => generated 269 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:12:01.903417 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf3ecd8-f0c8-4e96-9bd7-b55585d29194 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:01.922572 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f2a62e-e386-4284-9ba3-eda4f6209493 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:01.925358 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f2a62e-e386-4284-9ba3-eda4f6209493 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:02.041715 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 426/859] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 9 20:12:01 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 20:12:02.047249 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f2a62e-e386-4284-9ba3-eda4f6209493 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:02.054314 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf3ecd8-f0c8-4e96-9bd7-b55585d29194 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:02.090075 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd8ccea-d5b3-4de0-94ad-1206ec725981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:02.090659 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd8ccea-d5b3-4de0-94ad-1206ec725981 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:02.090939 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd8ccea-d5b3-4de0-94ad-1206ec725981 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:02.091213 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd8ccea-d5b3-4de0-94ad-1206ec725981 None admin] PATH_INFO: `/v3/domains` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:02.091976 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd8ccea-d5b3-4de0-94ad-1206ec725981 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:02.092283 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd8ccea-d5b3-4de0-94ad-1206ec725981 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:02.094074 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd8ccea-d5b3-4de0-94ad-1206ec725981 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:02.109435 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 434/860] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 9 20:12:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:02.116212 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd8ccea-d5b3-4de0-94ad-1206ec725981 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:02.173669 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f2a62e-e386-4284-9ba3-eda4f6209493 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:02.207564 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e5e2e8-615e-465a-a48c-1e5498009ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:02.208349 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e5e2e8-615e-465a-a48c-1e5498009ac5 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:02.208625 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e5e2e8-615e-465a-a48c-1e5498009ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:02.208894 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e5e2e8-615e-465a-a48c-1e5498009ac5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:02.221113 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e5e2e8-615e-465a-a48c-1e5498009ac5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:02.223341 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e5e2e8-615e-465a-a48c-1e5498009ac5 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:02.245877 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd8ccea-d5b3-4de0-94ad-1206ec725981 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:02.246495 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-b5e5e2e8-615e-465a-a48c-1e5498009ac5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:12:02.246495 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:12:02.246495 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:12:02.246495 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:12:02.246495 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:12:02.246495 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:12:02.246495 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:12:02.246495 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:12:02.246495 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:12:02.246495 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:12:02.246495 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:12:02.246495 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:12:02.246495 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 20:12:02.246495 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 20:12:02.246495 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 20:12:02.247350 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 20:12:02.247350 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:12:02.247350 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:12:02.247350 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:12:02.247350 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:12:02.247350 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:12:02.247350 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:12:02.247350 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:12:02.247350 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:12:02.247350 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:12:02.247350 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:12:02.247350 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:12:02.247350 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:12:02.247350 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:12:02.247350 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:12:02.247350 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:12:02.247350 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:12:02.248281 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 20:12:02.248281 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 20:12:02.248281 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:12:02.248281 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:12:02.248281 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 427/861] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:12:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 20:12:02.253418 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e5e2e8-615e-465a-a48c-1e5498009ac5 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:02.294367 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c6bbc8-149a-4e40-923f-99aa059ff74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:02.295840 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c6bbc8-149a-4e40-923f-99aa059ff74c None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:02.296589 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c6bbc8-149a-4e40-923f-99aa059ff74c None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:02.297319 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c6bbc8-149a-4e40-923f-99aa059ff74c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:02.305539 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c6bbc8-149a-4e40-923f-99aa059ff74c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:02.307033 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c6bbc8-149a-4e40-923f-99aa059ff74c None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:02.322600 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-d5c6bbc8-149a-4e40-923f-99aa059ff74c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 20:12:02.322600 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:12:02.322600 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:12:02.322600 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:12:02.322600 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:12:02.322600 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:12:02.322600 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:12:02.322600 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:12:02.322600 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:12:02.322600 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:12:02.322600 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:12:02.322600 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:12:02.322600 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 20:12:02.322600 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 20:12:02.322600 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 20:12:02.322600 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 20:12:02.323651 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:12:02.323651 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:12:02.323651 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 20:12:02.323651 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 20:12:02.323651 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 20:12:02.323651 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 20:12:02.323651 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:12:02.323651 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:12:02.323651 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:12:02.323651 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:12:02.323651 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:12:02.323651 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:12:02.323651 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:12:02.323651 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:12:02.323651 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:12:02.323651 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:12:02.323651 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:12:02.323651 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:12:02.325140 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:12:02.325140 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:12:02.325140 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 20:12:02.325140 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 20:12:02.325140 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 20:12:02.325140 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 20:12:02.325140 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 20:12:02.325140 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 20:12:02.325140 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 20:12:02.325140 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:12:02.325140 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 435/862] 10.222.0.44 () {56 vars in 1117 bytes} [Mon May 9 20:12:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:12:02.326579 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f743d5-14bf-4b9d-a323-86c600a166ef None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:02.326579 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f743d5-14bf-4b9d-a323-86c600a166ef None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:02.326579 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f743d5-14bf-4b9d-a323-86c600a166ef None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:02.335430 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 436/863] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:12:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:12:02.335430 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f743d5-14bf-4b9d-a323-86c600a166ef None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:02.356688 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e5e2e8-615e-465a-a48c-1e5498009ac5 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:02.389692 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e845e6-dbe4-4d07-8166-cb39eafde929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:02.390331 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e845e6-dbe4-4d07-8166-cb39eafde929 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:02.390608 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e845e6-dbe4-4d07-8166-cb39eafde929 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:02.390880 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e845e6-dbe4-4d07-8166-cb39eafde929 None admin] PATH_INFO: `/v3/domains` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:02.391613 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e845e6-dbe4-4d07-8166-cb39eafde929 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:02.391967 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e845e6-dbe4-4d07-8166-cb39eafde929 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:02.393832 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e845e6-dbe4-4d07-8166-cb39eafde929 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:02.404566 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 428/864] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 9 20:12:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:12:02.406692 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6200d8-c02a-4913-b3df-709cb43e0d6c None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:02.406692 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6200d8-c02a-4913-b3df-709cb43e0d6c None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:02.406692 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6200d8-c02a-4913-b3df-709cb43e0d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:02.423562 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-2e6200d8-c02a-4913-b3df-709cb43e0d6c None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:12:02.424723 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-2e6200d8-c02a-4913-b3df-709cb43e0d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:12:02.434172 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f743d5-14bf-4b9d-a323-86c600a166ef None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:02.467717 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b53cacb-76db-4c78-bb4e-96c1cf8e1b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:02.468378 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53cacb-76db-4c78-bb4e-96c1cf8e1b82 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:02.468734 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53cacb-76db-4c78-bb4e-96c1cf8e1b82 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:02.468925 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53cacb-76db-4c78-bb4e-96c1cf8e1b82 None admin] PATH_INFO: `/v3/users` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:02.469759 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b53cacb-76db-4c78-bb4e-96c1cf8e1b82 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:02.470106 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b53cacb-76db-4c78-bb4e-96c1cf8e1b82 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:02.472025 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b53cacb-76db-4c78-bb4e-96c1cf8e1b82 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:02.488905 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 437/865] 10.222.0.44 () {56 vars in 1149 bytes} [Mon May 9 20:12:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:12:02.488905 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b53cacb-76db-4c78-bb4e-96c1cf8e1b82 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:02.494903 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 429/866] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:12:02 2022] POST /identity/v3/auth/tokens => generated 1261 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 20:12:02.495716 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6200d8-c02a-4913-b3df-709cb43e0d6c None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:02.592263 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b53cacb-76db-4c78-bb4e-96c1cf8e1b82 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:02.601726 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6200d8-c02a-4913-b3df-709cb43e0d6c None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:02.624522 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360d80e1-e006-4a90-bde4-dca67b5d70cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:02.625263 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d80e1-e006-4a90-bde4-dca67b5d70cf None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:02.625541 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d80e1-e006-4a90-bde4-dca67b5d70cf None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:02.625811 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d80e1-e006-4a90-bde4-dca67b5d70cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:02.633148 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360d80e1-e006-4a90-bde4-dca67b5d70cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:02.634589 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360d80e1-e006-4a90-bde4-dca67b5d70cf None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:02.635052 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72998e16-d31c-4c1c-9b58-65ca66b719f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:02.635729 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72998e16-d31c-4c1c-9b58-65ca66b719f4 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:02.636010 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72998e16-d31c-4c1c-9b58-65ca66b719f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:02.636289 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72998e16-d31c-4c1c-9b58-65ca66b719f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:02.648567 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-360d80e1-e006-4a90-bde4-dca67b5d70cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 20:12:02.648567 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:12:02.648567 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:12:02.648567 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:12:02.648567 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:12:02.648567 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:12:02.648567 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:12:02.648567 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:12:02.648567 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:12:02.648567 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:12:02.648567 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:12:02.648567 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:12:02.648567 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 20:12:02.648567 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 20:12:02.648567 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 20:12:02.649657 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 20:12:02.649657 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:12:02.649657 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:12:02.649657 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:12:02.649657 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:12:02.649657 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:12:02.649657 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:12:02.649657 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:12:02.649657 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:12:02.649657 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:12:02.649657 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:12:02.649657 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:12:02.649657 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:12:02.649657 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:12:02.649657 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:12:02.649657 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:12:02.649657 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:12:02.650766 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 20:12:02.650766 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 20:12:02.650766 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 20:12:02.650766 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 20:12:02.650766 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 20:12:02.650766 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 20:12:02.650766 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 20:12:02.650766 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:12:02.651840 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 438/867] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 9 20:12:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:12:02.652312 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360d80e1-e006-4a90-bde4-dca67b5d70cf None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:02.707090 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72998e16-d31c-4c1c-9b58-65ca66b719f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:02.708993 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72998e16-d31c-4c1c-9b58-65ca66b719f4 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:02.754025 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360d80e1-e006-4a90-bde4-dca67b5d70cf None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:02.787668 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ac33e8-0993-4ced-bf4a-a8da15b549b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:02.788326 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac33e8-0993-4ced-bf4a-a8da15b549b2 None admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:02.788607 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac33e8-0993-4ced-bf4a-a8da15b549b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:02.788882 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac33e8-0993-4ced-bf4a-a8da15b549b2 None admin] PATH_INFO: `/v3/services` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:02.789597 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ac33e8-0993-4ced-bf4a-a8da15b549b2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:02.790962 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ac33e8-0993-4ced-bf4a-a8da15b549b2 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:02.805671 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 439/868] 10.222.0.44 () {60 vars in 1141 bytes} [Mon May 9 20:12:02 2022] POST /identity/v3/services => generated 251 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:12:02.806506 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ac33e8-0993-4ced-bf4a-a8da15b549b2 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:02.824494 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 430/869] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 9 20:12:02 2022] GET /identity/v3/auth/tokens => generated 1261 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 20:12:02.829839 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72998e16-d31c-4c1c-9b58-65ca66b719f4 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:02.926213 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ac33e8-0993-4ced-bf4a-a8da15b549b2 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:02.956602 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72998e16-d31c-4c1c-9b58-65ca66b719f4 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:02.964479 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec35ef-9d18-479f-9a13-8ee661b4a572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:02.965250 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec35ef-9d18-479f-9a13-8ee661b4a572 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:02.965603 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec35ef-9d18-479f-9a13-8ee661b4a572 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:02.966511 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec35ef-9d18-479f-9a13-8ee661b4a572 None admin] PATH_INFO: `/v3/projects` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:02.967642 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adec35ef-9d18-479f-9a13-8ee661b4a572 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:02.968030 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adec35ef-9d18-479f-9a13-8ee661b4a572 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:02.970791 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adec35ef-9d18-479f-9a13-8ee661b4a572 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:02.993087 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 440/870] 10.222.0.44 () {56 vars in 1148 bytes} [Mon May 9 20:12:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:02.994882 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec35ef-9d18-479f-9a13-8ee661b4a572 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:03.005048 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd31e8ce-5631-4e47-9bbb-29731e701900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:03.006200 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd31e8ce-5631-4e47-9bbb-29731e701900 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:03.006476 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd31e8ce-5631-4e47-9bbb-29731e701900 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:03.006742 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd31e8ce-5631-4e47-9bbb-29731e701900 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:03.018977 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd31e8ce-5631-4e47-9bbb-29731e701900 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:03.020480 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd31e8ce-5631-4e47-9bbb-29731e701900 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:03.041390 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-bd31e8ce-5631-4e47-9bbb-29731e701900 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:12:03.041390 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:12:03.041390 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:12:03.041390 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:12:03.041390 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:12:03.041390 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:12:03.041390 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:12:03.041390 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:12:03.041390 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:12:03.041390 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:12:03.041390 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:12:03.041390 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:12:03.041390 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 20:12:03.041390 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 20:12:03.041390 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 20:12:03.042352 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 20:12:03.042352 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:12:03.042352 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:12:03.042352 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:12:03.042352 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:12:03.042352 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:12:03.042352 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:12:03.042352 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:12:03.042352 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:12:03.042352 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:12:03.042352 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:12:03.042352 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:12:03.042352 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:12:03.042352 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:12:03.042352 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:12:03.042352 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:12:03.042352 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:12:03.043243 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 20:12:03.043243 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 20:12:03.043243 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:12:03.043243 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:12:03.045507 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 431/871] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:12:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 20:12:03.052429 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd31e8ce-5631-4e47-9bbb-29731e701900 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:03.114631 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec35ef-9d18-479f-9a13-8ee661b4a572 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:03.151067 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab0c1a5-3082-4b64-b91c-92f7173ce5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:03.151804 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab0c1a5-3082-4b64-b91c-92f7173ce5bd None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:03.152081 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab0c1a5-3082-4b64-b91c-92f7173ce5bd None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:03.152351 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab0c1a5-3082-4b64-b91c-92f7173ce5bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:03.153216 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab0c1a5-3082-4b64-b91c-92f7173ce5bd None admin] RBAC: Adding query filter params (role.id=274130b78e304bb88789c1b349263f3c, scope.project.id=563db7f5a25f480e8e6568b92ec3f195, user.id=965089f1a92f49bd883b337d6042c69f) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:03.153527 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab0c1a5-3082-4b64-b91c-92f7173ce5bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:03.154960 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab0c1a5-3082-4b64-b91c-92f7173ce5bd None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:03.162701 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 441/872] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 9 20:12:02 2022] GET /identity/v3/role_assignments?user.id=965089f1a92f49bd883b337d6042c69f&scope.project.id=563db7f5a25f480e8e6568b92ec3f195&role.id=274130b78e304bb88789c1b349263f3c => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:03.193006 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd31e8ce-5631-4e47-9bbb-29731e701900 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:03.230875 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c20474-f94a-46d7-bcf6-d533ed8af3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:03.231889 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c20474-f94a-46d7-bcf6-d533ed8af3c7 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:03.232338 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c20474-f94a-46d7-bcf6-d533ed8af3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:03.232759 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c20474-f94a-46d7-bcf6-d533ed8af3c7 None admin] PATH_INFO: `/v3/domains` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:03.233678 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c20474-f94a-46d7-bcf6-d533ed8af3c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:03.234140 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c20474-f94a-46d7-bcf6-d533ed8af3c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:03.235804 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c20474-f94a-46d7-bcf6-d533ed8af3c7 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:03.249085 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 432/873] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 9 20:12:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:12:03.255378 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab0c1a5-3082-4b64-b91c-92f7173ce5bd None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:03.360361 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab0c1a5-3082-4b64-b91c-92f7173ce5bd None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:03.393924 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6211704-29a8-40e2-a9b4-2685860f07d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:03.394703 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6211704-29a8-40e2-a9b4-2685860f07d3 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:03.394982 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6211704-29a8-40e2-a9b4-2685860f07d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:03.395248 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6211704-29a8-40e2-a9b4-2685860f07d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:03.402434 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6211704-29a8-40e2-a9b4-2685860f07d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:03.403890 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6211704-29a8-40e2-a9b4-2685860f07d3 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:03.418132 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-e6211704-29a8-40e2-a9b4-2685860f07d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 20:12:03.418132 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:12:03.418132 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:12:03.418132 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:12:03.418132 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:12:03.418132 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:12:03.418132 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:12:03.418132 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:12:03.418132 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:12:03.418132 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:12:03.418132 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:12:03.418132 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:12:03.418132 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 20:12:03.418132 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 20:12:03.418132 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 20:12:03.419227 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 20:12:03.419227 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:12:03.419227 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:12:03.419227 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:12:03.419227 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:12:03.419227 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:12:03.419227 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:12:03.419227 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:12:03.419227 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:12:03.419227 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:12:03.419227 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:12:03.419227 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:12:03.419227 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:12:03.419227 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:12:03.419227 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:12:03.419227 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:12:03.419227 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:12:03.420337 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 20:12:03.420337 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 20:12:03.420337 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 20:12:03.420337 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 20:12:03.420337 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 20:12:03.420337 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 20:12:03.420337 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 20:12:03.420337 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:12:03.420337 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 442/874] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 9 20:12:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:12:03.426012 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c20474-f94a-46d7-bcf6-d533ed8af3c7 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:03.530632 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c20474-f94a-46d7-bcf6-d533ed8af3c7 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:03.564435 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cc56ac-5a58-43d8-a4dc-54a0917658a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:03.565414 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc56ac-5a58-43d8-a4dc-54a0917658a7 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:03.565863 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc56ac-5a58-43d8-a4dc-54a0917658a7 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:03.566292 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc56ac-5a58-43d8-a4dc-54a0917658a7 None admin] PATH_INFO: `/v3/projects` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:03.567824 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cc56ac-5a58-43d8-a4dc-54a0917658a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:03.568410 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cc56ac-5a58-43d8-a4dc-54a0917658a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:03.570141 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cc56ac-5a58-43d8-a4dc-54a0917658a7 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:03.584296 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 433/875] 10.222.0.44 () {56 vars in 1148 bytes} [Mon May 9 20:12:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:03.590720 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6211704-29a8-40e2-a9b4-2685860f07d3 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:03.690892 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6211704-29a8-40e2-a9b4-2685860f07d3 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:03.724897 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0d5230-da95-476d-a362-73602a7e74ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:03.725600 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0d5230-da95-476d-a362-73602a7e74ca None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:03.725878 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0d5230-da95-476d-a362-73602a7e74ca None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:03.726149 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0d5230-da95-476d-a362-73602a7e74ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:03.726979 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0d5230-da95-476d-a362-73602a7e74ca None admin] RBAC: Adding query filter params (role.id=1ec9314b191d4bd59d71fe4d635de747, scope.project.id=563db7f5a25f480e8e6568b92ec3f195, user.id=0227b2954e61426388214e96e1741eb2) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:03.727282 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0d5230-da95-476d-a362-73602a7e74ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:03.728759 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0d5230-da95-476d-a362-73602a7e74ca None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:03.735308 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 443/876] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 9 20:12:03 2022] GET /identity/v3/role_assignments?user.id=0227b2954e61426388214e96e1741eb2&scope.project.id=563db7f5a25f480e8e6568b92ec3f195&role.id=1ec9314b191d4bd59d71fe4d635de747 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:04.262894 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931cd48c-65e2-4bc3-8c04-fcc2c3d70b65 None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:04.263309 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931cd48c-65e2-4bc3-8c04-fcc2c3d70b65 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:04.263515 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931cd48c-65e2-4bc3-8c04-fcc2c3d70b65 None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:04.265090 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 434/877] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:12:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:12:04.271265 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f03e60-721f-4309-b60b-3bfde80f1fa1 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:04.271742 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f03e60-721f-4309-b60b-3bfde80f1fa1 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:04.271935 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f03e60-721f-4309-b60b-3bfde80f1fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:04.289485 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-62f03e60-721f-4309-b60b-3bfde80f1fa1 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:12:04.291065 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-62f03e60-721f-4309-b60b-3bfde80f1fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:12:04.371503 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 444/878] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:12:04 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 20:12:04.388399 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931cd48c-65e2-4bc3-8c04-fcc2c3d70b65 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:04.491508 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931cd48c-65e2-4bc3-8c04-fcc2c3d70b65 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:04.526402 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d79406d-82f8-4ce1-ad9a-a5fe1a2fa027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:04.527133 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79406d-82f8-4ce1-ad9a-a5fe1a2fa027 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:04.527431 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79406d-82f8-4ce1-ad9a-a5fe1a2fa027 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:04.527708 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79406d-82f8-4ce1-ad9a-a5fe1a2fa027 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:04.528363 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d79406d-82f8-4ce1-ad9a-a5fe1a2fa027 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:04.529732 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d79406d-82f8-4ce1-ad9a-a5fe1a2fa027 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:04.542573 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-4d79406d-82f8-4ce1-ad9a-a5fe1a2fa027 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 09 20:12:04.542573 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:12:04.542573 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 20:12:04.542573 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 20:12:04.542573 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 20:12:04.542573 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 20:12:04.542573 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 20:12:04.542573 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 20:12:04.542573 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 09 20:12:04.542573 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:12:04.542573 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 20:12:04.542573 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:12:04.542573 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:12:04.542573 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:12:04.542573 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:12:04.542573 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:12:04.543595 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:12:04.543595 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:12:04.543595 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:12:04.543595 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:12:04.543595 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:12:04.543595 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:12:04.543595 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:12:04.543595 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 20:12:04.543595 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 20:12:04.543595 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 20:12:04.543595 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 20:12:04.543595 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:12:04.543595 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:12:04.543595 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:12:04.543595 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:12:04.543595 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:12:04.544428 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:12:04.544428 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:12:04.544428 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:12:04.544428 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:12:04.544428 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:12:04.544428 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:12:04.544428 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:12:04.544428 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:12:04.544428 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:12:04.544428 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:12:04.544428 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:12:04.544428 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 20:12:04.544428 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 20:12:04.544428 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 09 20:12:04.544428 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:12:04.547499 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 435/879] 10.222.0.44 () {56 vars in 1132 bytes} [Mon May 9 20:12:04 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:12:04.551079 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f03e60-721f-4309-b60b-3bfde80f1fa1 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:04.651371 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f03e60-721f-4309-b60b-3bfde80f1fa1 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:04.685590 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48daf63-bbad-436d-962a-3c8fef99191b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:04.686250 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48daf63-bbad-436d-962a-3c8fef99191b None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:04.686532 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48daf63-bbad-436d-962a-3c8fef99191b None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:04.686807 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48daf63-bbad-436d-962a-3c8fef99191b None admin] PATH_INFO: `/v3/services` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:04.687543 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48daf63-bbad-436d-962a-3c8fef99191b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:04.687853 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48daf63-bbad-436d-962a-3c8fef99191b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:04.689884 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48daf63-bbad-436d-962a-3c8fef99191b None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:04.699429 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 445/880] 10.222.0.44 () {56 vars in 1126 bytes} [Mon May 9 20:12:04 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:04.700835 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d79406d-82f8-4ce1-ad9a-a5fe1a2fa027 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:04.813574 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d79406d-82f8-4ce1-ad9a-a5fe1a2fa027 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:04.848055 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3140835-cf1f-4eb1-82c0-237cbca1e0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:04.849100 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3140835-cf1f-4eb1-82c0-237cbca1e0d8 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:04.849586 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3140835-cf1f-4eb1-82c0-237cbca1e0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:04.850050 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3140835-cf1f-4eb1-82c0-237cbca1e0d8 None admin] PATH_INFO: `/v3/services` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:04.850951 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3140835-cf1f-4eb1-82c0-237cbca1e0d8 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:04.851475 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3140835-cf1f-4eb1-82c0-237cbca1e0d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:04.853038 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3140835-cf1f-4eb1-82c0-237cbca1e0d8 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:04.858329 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 436/881] 10.222.0.44 () {56 vars in 1126 bytes} [Mon May 9 20:12:04 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:04.864388 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48daf63-bbad-436d-962a-3c8fef99191b None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:04.964214 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48daf63-bbad-436d-962a-3c8fef99191b None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:05.001284 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4469f099-7857-44bc-acfc-1ce00b0060a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:05.001927 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469f099-7857-44bc-acfc-1ce00b0060a7 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:05.002210 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469f099-7857-44bc-acfc-1ce00b0060a7 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:05.002485 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469f099-7857-44bc-acfc-1ce00b0060a7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:05.003301 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4469f099-7857-44bc-acfc-1ce00b0060a7 None admin] RBAC: Adding query filter params (interface=public, service_id=edd6632868394e45bf821c21e92f855f, region_id=RegionOne) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:05.003644 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4469f099-7857-44bc-acfc-1ce00b0060a7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:05.005068 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4469f099-7857-44bc-acfc-1ce00b0060a7 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:05.011701 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 446/882] 10.222.0.44 () {56 vars in 1251 bytes} [Mon May 9 20:12:04 2022] GET /identity/v3/endpoints?service_id=edd6632868394e45bf821c21e92f855f&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:05.017694 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3140835-cf1f-4eb1-82c0-237cbca1e0d8 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:05.128767 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3140835-cf1f-4eb1-82c0-237cbca1e0d8 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:05.167606 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6889f195-5ee0-4332-b7c0-24304d846f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:05.168269 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6889f195-5ee0-4332-b7c0-24304d846f98 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:05.168548 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6889f195-5ee0-4332-b7c0-24304d846f98 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:05.168818 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6889f195-5ee0-4332-b7c0-24304d846f98 None admin] PATH_INFO: `/v3/services` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:05.169493 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6889f195-5ee0-4332-b7c0-24304d846f98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:05.170861 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6889f195-5ee0-4332-b7c0-24304d846f98 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:05.177104 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 437/883] 10.222.0.44 () {56 vars in 1087 bytes} [Mon May 9 20:12:05 2022] GET /identity/v3/services => generated 1268 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:12:05.215529 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c6ecc6-75d3-4d3c-aa8a-8721df69da6d None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:05.216182 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c6ecc6-75d3-4d3c-aa8a-8721df69da6d None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:05.216651 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c6ecc6-75d3-4d3c-aa8a-8721df69da6d None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:05.218794 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 447/884] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:12:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:12:05.225567 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ab9515-9736-48e2-ad2e-6adbd1b65bb0 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:05.226170 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ab9515-9736-48e2-ad2e-6adbd1b65bb0 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:05.226640 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ab9515-9736-48e2-ad2e-6adbd1b65bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:05.245073 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-48ab9515-9736-48e2-ad2e-6adbd1b65bb0 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:12:05.246639 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-48ab9515-9736-48e2-ad2e-6adbd1b65bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:12:05.324285 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 438/885] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:12:05 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 20:12:05.348670 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c6ecc6-75d3-4d3c-aa8a-8721df69da6d None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:05.455467 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c6ecc6-75d3-4d3c-aa8a-8721df69da6d None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:05.489870 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8559b195-fbea-4b3b-97c5-c5ae4e4f5ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:05.490665 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8559b195-fbea-4b3b-97c5-c5ae4e4f5ee9 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:05.490946 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8559b195-fbea-4b3b-97c5-c5ae4e4f5ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:05.491305 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8559b195-fbea-4b3b-97c5-c5ae4e4f5ee9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:05.492004 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8559b195-fbea-4b3b-97c5-c5ae4e4f5ee9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:05.493098 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5d02c4-ea56-44ce-9d57-8683c5a51b47 None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:05.493563 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8559b195-fbea-4b3b-97c5-c5ae4e4f5ee9 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:05.493644 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5d02c4-ea56-44ce-9d57-8683c5a51b47 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:05.493644 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5d02c4-ea56-44ce-9d57-8683c5a51b47 None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:05.495198 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 439/886] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:12:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:12:05.500624 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb3ec2-a2cc-42d8-bc47-5b87e83cbd3c None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:05.500906 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb3ec2-a2cc-42d8-bc47-5b87e83cbd3c None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:05.501742 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb3ec2-a2cc-42d8-bc47-5b87e83cbd3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:05.507274 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-8559b195-fbea-4b3b-97c5-c5ae4e4f5ee9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 09 20:12:05.507274 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:12:05.507274 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 20:12:05.507274 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 20:12:05.507274 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 20:12:05.507274 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 20:12:05.507274 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 20:12:05.507274 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 20:12:05.507274 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 09 20:12:05.507274 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:12:05.507274 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 20:12:05.507274 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:12:05.507274 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:12:05.507274 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:12:05.507274 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:12:05.507274 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:12:05.507274 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:12:05.508267 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:12:05.508267 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:12:05.508267 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:12:05.508267 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:12:05.508267 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:12:05.508267 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:12:05.508267 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 20:12:05.508267 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 20:12:05.508267 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 20:12:05.508267 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 20:12:05.508267 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:12:05.508267 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:12:05.508267 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:12:05.508267 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:12:05.508267 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:12:05.508267 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:12:05.509092 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:12:05.509092 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:12:05.509092 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:12:05.509092 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:12:05.509092 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:12:05.509092 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:12:05.509092 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:12:05.509092 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:12:05.509092 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:12:05.509092 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:12:05.509092 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 20:12:05.509092 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 20:12:05.509092 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 09 20:12:05.509092 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:12:05.509092 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 448/887] 10.222.0.44 () {56 vars in 1114 bytes} [Mon May 9 20:12:05 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 20:12:05.515817 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8559b195-fbea-4b3b-97c5-c5ae4e4f5ee9 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:05.519104 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-6bbb3ec2-a2cc-42d8-bc47-5b87e83cbd3c None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:12:05.520313 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-6bbb3ec2-a2cc-42d8-bc47-5b87e83cbd3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:12:05.595528 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 440/888] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:12:05 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 20:12:05.618242 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb3ec2-a2cc-42d8-bc47-5b87e83cbd3c None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:05.622634 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8559b195-fbea-4b3b-97c5-c5ae4e4f5ee9 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:05.657211 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378912f6-a0fb-4408-83b3-e2e525cd0f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:05.658144 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378912f6-a0fb-4408-83b3-e2e525cd0f33 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:05.658526 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378912f6-a0fb-4408-83b3-e2e525cd0f33 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:05.658897 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378912f6-a0fb-4408-83b3-e2e525cd0f33 None admin] PATH_INFO: `/v3/services` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:05.659759 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378912f6-a0fb-4408-83b3-e2e525cd0f33 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:05.660161 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378912f6-a0fb-4408-83b3-e2e525cd0f33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:05.661688 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378912f6-a0fb-4408-83b3-e2e525cd0f33 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:05.667108 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 449/889] 10.222.0.44 () {56 vars in 1114 bytes} [Mon May 9 20:12:05 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:05.672471 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378912f6-a0fb-4408-83b3-e2e525cd0f33 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:05.720136 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb3ec2-a2cc-42d8-bc47-5b87e83cbd3c None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:05.754598 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9331177b-df7c-42d6-b3cd-4e1c8becbc6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:05.755430 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331177b-df7c-42d6-b3cd-4e1c8becbc6f None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:05.755720 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331177b-df7c-42d6-b3cd-4e1c8becbc6f None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:05.756248 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331177b-df7c-42d6-b3cd-4e1c8becbc6f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:05.756900 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9331177b-df7c-42d6-b3cd-4e1c8becbc6f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:05.758277 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9331177b-df7c-42d6-b3cd-4e1c8becbc6f None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:05.770767 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-9331177b-df7c-42d6-b3cd-4e1c8becbc6f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 20:12:05.770767 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:12:05.770767 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 20:12:05.770767 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 20:12:05.770767 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 20:12:05.770767 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 20:12:05.770767 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 20:12:05.770767 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 20:12:05.770767 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 20:12:05.770767 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:12:05.770767 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 20:12:05.770767 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:12:05.770767 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:12:05.770767 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:12:05.770767 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:12:05.770767 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:12:05.770767 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:12:05.772858 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:12:05.772858 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:12:05.772858 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:12:05.772858 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:12:05.772858 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:12:05.772858 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:12:05.772858 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 20:12:05.772858 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 20:12:05.772858 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 20:12:05.772858 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 20:12:05.772858 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:12:05.772858 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:12:05.772858 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:12:05.772858 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:12:05.772858 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:12:05.772858 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:12:05.773918 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:12:05.773918 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:12:05.773918 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:12:05.773918 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:12:05.773918 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:12:05.773918 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:12:05.773918 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:12:05.773918 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:12:05.773918 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:12:05.773918 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:12:05.773918 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 20:12:05.773918 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 20:12:05.773918 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 20:12:05.773918 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:12:05.773918 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 441/890] 10.222.0.44 () {56 vars in 1126 bytes} [Mon May 9 20:12:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 20:12:05.779437 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378912f6-a0fb-4408-83b3-e2e525cd0f33 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:05.781572 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9331177b-df7c-42d6-b3cd-4e1c8becbc6f None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:05.819042 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3da281-24d5-47e5-bd46-cde78402db99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:05.820205 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3da281-24d5-47e5-bd46-cde78402db99 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:05.820698 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3da281-24d5-47e5-bd46-cde78402db99 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:05.821173 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3da281-24d5-47e5-bd46-cde78402db99 None admin] PATH_INFO: `/v3/services` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:05.822082 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3da281-24d5-47e5-bd46-cde78402db99 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:05.822603 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3da281-24d5-47e5-bd46-cde78402db99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:05.824229 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3da281-24d5-47e5-bd46-cde78402db99 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:05.830003 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 450/891] 10.222.0.44 () {56 vars in 1114 bytes} [Mon May 9 20:12:05 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:12:05.835305 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3da281-24d5-47e5-bd46-cde78402db99 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:05.904679 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9331177b-df7c-42d6-b3cd-4e1c8becbc6f None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:05.933346 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3da281-24d5-47e5-bd46-cde78402db99 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:05.949256 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85e07cc-a000-464d-90bb-6b2efa5f2a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:05.950419 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85e07cc-a000-464d-90bb-6b2efa5f2a52 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:05.951169 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85e07cc-a000-464d-90bb-6b2efa5f2a52 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:05.951684 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85e07cc-a000-464d-90bb-6b2efa5f2a52 None admin] PATH_INFO: `/v3/services` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:05.952618 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85e07cc-a000-464d-90bb-6b2efa5f2a52 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:05.953131 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85e07cc-a000-464d-90bb-6b2efa5f2a52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:05.955561 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85e07cc-a000-464d-90bb-6b2efa5f2a52 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:05.967581 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 442/892] 10.222.0.44 () {56 vars in 1122 bytes} [Mon May 9 20:12:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:05.969204 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85e07cc-a000-464d-90bb-6b2efa5f2a52 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:05.972401 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5dc85f-686b-4396-8523-3d9401e607d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:05.973052 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5dc85f-686b-4396-8523-3d9401e607d2 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:05.973329 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5dc85f-686b-4396-8523-3d9401e607d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:05.973600 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5dc85f-686b-4396-8523-3d9401e607d2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:05.974470 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5dc85f-686b-4396-8523-3d9401e607d2 None admin] RBAC: Adding query filter params (interface=public, service_id=3b0fec020d014567bfc484486eea2090, region_id=RegionOne) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:05.974782 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5dc85f-686b-4396-8523-3d9401e607d2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:05.976296 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5dc85f-686b-4396-8523-3d9401e607d2 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:05.982666 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 451/893] 10.222.0.44 () {56 vars in 1251 bytes} [Mon May 9 20:12:05 2022] GET /identity/v3/endpoints?service_id=3b0fec020d014567bfc484486eea2090&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:12:05.988911 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5dc85f-686b-4396-8523-3d9401e607d2 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:06.089959 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85e07cc-a000-464d-90bb-6b2efa5f2a52 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:06.102891 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5dc85f-686b-4396-8523-3d9401e607d2 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:06.124004 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0855b1-baaa-4446-8af1-9b9dec1f6d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:06.124640 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0855b1-baaa-4446-8af1-9b9dec1f6d33 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:06.124914 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0855b1-baaa-4446-8af1-9b9dec1f6d33 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:06.125181 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0855b1-baaa-4446-8af1-9b9dec1f6d33 None admin] PATH_INFO: `/v3/services` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:06.125910 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0855b1-baaa-4446-8af1-9b9dec1f6d33 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:06.126236 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0855b1-baaa-4446-8af1-9b9dec1f6d33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:06.127832 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0855b1-baaa-4446-8af1-9b9dec1f6d33 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:06.139652 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 443/894] 10.222.0.44 () {56 vars in 1122 bytes} [Mon May 9 20:12:05 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:06.151987 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa48977-a25f-4dba-8980-ee57e9d3f1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:06.152712 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa48977-a25f-4dba-8980-ee57e9d3f1de None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:06.152987 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa48977-a25f-4dba-8980-ee57e9d3f1de None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:06.153302 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa48977-a25f-4dba-8980-ee57e9d3f1de None admin] PATH_INFO: `/v3/services` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:06.153996 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa48977-a25f-4dba-8980-ee57e9d3f1de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:06.155415 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa48977-a25f-4dba-8980-ee57e9d3f1de None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:06.163026 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 452/895] 10.222.0.44 () {56 vars in 1087 bytes} [Mon May 9 20:12:05 2022] GET /identity/v3/services => generated 1268 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:12:06.168326 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60e5be-437d-45e6-ba77-6f818abb0b31 None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:06.168686 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60e5be-437d-45e6-ba77-6f818abb0b31 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:06.168884 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60e5be-437d-45e6-ba77-6f818abb0b31 None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:06.170717 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 444/896] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:12:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:12:06.176908 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45575811-e53e-49c4-89e5-0eb017db2299 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:06.177190 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45575811-e53e-49c4-89e5-0eb017db2299 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:06.177468 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45575811-e53e-49c4-89e5-0eb017db2299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:06.196280 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-45575811-e53e-49c4-89e5-0eb017db2299 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:12:06.197635 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-45575811-e53e-49c4-89e5-0eb017db2299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:12:06.275344 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 453/897] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:12:06 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 20:12:06.299534 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad60e5be-437d-45e6-ba77-6f818abb0b31 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:06.414208 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad60e5be-437d-45e6-ba77-6f818abb0b31 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:06.446897 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1eeb0e-b202-4b3c-bfab-841e3c074488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:06.447749 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1eeb0e-b202-4b3c-bfab-841e3c074488 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:06.448031 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1eeb0e-b202-4b3c-bfab-841e3c074488 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:06.448303 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1eeb0e-b202-4b3c-bfab-841e3c074488 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:06.459865 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1eeb0e-b202-4b3c-bfab-841e3c074488 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:12:06.467974 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-7b1eeb0e-b202-4b3c-bfab-841e3c074488 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 20:12:06.467974 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:12:06.467974 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:12:06.467974 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:12:06.467974 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:12:06.467974 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:12:06.467974 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:12:06.467974 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:12:06.467974 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:12:06.467974 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:12:06.467974 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:12:06.467974 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:12:06.467974 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:12:06.467974 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:12:06.467974 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:12:06.467974 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:12:06.468988 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:12:06.468988 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:12:06.468988 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:12:06.468988 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:12:06.468988 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:12:06.468988 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:12:06.468988 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:12:06.468988 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:12:06.468988 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:12:06.468988 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:12:06.468988 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:12:06.468988 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:12:06.468988 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:12:06.468988 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:12:06.468988 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:12:06.468988 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:12:06.470530 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:12:06.470530 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:12:06.470530 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:12:06.470530 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:12:06.470530 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:12:06.470530 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:12:06.470530 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:12:06.470530 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:12:06.470530 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:12:06.470530 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:12:06.470530 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 20:12:06.470530 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:12:06.470530 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 445/898] 10.222.0.44 () {56 vars in 1120 bytes} [Mon May 9 20:12:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 20:12:06.475837 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45575811-e53e-49c4-89e5-0eb017db2299 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:06.580624 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45575811-e53e-49c4-89e5-0eb017db2299 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:06.615442 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d08055f-8906-4a25-b32c-15daa3e84353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:06.616119 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08055f-8906-4a25-b32c-15daa3e84353 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:06.616398 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08055f-8906-4a25-b32c-15daa3e84353 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:06.616672 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08055f-8906-4a25-b32c-15daa3e84353 None admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:06.617414 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d08055f-8906-4a25-b32c-15daa3e84353 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:06.617717 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d08055f-8906-4a25-b32c-15daa3e84353 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:06.619084 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d08055f-8906-4a25-b32c-15daa3e84353 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:06.628491 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 454/899] 10.222.0.44 () {56 vars in 1115 bytes} [Mon May 9 20:12:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:06.634201 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1eeb0e-b202-4b3c-bfab-841e3c074488 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:06.732580 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1eeb0e-b202-4b3c-bfab-841e3c074488 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:06.766841 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf20154-054a-44ce-bd23-4d89cc40241c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:06.768033 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf20154-054a-44ce-bd23-4d89cc40241c None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:06.768530 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf20154-054a-44ce-bd23-4d89cc40241c None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:06.769004 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf20154-054a-44ce-bd23-4d89cc40241c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:06.779132 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf20154-054a-44ce-bd23-4d89cc40241c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:06.780876 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf20154-054a-44ce-bd23-4d89cc40241c None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:06.799026 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-8cf20154-054a-44ce-bd23-4d89cc40241c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:12:06.799026 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:12:06.799026 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:12:06.799026 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:12:06.799026 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:12:06.799026 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:12:06.799026 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:12:06.799026 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:12:06.799026 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:12:06.799026 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:12:06.799026 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:12:06.799026 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:12:06.799026 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 20:12:06.799026 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 20:12:06.799026 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 20:12:06.800110 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 20:12:06.800110 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:12:06.800110 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:12:06.800110 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:12:06.800110 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:12:06.800110 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:12:06.800110 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:12:06.800110 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:12:06.800110 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:12:06.800110 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:12:06.800110 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:12:06.800110 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:12:06.800110 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:12:06.800110 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:12:06.800110 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:12:06.800110 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:12:06.800110 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:12:06.801022 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 20:12:06.801022 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 20:12:06.801022 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:12:06.801022 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:12:06.803233 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 446/900] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:12:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:12:06.809123 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d08055f-8906-4a25-b32c-15daa3e84353 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:06.915764 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d08055f-8906-4a25-b32c-15daa3e84353 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:06.949506 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4eb70b-056b-4569-a37a-cbab01c05224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:06.950172 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4eb70b-056b-4569-a37a-cbab01c05224 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:06.950453 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4eb70b-056b-4569-a37a-cbab01c05224 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:06.950725 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4eb70b-056b-4569-a37a-cbab01c05224 None admin] PATH_INFO: `/v3/domains` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:06.951462 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4eb70b-056b-4569-a37a-cbab01c05224 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:06.951771 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4eb70b-056b-4569-a37a-cbab01c05224 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:06.953136 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4eb70b-056b-4569-a37a-cbab01c05224 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:06.965714 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 455/901] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 9 20:12:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:06.972447 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf20154-054a-44ce-bd23-4d89cc40241c None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:07.078899 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf20154-054a-44ce-bd23-4d89cc40241c None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:07.113660 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b63d5db-ad23-4e63-8e55-1a40d72667b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:07.114461 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b63d5db-ad23-4e63-8e55-1a40d72667b9 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:07.114746 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b63d5db-ad23-4e63-8e55-1a40d72667b9 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:07.115017 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b63d5db-ad23-4e63-8e55-1a40d72667b9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:07.122932 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b63d5db-ad23-4e63-8e55-1a40d72667b9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:07.124414 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b63d5db-ad23-4e63-8e55-1a40d72667b9 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:07.139128 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-1b63d5db-ad23-4e63-8e55-1a40d72667b9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 20:12:07.139128 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:12:07.139128 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:12:07.139128 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:12:07.139128 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:12:07.139128 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:12:07.139128 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:12:07.139128 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:12:07.139128 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:12:07.139128 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:12:07.139128 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:12:07.139128 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:12:07.139128 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 20:12:07.139128 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 20:12:07.139128 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 20:12:07.139128 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 20:12:07.140152 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:12:07.140152 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:12:07.140152 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 20:12:07.140152 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 20:12:07.140152 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 20:12:07.140152 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 20:12:07.140152 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:12:07.140152 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:12:07.140152 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:12:07.140152 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:12:07.140152 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:12:07.140152 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:12:07.140152 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:12:07.140152 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:12:07.140152 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:12:07.140152 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:12:07.140152 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:12:07.140152 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:12:07.141141 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:12:07.141141 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:12:07.141141 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 20:12:07.141141 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 20:12:07.141141 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 20:12:07.141141 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 20:12:07.141141 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 20:12:07.141141 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 20:12:07.141141 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 20:12:07.141141 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:12:07.141141 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 447/902] 10.222.0.44 () {56 vars in 1117 bytes} [Mon May 9 20:12:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:12:07.149286 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4eb70b-056b-4569-a37a-cbab01c05224 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:07.253056 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4eb70b-056b-4569-a37a-cbab01c05224 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:07.287134 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aa875b-f8bd-490d-8523-d9c84712ef6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:07.287826 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa875b-f8bd-490d-8523-d9c84712ef6a None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:07.288108 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa875b-f8bd-490d-8523-d9c84712ef6a None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:07.288383 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa875b-f8bd-490d-8523-d9c84712ef6a None admin] PATH_INFO: `/v3/users` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:07.289214 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aa875b-f8bd-490d-8523-d9c84712ef6a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:07.289520 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aa875b-f8bd-490d-8523-d9c84712ef6a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:07.290950 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aa875b-f8bd-490d-8523-d9c84712ef6a None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:07.308898 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 456/903] 10.222.0.44 () {56 vars in 1149 bytes} [Mon May 9 20:12:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:07.315537 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b63d5db-ad23-4e63-8e55-1a40d72667b9 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:07.425183 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b63d5db-ad23-4e63-8e55-1a40d72667b9 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:07.462588 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeb23d6-25b0-4aaf-be59-4f77b1ac84dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:07.463237 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb23d6-25b0-4aaf-be59-4f77b1ac84dd None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:07.463546 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb23d6-25b0-4aaf-be59-4f77b1ac84dd None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:07.463820 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb23d6-25b0-4aaf-be59-4f77b1ac84dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:07.516028 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f604c0b-b1e8-4478-bec3-3701f0732d64 None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:07.516538 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f604c0b-b1e8-4478-bec3-3701f0732d64 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:07.516538 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f604c0b-b1e8-4478-bec3-3701f0732d64 None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:07.518415 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 457/904] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:12:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 20:12:07.525206 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c249bfc1-4271-489e-b667-ee2dfe9c5694 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:07.525489 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c249bfc1-4271-489e-b667-ee2dfe9c5694 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:07.525767 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c249bfc1-4271-489e-b667-ee2dfe9c5694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:07.536891 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeb23d6-25b0-4aaf-be59-4f77b1ac84dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:07.538931 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeb23d6-25b0-4aaf-be59-4f77b1ac84dd None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:07.542905 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-c249bfc1-4271-489e-b667-ee2dfe9c5694 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:12:07.544233 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-c249bfc1-4271-489e-b667-ee2dfe9c5694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:12:07.626358 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 458/905] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:12:07 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 20:12:07.648804 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c249bfc1-4271-489e-b667-ee2dfe9c5694 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:07.656813 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 448/906] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 9 20:12:07 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 20:12:07.663258 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeb23d6-25b0-4aaf-be59-4f77b1ac84dd None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:07.769227 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c249bfc1-4271-489e-b667-ee2dfe9c5694 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:07.779730 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeb23d6-25b0-4aaf-be59-4f77b1ac84dd None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:07.813007 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e37066e-eafe-4ed8-96a6-50cceb43edb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:07.814056 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e37066e-eafe-4ed8-96a6-50cceb43edb1 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:07.814329 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e37066e-eafe-4ed8-96a6-50cceb43edb1 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:07.814589 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e37066e-eafe-4ed8-96a6-50cceb43edb1 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:07.815238 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e37066e-eafe-4ed8-96a6-50cceb43edb1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:07.815642 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ab1490-3e96-4d8d-97b2-b28ea23b5513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:07.816636 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e37066e-eafe-4ed8-96a6-50cceb43edb1 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:07.816856 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab1490-3e96-4d8d-97b2-b28ea23b5513 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:07.817319 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab1490-3e96-4d8d-97b2-b28ea23b5513 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:07.817773 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab1490-3e96-4d8d-97b2-b28ea23b5513 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:07.827893 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ab1490-3e96-4d8d-97b2-b28ea23b5513 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:07.830298 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ab1490-3e96-4d8d-97b2-b28ea23b5513 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:07.831321 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-2e37066e-eafe-4ed8-96a6-50cceb43edb1 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 09 20:12:07.831321 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:12:07.831321 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 20:12:07.831321 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 20:12:07.831321 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 20:12:07.831321 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 20:12:07.831321 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 20:12:07.831321 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 20:12:07.831321 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 09 20:12:07.831321 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:12:07.831321 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 20:12:07.831321 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:12:07.831321 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:12:07.831321 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:12:07.831321 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:12:07.831321 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:12:07.832337 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:12:07.832337 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:12:07.832337 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:12:07.832337 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:12:07.832337 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:12:07.832337 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:12:07.832337 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:12:07.832337 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 20:12:07.832337 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 20:12:07.832337 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 20:12:07.832337 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 20:12:07.832337 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:12:07.832337 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:12:07.832337 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:12:07.832337 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:12:07.832337 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:12:07.838293 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:12:07.838293 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:12:07.838293 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:12:07.838293 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:12:07.838293 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:12:07.838293 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:12:07.838293 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:12:07.838293 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:12:07.838293 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:12:07.838293 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:12:07.838293 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:12:07.838293 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 20:12:07.838293 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 20:12:07.838293 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 09 20:12:07.838293 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:12:07.838293 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 459/907] 10.222.0.44 () {56 vars in 1132 bytes} [Mon May 9 20:12:07 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 20:12:07.840643 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e37066e-eafe-4ed8-96a6-50cceb43edb1 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:07.854230 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-d9ab1490-3e96-4d8d-97b2-b28ea23b5513 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:12:07.854230 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:12:07.854230 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:12:07.854230 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:12:07.854230 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:12:07.854230 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:12:07.854230 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:12:07.854230 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:12:07.854230 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:12:07.854230 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:12:07.854230 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:12:07.854230 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:12:07.854230 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 20:12:07.854230 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 20:12:07.854230 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 20:12:07.855158 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 20:12:07.855158 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:12:07.855158 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:12:07.855158 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:12:07.855158 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:12:07.855158 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:12:07.855158 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:12:07.855158 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:12:07.855158 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:12:07.855158 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:12:07.855158 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:12:07.855158 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:12:07.855158 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:12:07.855158 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:12:07.855158 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:12:07.855158 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:12:07.855158 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:12:07.856492 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 20:12:07.856492 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 20:12:07.856492 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:12:07.856492 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:12:07.859476 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 449/908] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:12:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:12:07.861093 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ab1490-3e96-4d8d-97b2-b28ea23b5513 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:07.968558 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e37066e-eafe-4ed8-96a6-50cceb43edb1 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:07.980545 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ab1490-3e96-4d8d-97b2-b28ea23b5513 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:08.012469 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0fe48c-75f9-4350-bddd-2db82739eebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:08.013615 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0fe48c-75f9-4350-bddd-2db82739eebc None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:08.014186 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0fe48c-75f9-4350-bddd-2db82739eebc None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:08.014640 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0fe48c-75f9-4350-bddd-2db82739eebc None admin] PATH_INFO: `/v3/services` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:08.015252 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd2edca-b3fa-4980-aa61-b515fa163b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:08.015772 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0fe48c-75f9-4350-bddd-2db82739eebc None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:08.016076 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2edca-b3fa-4980-aa61-b515fa163b9d None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:08.016426 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2edca-b3fa-4980-aa61-b515fa163b9d None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:08.016687 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0fe48c-75f9-4350-bddd-2db82739eebc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:08.017301 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2edca-b3fa-4980-aa61-b515fa163b9d None admin] PATH_INFO: `/v3/domains` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:08.018128 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd2edca-b3fa-4980-aa61-b515fa163b9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:08.018503 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd2edca-b3fa-4980-aa61-b515fa163b9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:08.019362 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0fe48c-75f9-4350-bddd-2db82739eebc None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:08.020069 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd2edca-b3fa-4980-aa61-b515fa163b9d None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:08.025714 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 460/909] 10.222.0.44 () {56 vars in 1126 bytes} [Mon May 9 20:12:07 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:12:08.031810 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0fe48c-75f9-4350-bddd-2db82739eebc None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:08.039199 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 450/910] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 9 20:12:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:12:08.040258 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd2edca-b3fa-4980-aa61-b515fa163b9d None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:08.154566 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd2edca-b3fa-4980-aa61-b515fa163b9d None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:08.165317 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0fe48c-75f9-4350-bddd-2db82739eebc None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:08.201622 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fe7d3e-4848-47a5-a299-1d742313bb68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:08.202408 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe7d3e-4848-47a5-a299-1d742313bb68 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:08.202686 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe7d3e-4848-47a5-a299-1d742313bb68 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:08.202956 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe7d3e-4848-47a5-a299-1d742313bb68 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:08.209839 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fe7d3e-4848-47a5-a299-1d742313bb68 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:08.211286 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fe7d3e-4848-47a5-a299-1d742313bb68 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:08.212087 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5516f5d3-d5c5-487d-aa6a-097ad2c7b4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:08.212852 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516f5d3-d5c5-487d-aa6a-097ad2c7b4e9 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:08.213032 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516f5d3-d5c5-487d-aa6a-097ad2c7b4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:08.213303 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516f5d3-d5c5-487d-aa6a-097ad2c7b4e9 None admin] PATH_INFO: `/v3/services` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:08.214008 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5516f5d3-d5c5-487d-aa6a-097ad2c7b4e9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:08.214311 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5516f5d3-d5c5-487d-aa6a-097ad2c7b4e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:08.216944 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5516f5d3-d5c5-487d-aa6a-097ad2c7b4e9 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:08.227417 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-58fe7d3e-4848-47a5-a299-1d742313bb68 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 20:12:08.227417 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:12:08.227417 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:12:08.227417 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:12:08.227417 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:12:08.227417 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:12:08.227417 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:12:08.227417 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:12:08.227417 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:12:08.227417 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:12:08.227417 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:12:08.227417 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:12:08.227417 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 20:12:08.227417 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 20:12:08.227417 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 20:12:08.228356 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 20:12:08.228356 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:12:08.228356 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:12:08.228356 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:12:08.228356 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:12:08.228356 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:12:08.228356 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:12:08.228356 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:12:08.228356 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:12:08.228356 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:12:08.228356 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:12:08.228356 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:12:08.228356 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:12:08.228356 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:12:08.228356 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:12:08.228356 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:12:08.228356 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:12:08.229234 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 20:12:08.229234 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 20:12:08.229234 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 20:12:08.229234 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 20:12:08.229234 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 20:12:08.229234 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 20:12:08.229234 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 20:12:08.229234 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:12:08.230224 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 461/911] 10.222.0.44 () {56 vars in 1126 bytes} [Mon May 9 20:12:08 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:08.231579 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5516f5d3-d5c5-487d-aa6a-097ad2c7b4e9 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:08.232005 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 451/912] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 9 20:12:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:12:08.240814 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fe7d3e-4848-47a5-a299-1d742313bb68 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:08.337134 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5516f5d3-d5c5-487d-aa6a-097ad2c7b4e9 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:08.339942 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fe7d3e-4848-47a5-a299-1d742313bb68 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:08.375033 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1960cdd-f4b8-4ee5-aaba-34381164fa1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:08.375733 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1960cdd-f4b8-4ee5-aaba-34381164fa1a None admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:08.376015 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1960cdd-f4b8-4ee5-aaba-34381164fa1a None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:08.376825 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1960cdd-f4b8-4ee5-aaba-34381164fa1a None admin] PATH_INFO: `/v3/endpoints` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:08.377575 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1960cdd-f4b8-4ee5-aaba-34381164fa1a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:08.378958 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1960cdd-f4b8-4ee5-aaba-34381164fa1a None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:08.380155 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21015f25-74ca-46e0-b402-84663c727025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:08.381176 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21015f25-74ca-46e0-b402-84663c727025 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:08.381531 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21015f25-74ca-46e0-b402-84663c727025 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:08.381815 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21015f25-74ca-46e0-b402-84663c727025 None admin] PATH_INFO: `/v3/projects` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:08.382766 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21015f25-74ca-46e0-b402-84663c727025 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:08.383077 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21015f25-74ca-46e0-b402-84663c727025 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:08.384531 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21015f25-74ca-46e0-b402-84663c727025 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:08.403112 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 452/913] 10.222.0.44 () {56 vars in 1148 bytes} [Mon May 9 20:12:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:08.404162 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21015f25-74ca-46e0-b402-84663c727025 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:08.407986 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 462/914] 10.222.0.44 () {60 vars in 1144 bytes} [Mon May 9 20:12:08 2022] POST /identity/v3/endpoints => generated 347 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:12:08.527112 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21015f25-74ca-46e0-b402-84663c727025 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:08.550706 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8cc325-d8ae-4314-8d35-5fa58b9d0cda None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:08.551620 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8cc325-d8ae-4314-8d35-5fa58b9d0cda None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:08.552058 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8cc325-d8ae-4314-8d35-5fa58b9d0cda None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:08.553869 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 463/915] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:12:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:12:08.560024 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa1e29-ae11-4b80-a49b-84ac0a4c05ec None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:08.560659 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa1e29-ae11-4b80-a49b-84ac0a4c05ec None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:08.561145 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa1e29-ae11-4b80-a49b-84ac0a4c05ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:08.572133 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aca8d53-931f-40d5-9c57-22f840a5bfa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:08.572795 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca8d53-931f-40d5-9c57-22f840a5bfa2 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:08.573073 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca8d53-931f-40d5-9c57-22f840a5bfa2 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:08.573345 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca8d53-931f-40d5-9c57-22f840a5bfa2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:08.574430 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aca8d53-931f-40d5-9c57-22f840a5bfa2 None admin] RBAC: Adding query filter params (role.id=397402b5f9aa441e966bdc8d463504e7, scope.project.id=563db7f5a25f480e8e6568b92ec3f195, user.id=0227b2954e61426388214e96e1741eb2) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:08.574745 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aca8d53-931f-40d5-9c57-22f840a5bfa2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:08.577308 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aca8d53-931f-40d5-9c57-22f840a5bfa2 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:08.584412 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 453/916] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 9 20:12:08 2022] GET /identity/v3/role_assignments?user.id=0227b2954e61426388214e96e1741eb2&scope.project.id=563db7f5a25f480e8e6568b92ec3f195&role.id=397402b5f9aa441e966bdc8d463504e7 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:08.599586 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-3eaa1e29-ae11-4b80-a49b-84ac0a4c05ec None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:12:08.601312 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-3eaa1e29-ae11-4b80-a49b-84ac0a4c05ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:12:08.606368 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee5d60-94fe-4014-93ad-faa3d594211b None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:08.606695 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee5d60-94fe-4014-93ad-faa3d594211b None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:08.606926 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee5d60-94fe-4014-93ad-faa3d594211b None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:08.608746 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 454/917] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:12:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 20:12:08.614840 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea025ace-ecbb-4108-b909-81d7bfdb59d0 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:08.615178 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea025ace-ecbb-4108-b909-81d7bfdb59d0 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:08.615422 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea025ace-ecbb-4108-b909-81d7bfdb59d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:08.635767 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-ea025ace-ecbb-4108-b909-81d7bfdb59d0 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:12:08.636992 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-ea025ace-ecbb-4108-b909-81d7bfdb59d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:12:08.687946 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 464/918] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:12:08 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 20:12:08.710773 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaa1e29-ae11-4b80-a49b-84ac0a4c05ec None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:08.723728 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 455/919] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:12:08 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 20:12:08.747323 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea025ace-ecbb-4108-b909-81d7bfdb59d0 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:08.845135 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaa1e29-ae11-4b80-a49b-84ac0a4c05ec None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:08.861007 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea025ace-ecbb-4108-b909-81d7bfdb59d0 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:08.891128 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f022e1-a59f-45a4-9e0d-15ce8accd960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:08.892181 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f022e1-a59f-45a4-9e0d-15ce8accd960 None admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:08.892531 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f022e1-a59f-45a4-9e0d-15ce8accd960 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:08.892863 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f022e1-a59f-45a4-9e0d-15ce8accd960 None admin] PATH_INFO: `/v3/services` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:08.894008 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f022e1-a59f-45a4-9e0d-15ce8accd960 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:08.895916 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f022e1-a59f-45a4-9e0d-15ce8accd960 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:08.902222 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedc6732-18bd-4038-a9bb-d6fd67da4dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:08.903800 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc6732-18bd-4038-a9bb-d6fd67da4dd8 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:08.904380 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc6732-18bd-4038-a9bb-d6fd67da4dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:08.904840 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc6732-18bd-4038-a9bb-d6fd67da4dd8 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:08.905827 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedc6732-18bd-4038-a9bb-d6fd67da4dd8 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:08.907878 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedc6732-18bd-4038-a9bb-d6fd67da4dd8 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:08.912625 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 465/920] 10.222.0.44 () {60 vars in 1141 bytes} [Mon May 9 20:12:08 2022] POST /identity/v3/services => generated 241 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 20:12:08.921022 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-bedc6732-18bd-4038-a9bb-d6fd67da4dd8 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 09 20:12:08.921022 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:12:08.921022 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 20:12:08.921022 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 20:12:08.921022 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 20:12:08.921022 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 20:12:08.921022 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 20:12:08.921022 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 20:12:08.921022 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 09 20:12:08.921022 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:12:08.921022 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 20:12:08.921022 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:12:08.921022 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:12:08.921022 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:12:08.921022 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:12:08.921022 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:12:08.921022 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:12:08.922118 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:12:08.922118 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:12:08.922118 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:12:08.922118 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:12:08.922118 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:12:08.922118 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:12:08.922118 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 20:12:08.922118 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 20:12:08.922118 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 20:12:08.922118 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 20:12:08.922118 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:12:08.922118 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:12:08.922118 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:12:08.922118 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:12:08.922118 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:12:08.922118 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:12:08.923493 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:12:08.923493 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:12:08.923493 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:12:08.923493 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:12:08.923493 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:12:08.923493 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:12:08.923493 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:12:08.923493 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:12:08.923493 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:12:08.923493 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:12:08.923493 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 20:12:08.923493 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 20:12:08.923493 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 09 20:12:08.923493 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:12:08.927200 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 456/921] 10.222.0.44 () {56 vars in 1114 bytes} [Mon May 9 20:12:08 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 20:12:08.939504 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f022e1-a59f-45a4-9e0d-15ce8accd960 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:09.054932 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f022e1-a59f-45a4-9e0d-15ce8accd960 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:09.090888 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167c94f5-7077-42a6-babf-86217a9126dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:09.091578 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c94f5-7077-42a6-babf-86217a9126dd None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:09.091859 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c94f5-7077-42a6-babf-86217a9126dd None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:09.092183 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c94f5-7077-42a6-babf-86217a9126dd None admin] PATH_INFO: `/v3/services` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:09.092903 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167c94f5-7077-42a6-babf-86217a9126dd None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:09.093206 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167c94f5-7077-42a6-babf-86217a9126dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:09.094601 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167c94f5-7077-42a6-babf-86217a9126dd None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:09.101802 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 466/922] 10.222.0.44 () {56 vars in 1114 bytes} [Mon May 9 20:12:08 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:09.106125 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedc6732-18bd-4038-a9bb-d6fd67da4dd8 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:09.211287 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedc6732-18bd-4038-a9bb-d6fd67da4dd8 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:09.248640 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfd3a1c-f1ac-4218-8ae0-01cdd030f962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:09.249298 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd3a1c-f1ac-4218-8ae0-01cdd030f962 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:09.249575 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd3a1c-f1ac-4218-8ae0-01cdd030f962 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:09.249843 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd3a1c-f1ac-4218-8ae0-01cdd030f962 None admin] PATH_INFO: `/v3/services` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:09.250542 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfd3a1c-f1ac-4218-8ae0-01cdd030f962 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:09.250839 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfd3a1c-f1ac-4218-8ae0-01cdd030f962 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:09.252338 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfd3a1c-f1ac-4218-8ae0-01cdd030f962 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:09.257723 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 457/923] 10.222.0.44 () {56 vars in 1114 bytes} [Mon May 9 20:12:09 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:12:09.263224 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167c94f5-7077-42a6-babf-86217a9126dd None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:09.363603 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167c94f5-7077-42a6-babf-86217a9126dd None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:09.397117 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaa94c0-3bff-4139-a5ee-4c181c2683ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:09.397777 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa94c0-3bff-4139-a5ee-4c181c2683ef None admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:09.398053 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa94c0-3bff-4139-a5ee-4c181c2683ef None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:09.398322 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa94c0-3bff-4139-a5ee-4c181c2683ef None admin] PATH_INFO: `/v3/endpoints` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:09.399043 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaa94c0-3bff-4139-a5ee-4c181c2683ef None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:09.400426 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaa94c0-3bff-4139-a5ee-4c181c2683ef None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:09.421116 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 467/924] 10.222.0.44 () {60 vars in 1144 bytes} [Mon May 9 20:12:09 2022] POST /identity/v3/endpoints => generated 346 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:12:10.795435 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b8fd50-b228-4451-a8b3-0852315627da None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:10.796457 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b8fd50-b228-4451-a8b3-0852315627da None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:10.796948 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b8fd50-b228-4451-a8b3-0852315627da None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:10.800025 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 458/925] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:12:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:12:10.804568 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b61519-99a5-4eea-af32-df06cc034c25 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:10.805468 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b61519-99a5-4eea-af32-df06cc034c25 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:10.805947 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b61519-99a5-4eea-af32-df06cc034c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:10.824215 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-b6b61519-99a5-4eea-af32-df06cc034c25 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:12:10.825695 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-b6b61519-99a5-4eea-af32-df06cc034c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:12:10.903568 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 468/926] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:12:10 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 20:12:10.921154 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b8fd50-b228-4451-a8b3-0852315627da None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:10.940149 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46efc05d-9338-4736-a667-0562203badea None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:10.940791 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46efc05d-9338-4736-a667-0562203badea None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:10.941270 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46efc05d-9338-4736-a667-0562203badea None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:10.943140 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 469/927] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:12:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 20:12:10.948654 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6175748-5a8c-4405-8da9-eff6a7f544a1 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:10.949188 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6175748-5a8c-4405-8da9-eff6a7f544a1 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:10.949707 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6175748-5a8c-4405-8da9-eff6a7f544a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:10.967595 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-c6175748-5a8c-4405-8da9-eff6a7f544a1 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:12:10.969083 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-c6175748-5a8c-4405-8da9-eff6a7f544a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:12:11.038198 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 470/928] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:12:10 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 20:12:11.043443 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b8fd50-b228-4451-a8b3-0852315627da None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:11.065015 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6175748-5a8c-4405-8da9-eff6a7f544a1 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:11.088827 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5dbf71-ab1d-4b94-afba-9e541edf3f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:11.090301 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5dbf71-ab1d-4b94-afba-9e541edf3f47 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:11.090813 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5dbf71-ab1d-4b94-afba-9e541edf3f47 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:11.091289 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5dbf71-ab1d-4b94-afba-9e541edf3f47 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:11.092624 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5dbf71-ab1d-4b94-afba-9e541edf3f47 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:11.094482 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5dbf71-ab1d-4b94-afba-9e541edf3f47 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:11.110891 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-fa5dbf71-ab1d-4b94-afba-9e541edf3f47 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 09 20:12:11.110891 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:12:11.110891 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 20:12:11.110891 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 20:12:11.110891 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 20:12:11.110891 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 20:12:11.110891 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 20:12:11.110891 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 20:12:11.110891 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 09 20:12:11.110891 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:12:11.110891 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 20:12:11.110891 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:12:11.110891 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:12:11.110891 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:12:11.110891 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:12:11.110891 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:12:11.110891 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:12:11.112377 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:12:11.112377 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:12:11.112377 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:12:11.112377 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:12:11.112377 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:12:11.112377 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:12:11.112377 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 20:12:11.112377 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 20:12:11.112377 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 20:12:11.112377 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 20:12:11.112377 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:12:11.112377 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:12:11.112377 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:12:11.112377 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:12:11.112377 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:12:11.112377 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:12:11.118968 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:12:11.118968 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:12:11.118968 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:12:11.118968 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:12:11.118968 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:12:11.118968 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:12:11.118968 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:12:11.118968 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:12:11.118968 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:12:11.118968 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:12:11.118968 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 20:12:11.118968 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 20:12:11.118968 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 09 20:12:11.118968 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:12:11.118968 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 459/929] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 9 20:12:10 2022] GET /identity/v3/services/compute => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:12:11.121362 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5dbf71-ab1d-4b94-afba-9e541edf3f47 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:11.188209 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6175748-5a8c-4405-8da9-eff6a7f544a1 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:11.231586 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69a8084-61fd-4811-8d34-f6c4688efc2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:11.232565 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69a8084-61fd-4811-8d34-f6c4688efc2e None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:11.232849 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69a8084-61fd-4811-8d34-f6c4688efc2e None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:11.233124 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69a8084-61fd-4811-8d34-f6c4688efc2e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:11.243848 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5dbf71-ab1d-4b94-afba-9e541edf3f47 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:11.247761 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69a8084-61fd-4811-8d34-f6c4688efc2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:12:11.257850 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-f69a8084-61fd-4811-8d34-f6c4688efc2e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 20:12:11.257850 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:12:11.257850 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:12:11.257850 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:12:11.257850 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:12:11.257850 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:12:11.257850 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:12:11.257850 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:12:11.257850 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:12:11.257850 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:12:11.257850 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:12:11.257850 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:12:11.257850 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:12:11.257850 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:12:11.257850 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:12:11.257850 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:12:11.259142 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:12:11.259142 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:12:11.259142 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:12:11.259142 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:12:11.259142 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:12:11.259142 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:12:11.259142 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:12:11.259142 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:12:11.259142 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:12:11.259142 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:12:11.259142 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:12:11.259142 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:12:11.259142 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:12:11.259142 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:12:11.259142 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:12:11.259142 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:12:11.264931 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:12:11.264931 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:12:11.264931 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:12:11.264931 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:12:11.264931 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:12:11.264931 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:12:11.264931 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:12:11.264931 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:12:11.264931 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:12:11.264931 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:12:11.264931 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 20:12:11.264931 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:12:11.264931 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 471/930] 10.222.0.44 () {56 vars in 1120 bytes} [Mon May 9 20:12:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:12:11.264931 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e7482-7349-42d1-b0e0-898e01e12ff6 None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:11.265708 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e7482-7349-42d1-b0e0-898e01e12ff6 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:11.265708 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e7482-7349-42d1-b0e0-898e01e12ff6 None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:11.265708 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 472/931] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:12:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:12:11.267752 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e7482-7349-42d1-b0e0-898e01e12ff6 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:11.287449 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa70cf3-208e-4aa6-b3f2-c1f379600617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:11.288111 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa70cf3-208e-4aa6-b3f2-c1f379600617 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:11.288390 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa70cf3-208e-4aa6-b3f2-c1f379600617 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:11.288659 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa70cf3-208e-4aa6-b3f2-c1f379600617 None admin] PATH_INFO: `/v3/services` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:11.289768 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa70cf3-208e-4aa6-b3f2-c1f379600617 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:11.290088 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa70cf3-208e-4aa6-b3f2-c1f379600617 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:11.291745 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa70cf3-208e-4aa6-b3f2-c1f379600617 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:11.298677 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 460/932] 10.222.0.44 () {56 vars in 1112 bytes} [Mon May 9 20:12:11 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:11.300343 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62b08c-d880-4aba-a6b0-48f0afaa303b None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:11.300634 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62b08c-d880-4aba-a6b0-48f0afaa303b None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:11.300976 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62b08c-d880-4aba-a6b0-48f0afaa303b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:11.317197 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-9e62b08c-d880-4aba-a6b0-48f0afaa303b None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:12:11.318381 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-9e62b08c-d880-4aba-a6b0-48f0afaa303b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:12:11.372006 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e7482-7349-42d1-b0e0-898e01e12ff6 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:11.385080 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 461/933] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:12:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 20:12:11.385911 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e62b08c-d880-4aba-a6b0-48f0afaa303b None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:11.415478 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5088e1-9ea6-46b2-8e63-32e4924526e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:11.416144 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5088e1-9ea6-46b2-8e63-32e4924526e9 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:11.416425 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5088e1-9ea6-46b2-8e63-32e4924526e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:11.416698 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5088e1-9ea6-46b2-8e63-32e4924526e9 None admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:11.417436 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5088e1-9ea6-46b2-8e63-32e4924526e9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:11.417744 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5088e1-9ea6-46b2-8e63-32e4924526e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:11.419108 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5088e1-9ea6-46b2-8e63-32e4924526e9 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:11.427826 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 473/934] 10.222.0.44 () {56 vars in 1115 bytes} [Mon May 9 20:12:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:12:11.428483 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5088e1-9ea6-46b2-8e63-32e4924526e9 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:11.487229 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e62b08c-d880-4aba-a6b0-48f0afaa303b None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:11.520404 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b88c179-6c76-4346-9f45-209ce8e657b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:11.521093 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b88c179-6c76-4346-9f45-209ce8e657b7 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:11.521369 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b88c179-6c76-4346-9f45-209ce8e657b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:11.521642 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b88c179-6c76-4346-9f45-209ce8e657b7 None admin] PATH_INFO: `/v3/services` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:11.522367 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b88c179-6c76-4346-9f45-209ce8e657b7 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:11.522674 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b88c179-6c76-4346-9f45-209ce8e657b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:11.524157 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b88c179-6c76-4346-9f45-209ce8e657b7 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:11.527015 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5088e1-9ea6-46b2-8e63-32e4924526e9 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:11.539442 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 462/935] 10.222.0.44 () {56 vars in 1112 bytes} [Mon May 9 20:12:11 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:11.539442 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b88c179-6c76-4346-9f45-209ce8e657b7 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:11.594947 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfc5b93-650d-4120-9583-733c492f39d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:11.595815 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc5b93-650d-4120-9583-733c492f39d0 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:11.596097 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc5b93-650d-4120-9583-733c492f39d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:11.596368 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc5b93-650d-4120-9583-733c492f39d0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:11.597043 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfc5b93-650d-4120-9583-733c492f39d0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:11.598656 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfc5b93-650d-4120-9583-733c492f39d0 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:11.612831 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-3dfc5b93-650d-4120-9583-733c492f39d0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 20:12:11.612831 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:12:11.612831 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 20:12:11.612831 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 20:12:11.612831 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 20:12:11.612831 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 20:12:11.612831 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 20:12:11.612831 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 20:12:11.612831 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 20:12:11.612831 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:12:11.612831 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 20:12:11.612831 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:12:11.612831 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:12:11.612831 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:12:11.612831 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:12:11.612831 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:12:11.612831 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:12:11.613974 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:12:11.613974 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:12:11.613974 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:12:11.613974 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:12:11.613974 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:12:11.613974 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:12:11.613974 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 20:12:11.613974 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 20:12:11.613974 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 20:12:11.613974 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 20:12:11.613974 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:12:11.613974 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:12:11.613974 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:12:11.613974 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:12:11.613974 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:12:11.613974 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:12:11.615209 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:12:11.615209 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:12:11.615209 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:12:11.615209 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:12:11.615209 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:12:11.615209 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:12:11.615209 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:12:11.615209 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:12:11.615209 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:12:11.615209 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:12:11.615209 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 20:12:11.615209 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 20:12:11.615209 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 20:12:11.615209 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:12:11.615209 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 474/936] 10.222.0.44 () {56 vars in 1126 bytes} [Mon May 9 20:12:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:12:11.622483 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfc5b93-650d-4120-9583-733c492f39d0 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:11.666602 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b88c179-6c76-4346-9f45-209ce8e657b7 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:11.711891 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac51a259-2fab-4300-bcbf-fcb507c0d8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:11.713667 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51a259-2fab-4300-bcbf-fcb507c0d8b9 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:11.713969 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51a259-2fab-4300-bcbf-fcb507c0d8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:11.714246 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51a259-2fab-4300-bcbf-fcb507c0d8b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:11.727594 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac51a259-2fab-4300-bcbf-fcb507c0d8b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:11.728778 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac51a259-2fab-4300-bcbf-fcb507c0d8b9 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:11.747113 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfc5b93-650d-4120-9583-733c492f39d0 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:11.747296 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-ac51a259-2fab-4300-bcbf-fcb507c0d8b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:12:11.747296 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:12:11.747296 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:12:11.747296 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:12:11.747296 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:12:11.747296 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:12:11.747296 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:12:11.747296 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:12:11.747296 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:12:11.747296 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:12:11.747296 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:12:11.747296 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:12:11.747296 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 20:12:11.747296 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 20:12:11.747296 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 20:12:11.748147 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 20:12:11.748147 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:12:11.748147 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:12:11.748147 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:12:11.748147 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:12:11.748147 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:12:11.748147 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:12:11.748147 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:12:11.748147 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:12:11.748147 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:12:11.748147 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:12:11.748147 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:12:11.748147 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:12:11.748147 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:12:11.748147 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:12:11.748147 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:12:11.748147 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:12:11.749553 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 20:12:11.749553 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 20:12:11.749553 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:12:11.749553 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:12:11.749553 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 463/937] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:12:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:12:11.749954 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae243b15-6ac1-462e-83ff-1f7881c2c744 None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:11.750090 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae243b15-6ac1-462e-83ff-1f7881c2c744 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:11.750358 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae243b15-6ac1-462e-83ff-1f7881c2c744 None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:11.752383 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 464/938] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:12:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:12:11.754235 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae243b15-6ac1-462e-83ff-1f7881c2c744 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:11.787218 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e895f163-37e8-4c61-977d-883e304553d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:11.787904 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e895f163-37e8-4c61-977d-883e304553d1 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:11.788316 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e895f163-37e8-4c61-977d-883e304553d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:11.788489 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e895f163-37e8-4c61-977d-883e304553d1 None admin] PATH_INFO: `/v3/services` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:11.789147 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e895f163-37e8-4c61-977d-883e304553d1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:11.789452 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e895f163-37e8-4c61-977d-883e304553d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:11.790807 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e895f163-37e8-4c61-977d-883e304553d1 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:11.795580 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 475/939] 10.222.0.44 () {56 vars in 1122 bytes} [Mon May 9 20:12:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:12:11.800781 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a633564-dc76-433b-88ce-98f6092cdfd9 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:11.801112 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a633564-dc76-433b-88ce-98f6092cdfd9 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:11.801386 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a633564-dc76-433b-88ce-98f6092cdfd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:11.820820 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-3a633564-dc76-433b-88ce-98f6092cdfd9 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:12:11.822002 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-3a633564-dc76-433b-88ce-98f6092cdfd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:12:11.856937 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae243b15-6ac1-462e-83ff-1f7881c2c744 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:11.890925 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d039a6-f793-4dc4-b4f2-8d1775318e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:11.891420 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 476/940] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:12:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 20:12:11.891655 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d039a6-f793-4dc4-b4f2-8d1775318e88 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:11.892041 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d039a6-f793-4dc4-b4f2-8d1775318e88 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:11.892317 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d039a6-f793-4dc4-b4f2-8d1775318e88 None admin] PATH_INFO: `/v3/domains` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:11.892982 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a633564-dc76-433b-88ce-98f6092cdfd9 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:11.893086 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d039a6-f793-4dc4-b4f2-8d1775318e88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:11.893328 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d039a6-f793-4dc4-b4f2-8d1775318e88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:11.894704 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d039a6-f793-4dc4-b4f2-8d1775318e88 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:11.911580 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 465/941] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 9 20:12:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:12:11.912499 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d039a6-f793-4dc4-b4f2-8d1775318e88 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:11.996004 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a633564-dc76-433b-88ce-98f6092cdfd9 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:12.010478 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d039a6-f793-4dc4-b4f2-8d1775318e88 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:12.031387 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab8edbc-690e-47fe-b863-38fa7231e898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:12.032070 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab8edbc-690e-47fe-b863-38fa7231e898 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:12.032999 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab8edbc-690e-47fe-b863-38fa7231e898 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:12.033271 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab8edbc-690e-47fe-b863-38fa7231e898 None admin] PATH_INFO: `/v3/services` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:12.033972 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab8edbc-690e-47fe-b863-38fa7231e898 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:12.034290 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab8edbc-690e-47fe-b863-38fa7231e898 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:12.035698 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab8edbc-690e-47fe-b863-38fa7231e898 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:12.043337 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56b6c16-f766-4c20-bd35-6cdfe49d67e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:12.044158 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b6c16-f766-4c20-bd35-6cdfe49d67e5 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:12.044436 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b6c16-f766-4c20-bd35-6cdfe49d67e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:12.044729 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b6c16-f766-4c20-bd35-6cdfe49d67e5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:12.045425 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 477/942] 10.222.0.44 () {56 vars in 1122 bytes} [Mon May 9 20:12:11 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:12.046264 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab8edbc-690e-47fe-b863-38fa7231e898 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:12.054118 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56b6c16-f766-4c20-bd35-6cdfe49d67e5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:12.055591 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56b6c16-f766-4c20-bd35-6cdfe49d67e5 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:12.069798 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-a56b6c16-f766-4c20-bd35-6cdfe49d67e5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 20:12:12.069798 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:12:12.069798 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:12:12.069798 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:12:12.069798 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:12:12.069798 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:12:12.069798 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:12:12.069798 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:12:12.069798 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:12:12.069798 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:12:12.069798 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:12:12.069798 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:12:12.069798 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 20:12:12.069798 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 20:12:12.069798 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 20:12:12.069798 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 20:12:12.070753 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:12:12.070753 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:12:12.070753 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 20:12:12.070753 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 20:12:12.070753 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 20:12:12.070753 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 20:12:12.070753 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:12:12.070753 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:12:12.070753 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:12:12.070753 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:12:12.070753 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:12:12.070753 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:12:12.070753 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:12:12.070753 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:12:12.070753 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:12:12.070753 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:12:12.070753 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:12:12.070753 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:12:12.071730 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:12:12.071730 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:12:12.071730 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 20:12:12.071730 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 20:12:12.071730 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 20:12:12.071730 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 20:12:12.071730 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 20:12:12.071730 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 20:12:12.071730 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 20:12:12.071730 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:12:12.071730 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 466/943] 10.222.0.44 () {56 vars in 1117 bytes} [Mon May 9 20:12:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:12:12.072318 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56b6c16-f766-4c20-bd35-6cdfe49d67e5 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:12.148485 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab8edbc-690e-47fe-b863-38fa7231e898 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:12.172008 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56b6c16-f766-4c20-bd35-6cdfe49d67e5 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:12.182073 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d78843d-e1e9-4b03-80bf-b7e497b522cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:12.182723 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78843d-e1e9-4b03-80bf-b7e497b522cc None admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:12.182998 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78843d-e1e9-4b03-80bf-b7e497b522cc None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:12.183265 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78843d-e1e9-4b03-80bf-b7e497b522cc None admin] PATH_INFO: `/v3/projects` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:12.183977 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d78843d-e1e9-4b03-80bf-b7e497b522cc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:12.185417 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d78843d-e1e9-4b03-80bf-b7e497b522cc None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:12.186764 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: WARNING keystone.server.flask.common [None req-3d78843d-e1e9-4b03-80bf-b7e497b522cc None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 09 20:12:12.203614 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.sql.core [None req-3d78843d-e1e9-4b03-80bf-b7e497b522cc None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 09 20:12:12.203614 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 09 20:12:12.203614 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [parameters: {'id': 'cf45d430afa64cfc8e8e06637c86f1de', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 09 20:12:12.203614 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79828) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 09 20:12:12.207599 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc8e48e-35c1-44c5-ab06-512b993692ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:12.208414 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8e48e-35c1-44c5-ab06-512b993692ef None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:12.208856 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8e48e-35c1-44c5-ab06-512b993692ef None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:12.209270 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8e48e-35c1-44c5-ab06-512b993692ef None admin] PATH_INFO: `/v3/endpoints` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:12.210199 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc8e48e-35c1-44c5-ab06-512b993692ef None admin] RBAC: Adding query filter params (interface=public, service_id=834fd04205804295990fc18398b6daf2, region_id=RegionOne) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:12.210648 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc8e48e-35c1-44c5-ab06-512b993692ef None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:12.210942 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-3d78843d-e1e9-4b03-80bf-b7e497b522cc None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id cf45d430afa64cfc8e8e06637c86f1de.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id cf45d430afa64cfc8e8e06637c86f1de. May 09 20:12:12.210942 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:12:12.210942 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 09 20:12:12.210942 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application self.dialect.do_execute( May 09 20:12:12.210942 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 09 20:12:12.210942 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 09 20:12:12.210942 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 09 20:12:12.210942 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application result = self._query(query) May 09 20:12:12.210942 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 09 20:12:12.210942 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application conn.query(q) May 09 20:12:12.210942 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 09 20:12:12.210942 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 09 20:12:12.210942 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 09 20:12:12.211874 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application result.read() May 09 20:12:12.211874 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 09 20:12:12.211874 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 09 20:12:12.211874 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 09 20:12:12.211874 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application packet.raise_for_error() May 09 20:12:12.211874 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 09 20:12:12.211874 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 09 20:12:12.211874 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 09 20:12:12.211874 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 09 20:12:12.211874 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 09 20:12:12.211874 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:12:12.211874 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 09 20:12:12.211874 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:12:12.211874 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:12:12.211874 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 09 20:12:12.211874 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 09 20:12:12.211874 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 09 20:12:12.211874 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return project_ref.to_dict() May 09 20:12:12.213015 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 09 20:12:12.213015 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application next(self.gen) May 09 20:12:12.213015 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 09 20:12:12.213015 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application yield resource May 09 20:12:12.213015 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 09 20:12:12.213015 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application next(self.gen) May 09 20:12:12.213015 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 09 20:12:12.213015 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application self.session.rollback() May 09 20:12:12.213015 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 09 20:12:12.213015 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application self.force_reraise() May 09 20:12:12.213015 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 09 20:12:12.213015 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise self.value May 09 20:12:12.213015 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 09 20:12:12.213015 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 09 20:12:12.213015 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 09 20:12:12.213015 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application session.commit() May 09 20:12:12.213015 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 09 20:12:12.214070 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 09 20:12:12.214070 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 09 20:12:12.214070 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application self._prepare_impl() May 09 20:12:12.214070 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 09 20:12:12.214070 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application self.session.flush() May 09 20:12:12.214070 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 09 20:12:12.214070 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application self._flush(objects) May 09 20:12:12.214070 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 09 20:12:12.214070 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 09 20:12:12.214070 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 09 20:12:12.214070 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application compat.raise_( May 09 20:12:12.214070 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 09 20:12:12.214070 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception May 09 20:12:12.214070 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 09 20:12:12.214070 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application flush_context.execute() May 09 20:12:12.214070 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 09 20:12:12.214070 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rec.execute(self) May 09 20:12:12.215128 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 09 20:12:12.215128 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 09 20:12:12.215128 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 09 20:12:12.215128 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application _emit_insert_statements( May 09 20:12:12.215128 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 09 20:12:12.215128 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application c = connection._execute_20( May 09 20:12:12.215128 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 09 20:12:12.215128 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 09 20:12:12.215128 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 09 20:12:12.215128 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 09 20:12:12.215128 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 09 20:12:12.215128 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ret = self._execute_context( May 09 20:12:12.215128 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 09 20:12:12.215128 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 09 20:12:12.215128 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 09 20:12:12.216178 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 09 20:12:12.216178 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 09 20:12:12.216178 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception May 09 20:12:12.216178 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 09 20:12:12.216178 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application self.dialect.do_execute( May 09 20:12:12.216178 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 09 20:12:12.216178 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 09 20:12:12.216178 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 09 20:12:12.216178 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application result = self._query(query) May 09 20:12:12.216178 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 09 20:12:12.216178 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application conn.query(q) May 09 20:12:12.216178 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 09 20:12:12.216178 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 09 20:12:12.216178 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 09 20:12:12.216178 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application result.read() May 09 20:12:12.216178 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 09 20:12:12.216178 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 09 20:12:12.217147 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 09 20:12:12.217147 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application packet.raise_for_error() May 09 20:12:12.217147 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 09 20:12:12.217147 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 09 20:12:12.217147 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 09 20:12:12.217147 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 09 20:12:12.217147 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 09 20:12:12.217147 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 09 20:12:12.217147 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [parameters: {'id': 'cf45d430afa64cfc8e8e06637c86f1de', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 09 20:12:12.217147 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 09 20:12:12.217147 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:12:12.217147 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 20:12:12.217147 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:12:12.217147 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:12:12.217147 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 09 20:12:12.218075 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 09 20:12:12.218075 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 09 20:12:12.218075 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 09 20:12:12.218075 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 09 20:12:12.218075 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:12:12.218075 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 20:12:12.218075 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:12:12.218075 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:12:12.218075 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:12:12.218075 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:12:12.218075 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:12:12.218075 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:12:12.218075 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:12:12.218075 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:12:12.218075 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:12:12.218075 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:12:12.218075 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:12:12.219303 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:12:12.219303 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 09 20:12:12.219303 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 09 20:12:12.219303 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:12:12.219303 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:12:12.219303 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 09 20:12:12.219303 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.Conflict( May 09 20:12:12.219303 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id cf45d430afa64cfc8e8e06637c86f1de. May 09 20:12:12.219303 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:12:12.219303 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 478/944] 10.222.0.44 () {60 vars in 1140 bytes} [Mon May 9 20:12:12 2022] POST /identity/v3/projects => generated 262 bytes in 171 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 09 20:12:12.219303 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d78843d-e1e9-4b03-80bf-b7e497b522cc None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:12.221642 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc8e48e-35c1-44c5-ab06-512b993692ef None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:12.227627 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 467/945] 10.222.0.44 () {56 vars in 1251 bytes} [Mon May 9 20:12:12 2022] GET /identity/v3/endpoints?service_id=834fd04205804295990fc18398b6daf2&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:12.228611 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc8e48e-35c1-44c5-ab06-512b993692ef None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:12.321929 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d78843d-e1e9-4b03-80bf-b7e497b522cc None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:12.329764 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc8e48e-35c1-44c5-ab06-512b993692ef None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:12.355561 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6871874-b701-4416-a05d-e220927b4964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:12.356232 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6871874-b701-4416-a05d-e220927b4964 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:12.356514 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6871874-b701-4416-a05d-e220927b4964 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:12.356788 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6871874-b701-4416-a05d-e220927b4964 None admin] PATH_INFO: `/v3/users` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:12.357626 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6871874-b701-4416-a05d-e220927b4964 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:12.357942 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6871874-b701-4416-a05d-e220927b4964 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:12.359602 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6871874-b701-4416-a05d-e220927b4964 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:12.363987 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc9518d-4e19-431a-a5ea-f21336ce38e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:12.365648 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc9518d-4e19-431a-a5ea-f21336ce38e0 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:12.365925 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc9518d-4e19-431a-a5ea-f21336ce38e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:12.366193 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc9518d-4e19-431a-a5ea-f21336ce38e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:12.373067 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc9518d-4e19-431a-a5ea-f21336ce38e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:12.374521 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc9518d-4e19-431a-a5ea-f21336ce38e0 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:12.381823 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 479/946] 10.222.0.44 () {56 vars in 1149 bytes} [Mon May 9 20:12:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:12.382866 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6871874-b701-4416-a05d-e220927b4964 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:12.388774 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-2bc9518d-4e19-431a-a5ea-f21336ce38e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 20:12:12.388774 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:12:12.388774 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:12:12.388774 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:12:12.388774 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:12:12.388774 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:12:12.388774 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:12:12.388774 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:12:12.388774 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:12:12.388774 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:12:12.388774 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:12:12.388774 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:12:12.388774 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 20:12:12.388774 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 20:12:12.388774 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 20:12:12.389709 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 20:12:12.389709 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:12:12.389709 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:12:12.389709 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:12:12.389709 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:12:12.389709 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:12:12.389709 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:12:12.389709 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:12:12.389709 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:12:12.389709 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:12:12.389709 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:12:12.389709 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:12:12.389709 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:12:12.389709 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:12:12.389709 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:12:12.389709 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:12:12.389709 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:12:12.390589 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 20:12:12.390589 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 20:12:12.390589 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 20:12:12.390589 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 20:12:12.390589 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 20:12:12.390589 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 20:12:12.390589 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 20:12:12.390589 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:12:12.390589 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 468/947] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 9 20:12:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:12:12.392246 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc9518d-4e19-431a-a5ea-f21336ce38e0 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:12.488855 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6871874-b701-4416-a05d-e220927b4964 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:12.497114 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc9518d-4e19-431a-a5ea-f21336ce38e0 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:12.522695 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4245d9b-c299-4cab-b59c-915f488969d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:12.523347 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4245d9b-c299-4cab-b59c-915f488969d6 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:12.523678 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4245d9b-c299-4cab-b59c-915f488969d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:12.523958 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4245d9b-c299-4cab-b59c-915f488969d6 None admin] PATH_INFO: `/v3/services` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:12.524634 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4245d9b-c299-4cab-b59c-915f488969d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:12.525998 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4245d9b-c299-4cab-b59c-915f488969d6 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:12.530721 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917e50b7-4491-4a8c-ad15-8a4ced745e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:12.531540 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917e50b7-4491-4a8c-ad15-8a4ced745e3f None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:12.543830 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917e50b7-4491-4a8c-ad15-8a4ced745e3f None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:12.544039 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 480/948] 10.222.0.44 () {56 vars in 1087 bytes} [Mon May 9 20:12:12 2022] GET /identity/v3/services => generated 1497 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:12:12.544119 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917e50b7-4491-4a8c-ad15-8a4ced745e3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:12.544190 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4245d9b-c299-4cab-b59c-915f488969d6 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:12.555884 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917e50b7-4491-4a8c-ad15-8a4ced745e3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:12.557371 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917e50b7-4491-4a8c-ad15-8a4ced745e3f None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:12.577316 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-917e50b7-4491-4a8c-ad15-8a4ced745e3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:12:12.577316 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:12:12.577316 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:12:12.577316 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:12:12.577316 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:12:12.577316 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:12:12.577316 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:12:12.577316 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:12:12.577316 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:12:12.577316 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:12:12.577316 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:12:12.577316 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:12:12.577316 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 20:12:12.577316 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 20:12:12.577316 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 20:12:12.578479 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 20:12:12.578479 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:12:12.578479 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:12:12.578479 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:12:12.578479 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:12:12.578479 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:12:12.578479 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:12:12.578479 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:12:12.578479 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:12:12.578479 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:12:12.578479 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:12:12.578479 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:12:12.578479 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:12:12.578479 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:12:12.578479 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:12:12.578479 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:12:12.578479 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:12:12.579925 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 20:12:12.579925 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 20:12:12.579925 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:12:12.579925 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:12:12.579925 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 469/949] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:12:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:12:12.584222 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917e50b7-4491-4a8c-ad15-8a4ced745e3f None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:12.693971 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4245d9b-c299-4cab-b59c-915f488969d6 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:12.695496 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917e50b7-4491-4a8c-ad15-8a4ced745e3f None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:12.730922 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283ce1c7-de30-42cc-a763-cb5d0b34a14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:12.731731 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283ce1c7-de30-42cc-a763-cb5d0b34a14e None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:12.732114 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283ce1c7-de30-42cc-a763-cb5d0b34a14e None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:12.732488 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283ce1c7-de30-42cc-a763-cb5d0b34a14e None admin] PATH_INFO: `/v3/projects` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:12.733353 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283ce1c7-de30-42cc-a763-cb5d0b34a14e None admin] RBAC: Adding query filter params (name=service) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:12.734029 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283ce1c7-de30-42cc-a763-cb5d0b34a14e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:12.735352 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283ce1c7-de30-42cc-a763-cb5d0b34a14e None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:12.739909 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27403a64-bd8b-42c8-8b7d-1d17611833a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:12.740754 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27403a64-bd8b-42c8-8b7d-1d17611833a0 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:12.741188 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27403a64-bd8b-42c8-8b7d-1d17611833a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:12.741602 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27403a64-bd8b-42c8-8b7d-1d17611833a0 None admin] PATH_INFO: `/v3/domains` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:12.742472 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27403a64-bd8b-42c8-8b7d-1d17611833a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:12.742983 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27403a64-bd8b-42c8-8b7d-1d17611833a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:12.744513 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27403a64-bd8b-42c8-8b7d-1d17611833a0 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:12.756760 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 470/950] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 9 20:12:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:12:12.757897 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 481/951] 10.222.0.44 () {56 vars in 1112 bytes} [Mon May 9 20:12:12 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:12.762676 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27403a64-bd8b-42c8-8b7d-1d17611833a0 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:12.874577 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27403a64-bd8b-42c8-8b7d-1d17611833a0 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:12.912755 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc7448-6f90-43d5-8a64-a2857c07797c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:12.913554 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc7448-6f90-43d5-8a64-a2857c07797c None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:12.913831 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc7448-6f90-43d5-8a64-a2857c07797c None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:12.914099 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc7448-6f90-43d5-8a64-a2857c07797c None admin] PATH_INFO: `/v3/projects/service` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:12.921637 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcc7448-6f90-43d5-8a64-a2857c07797c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:12.923218 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcc7448-6f90-43d5-8a64-a2857c07797c None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:12.939780 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-fdcc7448-6f90-43d5-8a64-a2857c07797c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 20:12:12.939780 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:12:12.939780 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:12:12.939780 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:12:12.939780 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:12:12.939780 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:12:12.939780 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:12:12.939780 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:12:12.939780 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:12:12.939780 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:12:12.939780 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:12:12.939780 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:12:12.939780 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 20:12:12.939780 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 20:12:12.939780 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 20:12:12.940749 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 20:12:12.940749 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:12:12.940749 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:12:12.940749 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:12:12.940749 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:12:12.940749 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:12:12.940749 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:12:12.940749 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:12:12.940749 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:12:12.940749 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:12:12.940749 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:12:12.940749 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:12:12.940749 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:12:12.940749 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:12:12.940749 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:12:12.940749 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:12:12.940749 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:12:12.941701 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 20:12:12.941701 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 20:12:12.941701 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 20:12:12.941701 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 20:12:12.941701 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 20:12:12.941701 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 20:12:12.941701 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 20:12:12.941701 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:12:12.941701 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 471/952] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 9 20:12:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:12:12.946558 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283ce1c7-de30-42cc-a763-cb5d0b34a14e None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:13.046985 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283ce1c7-de30-42cc-a763-cb5d0b34a14e None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:13.081333 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cbf8a2-3bc4-47ee-9a8a-2bfda2b59ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:13.081999 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cbf8a2-3bc4-47ee-9a8a-2bfda2b59ef7 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:13.082280 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cbf8a2-3bc4-47ee-9a8a-2bfda2b59ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:13.082553 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cbf8a2-3bc4-47ee-9a8a-2bfda2b59ef7 None admin] PATH_INFO: `/v3/projects` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:13.083342 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cbf8a2-3bc4-47ee-9a8a-2bfda2b59ef7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:13.083679 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cbf8a2-3bc4-47ee-9a8a-2bfda2b59ef7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:13.085217 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cbf8a2-3bc4-47ee-9a8a-2bfda2b59ef7 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:13.097653 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 482/953] 10.222.0.44 () {56 vars in 1148 bytes} [Mon May 9 20:12:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:13.104541 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc7448-6f90-43d5-8a64-a2857c07797c None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:13.209218 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc7448-6f90-43d5-8a64-a2857c07797c None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:13.243782 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdc0ff1-8de8-407d-b286-02d41dd241eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:13.244668 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc0ff1-8de8-407d-b286-02d41dd241eb None admin] REQUEST_METHOD: `PUT` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:13.244945 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc0ff1-8de8-407d-b286-02d41dd241eb None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:13.245214 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc0ff1-8de8-407d-b286-02d41dd241eb None admin] PATH_INFO: `/v3/projects/563db7f5a25f480e8e6568b92ec3f195/users/0227b2954e61426388214e96e1741eb2/roles/397402b5f9aa441e966bdc8d463504e7` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:13.247453 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdc0ff1-8de8-407d-b286-02d41dd241eb None admin] RBAC: Authorizing `identity:create_grant(project_id=563db7f5a25f480e8e6568b92ec3f195, user_id=0227b2954e61426388214e96e1741eb2, role_id=397402b5f9aa441e966bdc8d463504e7)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:13.248895 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdc0ff1-8de8-407d-b286-02d41dd241eb None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:13.264468 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 472/954] 10.222.0.44 () {58 vars in 1439 bytes} [Mon May 9 20:12:13 2022] PUT /identity/v3/projects/563db7f5a25f480e8e6568b92ec3f195/users/0227b2954e61426388214e96e1741eb2/roles/397402b5f9aa441e966bdc8d463504e7 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:12:13.821071 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f1b1c-9d07-41ad-b3c7-1f64aecdff13 None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:13.821468 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f1b1c-9d07-41ad-b3c7-1f64aecdff13 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:13.821651 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f1b1c-9d07-41ad-b3c7-1f64aecdff13 None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:13.823213 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 483/955] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:12:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:12:13.828590 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d26a5-46ff-4238-b1e9-0dbdff96057d None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:13.828875 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d26a5-46ff-4238-b1e9-0dbdff96057d None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:13.829678 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d26a5-46ff-4238-b1e9-0dbdff96057d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:13.846847 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-bf9d26a5-46ff-4238-b1e9-0dbdff96057d None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:12:13.847975 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-bf9d26a5-46ff-4238-b1e9-0dbdff96057d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:12:13.915238 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 473/956] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:12:13 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 20:12:13.937821 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448f1b1c-9d07-41ad-b3c7-1f64aecdff13 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:14.043010 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448f1b1c-9d07-41ad-b3c7-1f64aecdff13 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:14.076549 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b797d7-d414-479a-b4aa-56582d56bf48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:14.077203 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b797d7-d414-479a-b4aa-56582d56bf48 None admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:14.077483 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b797d7-d414-479a-b4aa-56582d56bf48 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:14.077756 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b797d7-d414-479a-b4aa-56582d56bf48 None admin] PATH_INFO: `/v3/services` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:14.078485 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b797d7-d414-479a-b4aa-56582d56bf48 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:14.080408 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b797d7-d414-479a-b4aa-56582d56bf48 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:14.097198 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 484/957] 10.222.0.44 () {60 vars in 1141 bytes} [Mon May 9 20:12:13 2022] POST /identity/v3/services => generated 242 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:12:14.905616 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b2267-3da0-47d9-938c-f4d3b8070009 None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:14.905981 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b2267-3da0-47d9-938c-f4d3b8070009 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:14.906174 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b2267-3da0-47d9-938c-f4d3b8070009 None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:14.907773 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 474/958] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:12:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:12:14.913275 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f33844-fbdb-4373-aac4-8f32f6bc3290 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:14.913568 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f33844-fbdb-4373-aac4-8f32f6bc3290 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:14.913846 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f33844-fbdb-4373-aac4-8f32f6bc3290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:14.931807 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-22f33844-fbdb-4373-aac4-8f32f6bc3290 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:12:14.933380 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-22f33844-fbdb-4373-aac4-8f32f6bc3290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:12:15.012339 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 485/959] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:12:14 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 20:12:15.035791 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8b2267-3da0-47d9-938c-f4d3b8070009 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:15.135612 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df72ca0-bafd-451d-bb6a-032a8283473f None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:15.136288 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df72ca0-bafd-451d-bb6a-032a8283473f None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:15.136502 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df72ca0-bafd-451d-bb6a-032a8283473f None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:15.138879 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 486/960] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:12:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 20:12:15.144669 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8b2267-3da0-47d9-938c-f4d3b8070009 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:15.146500 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19df088-052b-48a8-940d-1cc23675c5b7 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:15.146787 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19df088-052b-48a8-940d-1cc23675c5b7 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:15.147065 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19df088-052b-48a8-940d-1cc23675c5b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:15.164918 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-a19df088-052b-48a8-940d-1cc23675c5b7 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:12:15.166010 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-a19df088-052b-48a8-940d-1cc23675c5b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:12:15.179142 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a48dad-2a3b-48b8-ba6c-444346657832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:15.179973 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a48dad-2a3b-48b8-ba6c-444346657832 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:15.180251 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a48dad-2a3b-48b8-ba6c-444346657832 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:15.180522 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a48dad-2a3b-48b8-ba6c-444346657832 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:15.181171 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a48dad-2a3b-48b8-ba6c-444346657832 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:15.182600 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a48dad-2a3b-48b8-ba6c-444346657832 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:15.195375 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-b3a48dad-2a3b-48b8-ba6c-444346657832 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 20:12:15.195375 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:12:15.195375 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 20:12:15.195375 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 20:12:15.195375 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 20:12:15.195375 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 20:12:15.195375 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 20:12:15.195375 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 20:12:15.195375 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 20:12:15.195375 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:12:15.195375 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 20:12:15.195375 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:12:15.195375 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:12:15.195375 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:12:15.195375 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:12:15.195375 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:12:15.195375 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:12:15.197421 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:12:15.197421 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:12:15.197421 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:12:15.197421 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:12:15.197421 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:12:15.197421 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:12:15.197421 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 20:12:15.197421 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 20:12:15.197421 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 20:12:15.197421 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 20:12:15.197421 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:12:15.197421 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:12:15.197421 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:12:15.197421 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:12:15.197421 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:12:15.197421 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:12:15.198508 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:12:15.198508 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:12:15.198508 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:12:15.198508 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:12:15.198508 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:12:15.198508 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:12:15.198508 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:12:15.198508 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:12:15.198508 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:12:15.198508 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:12:15.198508 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 20:12:15.198508 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 20:12:15.198508 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 20:12:15.198508 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:12:15.198508 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 475/961] 10.222.0.44 () {56 vars in 1126 bytes} [Mon May 9 20:12:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:12:15.202910 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a48dad-2a3b-48b8-ba6c-444346657832 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:15.259543 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 487/962] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:12:15 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 20:12:15.288435 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19df088-052b-48a8-940d-1cc23675c5b7 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:15.317317 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a48dad-2a3b-48b8-ba6c-444346657832 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:15.353031 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e438ab3-16e0-474d-93cf-fd96016ebd7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:15.353689 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e438ab3-16e0-474d-93cf-fd96016ebd7e None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:15.353965 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e438ab3-16e0-474d-93cf-fd96016ebd7e None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:15.354233 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e438ab3-16e0-474d-93cf-fd96016ebd7e None admin] PATH_INFO: `/v3/services` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:15.354934 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e438ab3-16e0-474d-93cf-fd96016ebd7e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:15.355235 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e438ab3-16e0-474d-93cf-fd96016ebd7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:15.356636 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e438ab3-16e0-474d-93cf-fd96016ebd7e None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:15.362476 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 476/963] 10.222.0.44 () {56 vars in 1122 bytes} [Mon May 9 20:12:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:12:15.368038 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e438ab3-16e0-474d-93cf-fd96016ebd7e None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:15.417943 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19df088-052b-48a8-940d-1cc23675c5b7 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:15.464420 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fb6d89-defa-4c4c-a175-b7cfc79486d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:15.465221 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb6d89-defa-4c4c-a175-b7cfc79486d2 None admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:15.465506 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb6d89-defa-4c4c-a175-b7cfc79486d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:15.465941 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb6d89-defa-4c4c-a175-b7cfc79486d2 None admin] PATH_INFO: `/v3/users` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:15.466961 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fb6d89-defa-4c4c-a175-b7cfc79486d2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:15.468700 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fb6d89-defa-4c4c-a175-b7cfc79486d2 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:15.472602 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e438ab3-16e0-474d-93cf-fd96016ebd7e None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:15.484896 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.sql.core [None req-37fb6d89-defa-4c4c-a175-b7cfc79486d2 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 09 20:12:15.484896 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 09 20:12:15.484896 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [parameters: {'user_id': '0dac8aa6f7a74178952f1575c77a7443', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 09 20:12:15.484896 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79828) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 09 20:12:15.495171 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-37fb6d89-defa-4c4c-a175-b7cfc79486d2 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 09 20:12:15.495171 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:12:15.495171 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 09 20:12:15.495171 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application self.dialect.do_execute( May 09 20:12:15.495171 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 09 20:12:15.495171 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 09 20:12:15.495171 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 09 20:12:15.495171 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application result = self._query(query) May 09 20:12:15.495171 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 09 20:12:15.495171 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application conn.query(q) May 09 20:12:15.495171 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 09 20:12:15.495171 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 09 20:12:15.495171 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 09 20:12:15.495171 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application result.read() May 09 20:12:15.495171 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 09 20:12:15.497041 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 09 20:12:15.497041 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 09 20:12:15.497041 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application packet.raise_for_error() May 09 20:12:15.497041 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 09 20:12:15.497041 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 09 20:12:15.497041 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 09 20:12:15.497041 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 09 20:12:15.497041 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 09 20:12:15.497041 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:12:15.497041 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 09 20:12:15.497041 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:12:15.497041 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:12:15.497041 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 09 20:12:15.497041 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 09 20:12:15.497041 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 09 20:12:15.497041 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 09 20:12:15.497041 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 09 20:12:15.497041 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application next(self.gen) May 09 20:12:15.498268 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 09 20:12:15.498268 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application yield resource May 09 20:12:15.498268 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 09 20:12:15.498268 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application next(self.gen) May 09 20:12:15.498268 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 09 20:12:15.498268 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application self.session.rollback() May 09 20:12:15.498268 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 09 20:12:15.498268 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application self.force_reraise() May 09 20:12:15.498268 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 09 20:12:15.498268 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise self.value May 09 20:12:15.498268 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 09 20:12:15.498268 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 09 20:12:15.498268 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 09 20:12:15.498268 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application session.commit() May 09 20:12:15.498268 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 09 20:12:15.498268 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 09 20:12:15.498268 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 09 20:12:15.499343 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application self._prepare_impl() May 09 20:12:15.499343 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 09 20:12:15.499343 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application self.session.flush() May 09 20:12:15.499343 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 09 20:12:15.499343 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application self._flush(objects) May 09 20:12:15.499343 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 09 20:12:15.499343 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 09 20:12:15.499343 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 09 20:12:15.499343 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application compat.raise_( May 09 20:12:15.499343 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 09 20:12:15.499343 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception May 09 20:12:15.499343 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 09 20:12:15.499343 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application flush_context.execute() May 09 20:12:15.499343 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 09 20:12:15.499343 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rec.execute(self) May 09 20:12:15.499343 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 09 20:12:15.499343 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 09 20:12:15.500544 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 09 20:12:15.500544 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application _emit_insert_statements( May 09 20:12:15.500544 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 09 20:12:15.500544 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application result = connection._execute_20( May 09 20:12:15.500544 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 09 20:12:15.500544 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 09 20:12:15.500544 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 09 20:12:15.500544 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 09 20:12:15.500544 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 09 20:12:15.500544 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ret = self._execute_context( May 09 20:12:15.500544 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 09 20:12:15.500544 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 09 20:12:15.500544 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 09 20:12:15.500544 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 09 20:12:15.500544 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 09 20:12:15.500544 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception May 09 20:12:15.502039 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 09 20:12:15.502039 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application self.dialect.do_execute( May 09 20:12:15.502039 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 09 20:12:15.502039 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 09 20:12:15.502039 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 09 20:12:15.502039 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application result = self._query(query) May 09 20:12:15.502039 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 09 20:12:15.502039 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application conn.query(q) May 09 20:12:15.502039 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 09 20:12:15.502039 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 09 20:12:15.502039 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 09 20:12:15.502039 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application result.read() May 09 20:12:15.502039 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 09 20:12:15.502039 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 09 20:12:15.502039 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 09 20:12:15.502039 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application packet.raise_for_error() May 09 20:12:15.513107 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 09 20:12:15.513107 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 09 20:12:15.513107 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 09 20:12:15.513107 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 09 20:12:15.513107 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 09 20:12:15.513107 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 09 20:12:15.513107 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [parameters: {'user_id': '0dac8aa6f7a74178952f1575c77a7443', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 09 20:12:15.513107 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 09 20:12:15.513107 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:12:15.513107 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 20:12:15.513107 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:12:15.513107 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:12:15.513107 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:12:15.513107 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:12:15.513107 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:12:15.514766 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:12:15.514766 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:12:15.514766 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:12:15.514766 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:12:15.514766 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:12:15.514766 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:12:15.514766 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:12:15.514766 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 09 20:12:15.514766 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 09 20:12:15.514766 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:12:15.514766 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:12:15.514766 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 20:12:15.514766 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 20:12:15.514766 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 20:12:15.514766 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 20:12:15.514766 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 09 20:12:15.514766 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 09 20:12:15.517215 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 09 20:12:15.517215 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 09 20:12:15.517215 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 09 20:12:15.517215 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 09 20:12:15.517215 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 09 20:12:15.517215 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:12:15.517215 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 488/964] 10.222.0.44 () {60 vars in 1131 bytes} [Mon May 9 20:12:15 2022] POST /identity/v3/users => generated 160 bytes in 209 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 09 20:12:15.517215 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fb6d89-defa-4c4c-a175-b7cfc79486d2 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:15.518100 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aacf5f0-2f64-4c51-9994-892dd2d92761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:15.518100 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aacf5f0-2f64-4c51-9994-892dd2d92761 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:15.518100 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aacf5f0-2f64-4c51-9994-892dd2d92761 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:15.518484 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aacf5f0-2f64-4c51-9994-892dd2d92761 None admin] PATH_INFO: `/v3/services` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:15.527427 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aacf5f0-2f64-4c51-9994-892dd2d92761 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:15.527427 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aacf5f0-2f64-4c51-9994-892dd2d92761 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:15.527427 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aacf5f0-2f64-4c51-9994-892dd2d92761 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:15.531086 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 477/965] 10.222.0.44 () {56 vars in 1122 bytes} [Mon May 9 20:12:15 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:15.532031 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aacf5f0-2f64-4c51-9994-892dd2d92761 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:15.616215 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fb6d89-defa-4c4c-a175-b7cfc79486d2 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:15.646403 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aacf5f0-2f64-4c51-9994-892dd2d92761 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:15.648691 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350c43bf-b4ce-4964-83bd-af4ae44b25a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:15.649481 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c43bf-b4ce-4964-83bd-af4ae44b25a9 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:15.649761 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c43bf-b4ce-4964-83bd-af4ae44b25a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:15.650032 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c43bf-b4ce-4964-83bd-af4ae44b25a9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:15.658022 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350c43bf-b4ce-4964-83bd-af4ae44b25a9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:15.659773 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350c43bf-b4ce-4964-83bd-af4ae44b25a9 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:15.673910 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-350c43bf-b4ce-4964-83bd-af4ae44b25a9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 09 20:12:15.673910 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:12:15.673910 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:12:15.673910 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:12:15.673910 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:12:15.673910 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:12:15.673910 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:12:15.673910 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:12:15.673910 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:12:15.673910 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:12:15.673910 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:12:15.673910 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:12:15.673910 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 20:12:15.673910 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 20:12:15.673910 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 20:12:15.673910 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 20:12:15.674871 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:12:15.674871 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:12:15.674871 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 20:12:15.674871 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 20:12:15.674871 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 20:12:15.674871 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 20:12:15.674871 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:12:15.674871 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:12:15.674871 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:12:15.674871 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:12:15.674871 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:12:15.674871 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:12:15.674871 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:12:15.674871 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:12:15.674871 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:12:15.674871 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:12:15.674871 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:12:15.674871 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:12:15.675869 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:12:15.675869 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:12:15.675869 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 20:12:15.675869 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 20:12:15.675869 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 20:12:15.675869 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 20:12:15.675869 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 20:12:15.675869 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 20:12:15.675869 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 09 20:12:15.675869 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:12:15.675869 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 489/966] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 9 20:12:15 2022] GET /identity/v3/users/cinder => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:12:15.676483 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc4499-4f42-4bd4-a926-b059aaa060a7 None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:15.676882 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc4499-4f42-4bd4-a926-b059aaa060a7 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:15.676882 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc4499-4f42-4bd4-a926-b059aaa060a7 None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:15.681055 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 490/967] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:12:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:12:15.681640 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bc4499-4f42-4bd4-a926-b059aaa060a7 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:15.688906 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ab1660-cd3a-4e08-acad-de3d49333574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:15.689962 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab1660-cd3a-4e08-acad-de3d49333574 None admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:15.690241 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab1660-cd3a-4e08-acad-de3d49333574 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:15.690507 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab1660-cd3a-4e08-acad-de3d49333574 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:15.691252 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ab1660-cd3a-4e08-acad-de3d49333574 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:15.692678 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ab1660-cd3a-4e08-acad-de3d49333574 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:15.711617 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 478/968] 10.222.0.44 () {60 vars in 1144 bytes} [Mon May 9 20:12:15 2022] POST /identity/v3/endpoints => generated 349 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:12:15.713014 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f990b0-274a-460b-b381-8fb27310e106 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:15.713356 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f990b0-274a-460b-b381-8fb27310e106 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:15.713631 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f990b0-274a-460b-b381-8fb27310e106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:15.731917 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-36f990b0-274a-460b-b381-8fb27310e106 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:12:15.733204 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-36f990b0-274a-460b-b381-8fb27310e106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:12:15.820242 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 479/969] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:12:15 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 20:12:15.844616 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f990b0-274a-460b-b381-8fb27310e106 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:15.864641 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bc4499-4f42-4bd4-a926-b059aaa060a7 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:15.910224 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac0bc8f-d135-40ad-ad09-76631d295a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:15.910905 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0bc8f-d135-40ad-ad09-76631d295a60 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:15.911189 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0bc8f-d135-40ad-ad09-76631d295a60 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:15.911496 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0bc8f-d135-40ad-ad09-76631d295a60 None admin] PATH_INFO: `/v3/users` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:15.912417 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac0bc8f-d135-40ad-ad09-76631d295a60 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:15.912919 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac0bc8f-d135-40ad-ad09-76631d295a60 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:15.914399 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac0bc8f-d135-40ad-ad09-76631d295a60 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:15.953684 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 491/970] 10.222.0.44 () {56 vars in 1101 bytes} [Mon May 9 20:12:15 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:15.961773 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f990b0-274a-460b-b381-8fb27310e106 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:16.000440 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6839fe4b-1e76-44d6-a9fa-64768072d222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:16.002079 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6839fe4b-1e76-44d6-a9fa-64768072d222 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:16.002681 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6839fe4b-1e76-44d6-a9fa-64768072d222 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:16.003100 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6839fe4b-1e76-44d6-a9fa-64768072d222 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:16.015524 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6839fe4b-1e76-44d6-a9fa-64768072d222 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:12:16.024860 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-6839fe4b-1e76-44d6-a9fa-64768072d222 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 20:12:16.024860 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:12:16.024860 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:12:16.024860 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:12:16.024860 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:12:16.024860 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:12:16.024860 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:12:16.024860 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:12:16.024860 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:12:16.024860 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:12:16.024860 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:12:16.024860 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:12:16.024860 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:12:16.024860 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:12:16.024860 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:12:16.024860 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:12:16.026234 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:12:16.026234 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:12:16.026234 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:12:16.026234 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:12:16.026234 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:12:16.026234 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:12:16.026234 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:12:16.026234 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:12:16.026234 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:12:16.026234 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:12:16.026234 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:12:16.026234 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:12:16.026234 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:12:16.026234 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:12:16.026234 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:12:16.026234 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:12:16.027301 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:12:16.027301 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:12:16.027301 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:12:16.027301 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:12:16.027301 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:12:16.027301 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:12:16.027301 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:12:16.027301 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:12:16.027301 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:12:16.027301 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:12:16.027301 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 20:12:16.027301 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:12:16.030011 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 480/971] 10.222.0.44 () {56 vars in 1120 bytes} [Mon May 9 20:12:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:12:16.036048 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac0bc8f-d135-40ad-ad09-76631d295a60 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:16.148797 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac0bc8f-d135-40ad-ad09-76631d295a60 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:16.186531 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bdd36f-b238-45d7-81f3-27c24cafe5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:16.187197 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bdd36f-b238-45d7-81f3-27c24cafe5e9 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:16.187502 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bdd36f-b238-45d7-81f3-27c24cafe5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:16.187771 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bdd36f-b238-45d7-81f3-27c24cafe5e9 None admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:16.188596 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bdd36f-b238-45d7-81f3-27c24cafe5e9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:16.188896 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bdd36f-b238-45d7-81f3-27c24cafe5e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:16.190267 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bdd36f-b238-45d7-81f3-27c24cafe5e9 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:16.199935 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 492/972] 10.222.0.44 () {56 vars in 1115 bytes} [Mon May 9 20:12:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:16.206310 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6839fe4b-1e76-44d6-a9fa-64768072d222 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:16.315962 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6839fe4b-1e76-44d6-a9fa-64768072d222 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:16.348776 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b4cea9-ccb0-4705-a576-70df3f230285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:16.349563 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b4cea9-ccb0-4705-a576-70df3f230285 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:16.349842 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b4cea9-ccb0-4705-a576-70df3f230285 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:16.350110 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b4cea9-ccb0-4705-a576-70df3f230285 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:16.362116 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b4cea9-ccb0-4705-a576-70df3f230285 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:16.363604 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b4cea9-ccb0-4705-a576-70df3f230285 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:16.380018 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-c5b4cea9-ccb0-4705-a576-70df3f230285 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:12:16.380018 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:12:16.380018 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:12:16.380018 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:12:16.380018 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:12:16.380018 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:12:16.380018 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:12:16.380018 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:12:16.380018 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:12:16.380018 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:12:16.380018 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:12:16.380018 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:12:16.380018 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 20:12:16.380018 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 20:12:16.380018 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 20:12:16.381340 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 20:12:16.381340 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:12:16.381340 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:12:16.381340 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:12:16.381340 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:12:16.381340 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:12:16.381340 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:12:16.381340 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:12:16.381340 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:12:16.381340 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:12:16.381340 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:12:16.381340 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:12:16.381340 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:12:16.381340 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:12:16.381340 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:12:16.381340 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:12:16.381340 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:12:16.382289 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 20:12:16.382289 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 20:12:16.382289 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:12:16.382289 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:12:16.382289 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 481/973] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:12:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:12:16.388193 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bdd36f-b238-45d7-81f3-27c24cafe5e9 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:16.394857 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1963aab-3103-4739-99f6-68ebcfd435aa None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:16.395141 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1963aab-3103-4739-99f6-68ebcfd435aa None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:16.395436 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1963aab-3103-4739-99f6-68ebcfd435aa None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:16.396902 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 482/974] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:12:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 20:12:16.401591 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f1d8ba-553b-4b14-81c6-50c1d643481a None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:16.401874 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f1d8ba-553b-4b14-81c6-50c1d643481a None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:16.402152 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f1d8ba-553b-4b14-81c6-50c1d643481a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:16.418725 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-e4f1d8ba-553b-4b14-81c6-50c1d643481a None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:12:16.419923 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-e4f1d8ba-553b-4b14-81c6-50c1d643481a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:12:16.487767 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bdd36f-b238-45d7-81f3-27c24cafe5e9 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:16.495671 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 483/975] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:12:16 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 20:12:16.507168 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f1d8ba-553b-4b14-81c6-50c1d643481a None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:16.521273 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5247d12-652b-4d59-aeb2-06aa532c877f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:16.521943 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5247d12-652b-4d59-aeb2-06aa532c877f None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:16.522223 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5247d12-652b-4d59-aeb2-06aa532c877f None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:16.522498 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5247d12-652b-4d59-aeb2-06aa532c877f None admin] PATH_INFO: `/v3/domains` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:16.523221 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5247d12-652b-4d59-aeb2-06aa532c877f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:16.523558 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5247d12-652b-4d59-aeb2-06aa532c877f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:16.524922 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5247d12-652b-4d59-aeb2-06aa532c877f None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:16.537468 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 493/976] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 9 20:12:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:16.542784 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5247d12-652b-4d59-aeb2-06aa532c877f None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:16.612888 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f1d8ba-553b-4b14-81c6-50c1d643481a None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:16.644890 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5247d12-652b-4d59-aeb2-06aa532c877f None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:16.646046 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c043cdfb-9962-4458-afd0-9a6601ab911d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:16.646823 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c043cdfb-9962-4458-afd0-9a6601ab911d None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:16.647097 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c043cdfb-9962-4458-afd0-9a6601ab911d None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:16.647366 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c043cdfb-9962-4458-afd0-9a6601ab911d None admin] PATH_INFO: `/v3/services/compute` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:16.648036 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c043cdfb-9962-4458-afd0-9a6601ab911d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:16.649390 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c043cdfb-9962-4458-afd0-9a6601ab911d None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:16.661305 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-c043cdfb-9962-4458-afd0-9a6601ab911d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 09 20:12:16.661305 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:12:16.661305 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 20:12:16.661305 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 20:12:16.661305 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 20:12:16.661305 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 20:12:16.661305 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 20:12:16.661305 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 20:12:16.661305 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 09 20:12:16.661305 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:12:16.661305 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 20:12:16.661305 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:12:16.661305 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:12:16.661305 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:12:16.661305 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:12:16.661305 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:12:16.661305 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:12:16.662384 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:12:16.662384 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:12:16.662384 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:12:16.662384 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:12:16.662384 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:12:16.662384 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:12:16.662384 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 20:12:16.662384 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 20:12:16.662384 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 20:12:16.662384 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 20:12:16.662384 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:12:16.662384 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:12:16.662384 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:12:16.662384 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:12:16.662384 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:12:16.662384 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:12:16.663263 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:12:16.663263 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:12:16.663263 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:12:16.663263 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:12:16.663263 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:12:16.663263 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:12:16.663263 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:12:16.663263 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:12:16.663263 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:12:16.663263 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:12:16.663263 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 20:12:16.663263 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 20:12:16.663263 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 09 20:12:16.663263 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:12:16.663263 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 484/977] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 9 20:12:16 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 20:12:16.668392 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c043cdfb-9962-4458-afd0-9a6601ab911d None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:16.682755 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a410481d-ee7e-487f-b830-7f521971d941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:16.683600 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a410481d-ee7e-487f-b830-7f521971d941 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:16.683884 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a410481d-ee7e-487f-b830-7f521971d941 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:16.684158 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a410481d-ee7e-487f-b830-7f521971d941 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:16.691284 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a410481d-ee7e-487f-b830-7f521971d941 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:16.692750 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a410481d-ee7e-487f-b830-7f521971d941 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:16.707630 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-a410481d-ee7e-487f-b830-7f521971d941 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 20:12:16.707630 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:12:16.707630 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:12:16.707630 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:12:16.707630 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:12:16.707630 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:12:16.707630 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:12:16.707630 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:12:16.707630 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:12:16.707630 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:12:16.707630 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:12:16.707630 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:12:16.707630 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 20:12:16.707630 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 20:12:16.707630 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 20:12:16.707630 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 20:12:16.708746 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:12:16.708746 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:12:16.708746 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 20:12:16.708746 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 20:12:16.708746 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 20:12:16.708746 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 20:12:16.708746 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:12:16.708746 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:12:16.708746 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:12:16.708746 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:12:16.708746 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:12:16.708746 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:12:16.708746 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:12:16.708746 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:12:16.708746 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:12:16.708746 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:12:16.708746 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:12:16.708746 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:12:16.709720 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:12:16.709720 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:12:16.709720 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 20:12:16.709720 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 20:12:16.709720 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 20:12:16.709720 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 20:12:16.709720 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 20:12:16.709720 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 20:12:16.709720 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 20:12:16.709720 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:12:16.709720 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 494/978] 10.222.0.44 () {56 vars in 1117 bytes} [Mon May 9 20:12:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 20:12:16.714293 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a410481d-ee7e-487f-b830-7f521971d941 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:16.773010 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c043cdfb-9962-4458-afd0-9a6601ab911d None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:16.808817 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742bed2c-4fad-43f2-b3ba-4a19bb9ce3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:16.809739 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742bed2c-4fad-43f2-b3ba-4a19bb9ce3ba None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:16.810026 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742bed2c-4fad-43f2-b3ba-4a19bb9ce3ba None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:16.810218 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a410481d-ee7e-487f-b830-7f521971d941 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:16.810321 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742bed2c-4fad-43f2-b3ba-4a19bb9ce3ba None admin] PATH_INFO: `/v3/services` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:16.811019 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742bed2c-4fad-43f2-b3ba-4a19bb9ce3ba None admin] RBAC: Adding query filter params (name=compute) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:16.811322 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742bed2c-4fad-43f2-b3ba-4a19bb9ce3ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:16.812734 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742bed2c-4fad-43f2-b3ba-4a19bb9ce3ba None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:16.817944 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 485/979] 10.222.0.44 () {56 vars in 1112 bytes} [Mon May 9 20:12:16 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:12:16.823078 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742bed2c-4fad-43f2-b3ba-4a19bb9ce3ba None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:16.849764 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4640030-5b63-4173-abae-e729087dd1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:16.850433 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4640030-5b63-4173-abae-e729087dd1b8 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:16.850724 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4640030-5b63-4173-abae-e729087dd1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:16.850989 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4640030-5b63-4173-abae-e729087dd1b8 None admin] PATH_INFO: `/v3/users` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:16.851856 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4640030-5b63-4173-abae-e729087dd1b8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:16.852168 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4640030-5b63-4173-abae-e729087dd1b8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:16.853597 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4640030-5b63-4173-abae-e729087dd1b8 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:16.870279 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 495/980] 10.222.0.44 () {56 vars in 1149 bytes} [Mon May 9 20:12:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:12:16.875600 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4640030-5b63-4173-abae-e729087dd1b8 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:16.921416 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742bed2c-4fad-43f2-b3ba-4a19bb9ce3ba None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:16.955566 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e903b89f-8e9f-4189-acc1-b3ec9383a394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:16.956228 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e903b89f-8e9f-4189-acc1-b3ec9383a394 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:16.956507 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e903b89f-8e9f-4189-acc1-b3ec9383a394 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:16.956772 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e903b89f-8e9f-4189-acc1-b3ec9383a394 None admin] PATH_INFO: `/v3/services` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:16.957467 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e903b89f-8e9f-4189-acc1-b3ec9383a394 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:16.957768 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e903b89f-8e9f-4189-acc1-b3ec9383a394 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:16.959132 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e903b89f-8e9f-4189-acc1-b3ec9383a394 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:16.964007 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 486/981] 10.222.0.44 () {56 vars in 1112 bytes} [Mon May 9 20:12:16 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:12:16.969525 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e903b89f-8e9f-4189-acc1-b3ec9383a394 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:16.977903 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4640030-5b63-4173-abae-e729087dd1b8 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:17.012530 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71735d75-cf60-4386-adc2-a0c262abf0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:17.013182 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71735d75-cf60-4386-adc2-a0c262abf0aa None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:17.013463 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71735d75-cf60-4386-adc2-a0c262abf0aa None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:17.013735 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71735d75-cf60-4386-adc2-a0c262abf0aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:17.067645 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e903b89f-8e9f-4189-acc1-b3ec9383a394 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:17.080384 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71735d75-cf60-4386-adc2-a0c262abf0aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:17.081832 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71735d75-cf60-4386-adc2-a0c262abf0aa None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:17.100323 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab2b8f-a072-40a0-a32a-cd2c2ce75e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:17.100975 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab2b8f-a072-40a0-a32a-cd2c2ce75e48 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:17.101254 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab2b8f-a072-40a0-a32a-cd2c2ce75e48 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:17.101525 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab2b8f-a072-40a0-a32a-cd2c2ce75e48 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:17.102305 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ab2b8f-a072-40a0-a32a-cd2c2ce75e48 None admin] RBAC: Adding query filter params (interface=public, service_id=a29e1661ec924dea973940890b7ebce4, region_id=RegionOne) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:17.102611 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ab2b8f-a072-40a0-a32a-cd2c2ce75e48 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:17.104008 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ab2b8f-a072-40a0-a32a-cd2c2ce75e48 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:17.113716 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 487/982] 10.222.0.44 () {56 vars in 1251 bytes} [Mon May 9 20:12:16 2022] GET /identity/v3/endpoints?service_id=a29e1661ec924dea973940890b7ebce4&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:12:17.114818 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab2b8f-a072-40a0-a32a-cd2c2ce75e48 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:17.181443 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 496/983] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 9 20:12:16 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 09 20:12:17.183133 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71735d75-cf60-4386-adc2-a0c262abf0aa None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:17.210381 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab2b8f-a072-40a0-a32a-cd2c2ce75e48 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:17.242997 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ca22d-1e01-4882-84e3-9f6f1f0db680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:17.243680 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ca22d-1e01-4882-84e3-9f6f1f0db680 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:17.243957 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ca22d-1e01-4882-84e3-9f6f1f0db680 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:17.244227 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ca22d-1e01-4882-84e3-9f6f1f0db680 None admin] PATH_INFO: `/v3/services` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:17.244899 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5ca22d-1e01-4882-84e3-9f6f1f0db680 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:17.246317 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5ca22d-1e01-4882-84e3-9f6f1f0db680 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:17.263425 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 488/984] 10.222.0.44 () {56 vars in 1087 bytes} [Mon May 9 20:12:17 2022] GET /identity/v3/services => generated 1727 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:12:17.285349 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71735d75-cf60-4386-adc2-a0c262abf0aa None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:17.321759 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf436891-99ea-41fc-a44a-9c4c7dbdead5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:17.322489 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf436891-99ea-41fc-a44a-9c4c7dbdead5 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:17.322766 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf436891-99ea-41fc-a44a-9c4c7dbdead5 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:17.323034 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf436891-99ea-41fc-a44a-9c4c7dbdead5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:17.334792 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf436891-99ea-41fc-a44a-9c4c7dbdead5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:17.336308 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf436891-99ea-41fc-a44a-9c4c7dbdead5 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:17.354692 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-bf436891-99ea-41fc-a44a-9c4c7dbdead5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:12:17.354692 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:12:17.354692 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:12:17.354692 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:12:17.354692 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:12:17.354692 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:12:17.354692 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:12:17.354692 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:12:17.354692 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:12:17.354692 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:12:17.354692 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:12:17.354692 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:12:17.354692 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 20:12:17.354692 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 20:12:17.354692 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 20:12:17.355986 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 20:12:17.355986 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:12:17.355986 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:12:17.355986 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:12:17.355986 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:12:17.355986 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:12:17.355986 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:12:17.355986 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:12:17.355986 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:12:17.355986 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:12:17.355986 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:12:17.355986 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:12:17.355986 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:12:17.355986 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:12:17.355986 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:12:17.355986 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:12:17.355986 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:12:17.361486 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 20:12:17.361486 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 20:12:17.361486 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:12:17.361486 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:12:17.361486 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 497/985] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:12:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 20:12:17.361769 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ca22d-1e01-4882-84e3-9f6f1f0db680 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:17.467786 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ca22d-1e01-4882-84e3-9f6f1f0db680 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:17.500226 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483b72d8-d4ad-4fac-9394-a602f0411bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:17.501464 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b72d8-d4ad-4fac-9394-a602f0411bc8 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:17.501816 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b72d8-d4ad-4fac-9394-a602f0411bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:17.502089 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b72d8-d4ad-4fac-9394-a602f0411bc8 None admin] PATH_INFO: `/v3/domains` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:17.502799 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483b72d8-d4ad-4fac-9394-a602f0411bc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:17.503098 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483b72d8-d4ad-4fac-9394-a602f0411bc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:17.504494 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483b72d8-d4ad-4fac-9394-a602f0411bc8 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:17.516229 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 489/986] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 9 20:12:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:17.522354 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf436891-99ea-41fc-a44a-9c4c7dbdead5 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:17.628952 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf436891-99ea-41fc-a44a-9c4c7dbdead5 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:17.662404 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee3b4a-66ef-4479-b061-4595800d5865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:17.663192 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee3b4a-66ef-4479-b061-4595800d5865 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:17.663569 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee3b4a-66ef-4479-b061-4595800d5865 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:17.663860 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee3b4a-66ef-4479-b061-4595800d5865 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:17.670488 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bee3b4a-66ef-4479-b061-4595800d5865 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:17.671958 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bee3b4a-66ef-4479-b061-4595800d5865 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:17.685594 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-5bee3b4a-66ef-4479-b061-4595800d5865 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 20:12:17.685594 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:12:17.685594 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:12:17.685594 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:12:17.685594 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:12:17.685594 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:12:17.685594 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:12:17.685594 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:12:17.685594 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:12:17.685594 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:12:17.685594 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:12:17.685594 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:12:17.685594 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 20:12:17.685594 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 20:12:17.685594 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 20:12:17.686500 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 20:12:17.686500 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:12:17.686500 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:12:17.686500 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:12:17.686500 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:12:17.686500 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:12:17.686500 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:12:17.686500 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:12:17.686500 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:12:17.686500 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:12:17.686500 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:12:17.686500 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:12:17.686500 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:12:17.686500 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:12:17.686500 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:12:17.686500 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:12:17.686500 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:12:17.687411 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 20:12:17.687411 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 20:12:17.687411 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 20:12:17.687411 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 20:12:17.687411 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 20:12:17.687411 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 20:12:17.687411 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 20:12:17.687411 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:12:17.691676 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 498/987] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 9 20:12:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:12:17.692657 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483b72d8-d4ad-4fac-9394-a602f0411bc8 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:17.789965 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483b72d8-d4ad-4fac-9394-a602f0411bc8 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:17.822101 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c059b8-4d8f-4ca4-93ea-d530ca8ae6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:17.822764 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c059b8-4d8f-4ca4-93ea-d530ca8ae6c8 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:17.823039 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c059b8-4d8f-4ca4-93ea-d530ca8ae6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:17.823306 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c059b8-4d8f-4ca4-93ea-d530ca8ae6c8 None admin] PATH_INFO: `/v3/projects` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:17.824113 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c059b8-4d8f-4ca4-93ea-d530ca8ae6c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:17.824418 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c059b8-4d8f-4ca4-93ea-d530ca8ae6c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:17.825844 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c059b8-4d8f-4ca4-93ea-d530ca8ae6c8 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:17.843456 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 490/988] 10.222.0.44 () {56 vars in 1148 bytes} [Mon May 9 20:12:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:17.845632 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee3b4a-66ef-4479-b061-4595800d5865 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:17.942981 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee3b4a-66ef-4479-b061-4595800d5865 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:17.974792 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bbed79-0215-4aa5-bee8-026ee14d8a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:17.975460 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bbed79-0215-4aa5-bee8-026ee14d8a2f None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:17.975745 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bbed79-0215-4aa5-bee8-026ee14d8a2f None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:17.976016 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bbed79-0215-4aa5-bee8-026ee14d8a2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:17.976838 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bbed79-0215-4aa5-bee8-026ee14d8a2f None admin] RBAC: Adding query filter params (role.id=397402b5f9aa441e966bdc8d463504e7, scope.project.id=563db7f5a25f480e8e6568b92ec3f195, user.id=0227b2954e61426388214e96e1741eb2) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:17.977149 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bbed79-0215-4aa5-bee8-026ee14d8a2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:17.978571 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bbed79-0215-4aa5-bee8-026ee14d8a2f None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:17.991440 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 499/989] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 9 20:12:17 2022] GET /identity/v3/role_assignments?user.id=0227b2954e61426388214e96e1741eb2&scope.project.id=563db7f5a25f480e8e6568b92ec3f195&role.id=397402b5f9aa441e966bdc8d463504e7 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:12:18.030046 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075ee6a-13c2-43b1-bade-109f2fb77963 None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:18.030356 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075ee6a-13c2-43b1-bade-109f2fb77963 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:18.030589 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075ee6a-13c2-43b1-bade-109f2fb77963 None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:18.032820 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 491/990] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:12:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:12:18.038485 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f7b200-452d-46c5-9cd2-200b35404112 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:18.038768 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f7b200-452d-46c5-9cd2-200b35404112 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:18.039044 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f7b200-452d-46c5-9cd2-200b35404112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:18.057784 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-b7f7b200-452d-46c5-9cd2-200b35404112 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:12:18.059326 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-b7f7b200-452d-46c5-9cd2-200b35404112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:12:18.129630 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 500/991] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:12:18 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 20:12:18.152486 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1075ee6a-13c2-43b1-bade-109f2fb77963 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:18.253390 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1075ee6a-13c2-43b1-bade-109f2fb77963 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:18.286495 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aa9cc6-7a45-4b0b-9dc1-6a91557b6a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:18.287628 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa9cc6-7a45-4b0b-9dc1-6a91557b6a3f None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:18.288111 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa9cc6-7a45-4b0b-9dc1-6a91557b6a3f None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:18.288577 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa9cc6-7a45-4b0b-9dc1-6a91557b6a3f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:18.289495 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aa9cc6-7a45-4b0b-9dc1-6a91557b6a3f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:18.291141 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aa9cc6-7a45-4b0b-9dc1-6a91557b6a3f None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:18.303955 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-d9aa9cc6-7a45-4b0b-9dc1-6a91557b6a3f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 20:12:18.303955 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:12:18.303955 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 20:12:18.303955 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 20:12:18.303955 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 20:12:18.303955 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 20:12:18.303955 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 20:12:18.303955 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 20:12:18.303955 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 20:12:18.303955 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:12:18.303955 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 20:12:18.303955 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:12:18.303955 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:12:18.303955 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:12:18.303955 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:12:18.303955 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:12:18.303955 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:12:18.304977 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:12:18.304977 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:12:18.304977 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:12:18.304977 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:12:18.304977 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:12:18.304977 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:12:18.304977 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 20:12:18.304977 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 20:12:18.304977 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 20:12:18.304977 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 20:12:18.304977 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:12:18.304977 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:12:18.304977 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:12:18.304977 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:12:18.304977 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:12:18.304977 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:12:18.305824 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:12:18.305824 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:12:18.305824 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:12:18.305824 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:12:18.305824 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:12:18.305824 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:12:18.305824 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:12:18.305824 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:12:18.305824 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:12:18.305824 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:12:18.305824 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 20:12:18.305824 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 20:12:18.305824 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 20:12:18.305824 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:12:18.308712 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 492/992] 10.222.0.44 () {56 vars in 1126 bytes} [Mon May 9 20:12:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:12:18.314722 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f7b200-452d-46c5-9cd2-200b35404112 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:18.410699 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f7b200-452d-46c5-9cd2-200b35404112 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:18.444615 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c671bfd-9a02-4d14-ab04-ea2f2dd56add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:18.445276 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c671bfd-9a02-4d14-ab04-ea2f2dd56add None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:18.445554 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c671bfd-9a02-4d14-ab04-ea2f2dd56add None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:18.445820 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c671bfd-9a02-4d14-ab04-ea2f2dd56add None admin] PATH_INFO: `/v3/services` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:18.446518 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c671bfd-9a02-4d14-ab04-ea2f2dd56add None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:18.446821 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c671bfd-9a02-4d14-ab04-ea2f2dd56add None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:18.448198 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c671bfd-9a02-4d14-ab04-ea2f2dd56add None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:18.457842 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 501/993] 10.222.0.44 () {56 vars in 1122 bytes} [Mon May 9 20:12:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:12:18.459269 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aa9cc6-7a45-4b0b-9dc1-6a91557b6a3f None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:18.557204 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aa9cc6-7a45-4b0b-9dc1-6a91557b6a3f None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:18.595165 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa992f73-85cc-4ee4-83f5-a93ad08d5659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:18.595858 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa992f73-85cc-4ee4-83f5-a93ad08d5659 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:18.596128 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa992f73-85cc-4ee4-83f5-a93ad08d5659 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:18.596388 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa992f73-85cc-4ee4-83f5-a93ad08d5659 None admin] PATH_INFO: `/v3/services` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:18.597079 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa992f73-85cc-4ee4-83f5-a93ad08d5659 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:18.597376 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa992f73-85cc-4ee4-83f5-a93ad08d5659 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:18.598731 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa992f73-85cc-4ee4-83f5-a93ad08d5659 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:18.608328 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 493/994] 10.222.0.44 () {56 vars in 1122 bytes} [Mon May 9 20:12:18 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:12:18.609290 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c671bfd-9a02-4d14-ab04-ea2f2dd56add None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:18.702645 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c671bfd-9a02-4d14-ab04-ea2f2dd56add None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:18.734512 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2e32f3-7b58-497c-9b75-292683b4bc09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:18.735272 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e32f3-7b58-497c-9b75-292683b4bc09 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:18.735622 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e32f3-7b58-497c-9b75-292683b4bc09 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:18.735936 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e32f3-7b58-497c-9b75-292683b4bc09 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:18.736777 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2e32f3-7b58-497c-9b75-292683b4bc09 None admin] RBAC: Adding query filter params (interface=admin, service_id=834fd04205804295990fc18398b6daf2, region_id=RegionOne) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:18.737139 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2e32f3-7b58-497c-9b75-292683b4bc09 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:18.738487 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2e32f3-7b58-497c-9b75-292683b4bc09 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:18.747619 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 502/995] 10.222.0.44 () {56 vars in 1249 bytes} [Mon May 9 20:12:18 2022] GET /identity/v3/endpoints?service_id=834fd04205804295990fc18398b6daf2&interface=admin®ion_id=RegionOne => generated 193 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:12:18.748713 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa992f73-85cc-4ee4-83f5-a93ad08d5659 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:18.847865 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa992f73-85cc-4ee4-83f5-a93ad08d5659 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:18.882322 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5372813-8572-4c3c-8c4b-6bed2ae05df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:18.882977 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5372813-8572-4c3c-8c4b-6bed2ae05df8 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:18.883257 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5372813-8572-4c3c-8c4b-6bed2ae05df8 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:18.883557 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5372813-8572-4c3c-8c4b-6bed2ae05df8 None admin] PATH_INFO: `/v3/services` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:18.884233 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5372813-8572-4c3c-8c4b-6bed2ae05df8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:18.885599 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5372813-8572-4c3c-8c4b-6bed2ae05df8 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:18.899479 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 494/996] 10.222.0.44 () {56 vars in 1087 bytes} [Mon May 9 20:12:18 2022] GET /identity/v3/services => generated 1727 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 09 20:12:19.560969 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d7e7c1-7c4e-4af1-b479-7f08cc1a001f None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:19.561491 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d7e7c1-7c4e-4af1-b479-7f08cc1a001f None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:19.561491 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d7e7c1-7c4e-4af1-b479-7f08cc1a001f None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:19.563023 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 503/997] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:12:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:12:19.570840 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc187cd8-4f36-4276-ad2d-564900e03afe None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:19.571297 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc187cd8-4f36-4276-ad2d-564900e03afe None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:19.571432 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc187cd8-4f36-4276-ad2d-564900e03afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:19.589129 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-bc187cd8-4f36-4276-ad2d-564900e03afe None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:12:19.590292 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-bc187cd8-4f36-4276-ad2d-564900e03afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:12:19.654168 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 495/998] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:12:19 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 20:12:19.676246 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d7e7c1-7c4e-4af1-b479-7f08cc1a001f None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:19.773105 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d7e7c1-7c4e-4af1-b479-7f08cc1a001f None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:19.805091 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035a3081-9766-404f-9d81-4635688ab7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:19.805886 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a3081-9766-404f-9d81-4635688ab7ae None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:19.806239 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a3081-9766-404f-9d81-4635688ab7ae None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:19.806480 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a3081-9766-404f-9d81-4635688ab7ae None admin] PATH_INFO: `/v3/services/compute` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:19.807058 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035a3081-9766-404f-9d81-4635688ab7ae None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:19.808576 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035a3081-9766-404f-9d81-4635688ab7ae None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:19.821009 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-035a3081-9766-404f-9d81-4635688ab7ae None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 09 20:12:19.821009 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:12:19.821009 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 20:12:19.821009 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 20:12:19.821009 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 20:12:19.821009 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 20:12:19.821009 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 20:12:19.821009 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 20:12:19.821009 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 09 20:12:19.821009 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:12:19.821009 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 20:12:19.821009 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:12:19.821009 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:12:19.821009 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:12:19.821009 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:12:19.821009 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:12:19.821009 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:12:19.822012 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:12:19.822012 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:12:19.822012 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:12:19.822012 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:12:19.822012 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:12:19.822012 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:12:19.822012 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 20:12:19.822012 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 20:12:19.822012 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 20:12:19.822012 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 20:12:19.822012 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:12:19.822012 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:12:19.822012 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:12:19.822012 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:12:19.822012 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:12:19.822012 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:12:19.822942 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:12:19.822942 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:12:19.822942 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:12:19.822942 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:12:19.822942 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:12:19.822942 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:12:19.822942 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:12:19.822942 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:12:19.822942 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:12:19.822942 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:12:19.822942 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 20:12:19.822942 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 20:12:19.822942 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 09 20:12:19.822942 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:12:19.830195 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 504/999] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 9 20:12:19 2022] GET /identity/v3/services/compute => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:12:19.830359 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc187cd8-4f36-4276-ad2d-564900e03afe None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:19.920390 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc187cd8-4f36-4276-ad2d-564900e03afe None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:19.953227 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb0acaa-b2eb-43e3-a913-023accac4042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:19.954275 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb0acaa-b2eb-43e3-a913-023accac4042 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:19.954796 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb0acaa-b2eb-43e3-a913-023accac4042 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:19.955286 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb0acaa-b2eb-43e3-a913-023accac4042 None admin] PATH_INFO: `/v3/services` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:19.956214 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb0acaa-b2eb-43e3-a913-023accac4042 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:19.956693 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb0acaa-b2eb-43e3-a913-023accac4042 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:19.958229 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb0acaa-b2eb-43e3-a913-023accac4042 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:19.963492 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 496/1000] 10.222.0.44 () {56 vars in 1112 bytes} [Mon May 9 20:12:19 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:19.968945 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035a3081-9766-404f-9d81-4635688ab7ae None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:20.068460 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035a3081-9766-404f-9d81-4635688ab7ae None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:20.103985 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26222694-d600-4e2e-a2b7-d5c427555953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:20.104640 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26222694-d600-4e2e-a2b7-d5c427555953 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:20.105113 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26222694-d600-4e2e-a2b7-d5c427555953 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:20.105583 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26222694-d600-4e2e-a2b7-d5c427555953 None admin] PATH_INFO: `/v3/services` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:20.106895 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26222694-d600-4e2e-a2b7-d5c427555953 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:20.107453 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26222694-d600-4e2e-a2b7-d5c427555953 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:20.110001 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26222694-d600-4e2e-a2b7-d5c427555953 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:20.123873 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 505/1001] 10.222.0.44 () {56 vars in 1112 bytes} [Mon May 9 20:12:19 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:20.124084 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb0acaa-b2eb-43e3-a913-023accac4042 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:20.220247 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb0acaa-b2eb-43e3-a913-023accac4042 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:20.253316 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c721011b-e690-4565-995b-ec23ba951a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:20.254195 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c721011b-e690-4565-995b-ec23ba951a0a None admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:20.254622 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c721011b-e690-4565-995b-ec23ba951a0a None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:20.255066 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c721011b-e690-4565-995b-ec23ba951a0a None admin] PATH_INFO: `/v3/endpoints` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:20.256284 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c721011b-e690-4565-995b-ec23ba951a0a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:20.257787 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c721011b-e690-4565-995b-ec23ba951a0a None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:20.259847 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa221b6-e51b-42c7-a819-67f129fcaebe None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:20.260153 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa221b6-e51b-42c7-a819-67f129fcaebe None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:20.260405 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa221b6-e51b-42c7-a819-67f129fcaebe None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:20.261764 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 506/1002] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:12:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 20:12:20.266958 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2520f5-8dbf-4047-854c-f70b925eba84 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:20.266958 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2520f5-8dbf-4047-854c-f70b925eba84 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:20.267168 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2520f5-8dbf-4047-854c-f70b925eba84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:20.280047 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 497/1003] 10.222.0.44 () {60 vars in 1144 bytes} [Mon May 9 20:12:20 2022] POST /identity/v3/endpoints => generated 334 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:12:20.287820 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-7c2520f5-8dbf-4047-854c-f70b925eba84 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:12:20.289039 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-7c2520f5-8dbf-4047-854c-f70b925eba84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:12:20.368103 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 507/1004] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:12:20 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 20:12:20.390740 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c721011b-e690-4565-995b-ec23ba951a0a None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:20.498020 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c721011b-e690-4565-995b-ec23ba951a0a None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:20.534700 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310a990-1568-49aa-b95d-ec8c4f1ca80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:20.535526 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310a990-1568-49aa-b95d-ec8c4f1ca80b None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:20.535813 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310a990-1568-49aa-b95d-ec8c4f1ca80b None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:20.536077 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310a990-1568-49aa-b95d-ec8c4f1ca80b None admin] PATH_INFO: `/v3/services/image` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:20.536731 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3310a990-1568-49aa-b95d-ec8c4f1ca80b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:20.538100 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3310a990-1568-49aa-b95d-ec8c4f1ca80b None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:20.550959 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-3310a990-1568-49aa-b95d-ec8c4f1ca80b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 09 20:12:20.550959 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:12:20.550959 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 20:12:20.550959 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 20:12:20.550959 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 20:12:20.550959 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 20:12:20.550959 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 20:12:20.550959 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 20:12:20.550959 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 09 20:12:20.550959 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:12:20.550959 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 20:12:20.550959 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:12:20.550959 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:12:20.550959 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:12:20.550959 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:12:20.550959 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:12:20.550959 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:12:20.552019 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:12:20.552019 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:12:20.552019 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:12:20.552019 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:12:20.552019 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:12:20.552019 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:12:20.552019 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 20:12:20.552019 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 20:12:20.552019 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 20:12:20.552019 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 20:12:20.552019 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:12:20.552019 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:12:20.552019 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:12:20.552019 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:12:20.552019 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:12:20.552019 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:12:20.552885 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:12:20.552885 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:12:20.552885 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:12:20.552885 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:12:20.552885 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:12:20.552885 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:12:20.552885 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:12:20.552885 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:12:20.552885 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:12:20.552885 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:12:20.552885 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 20:12:20.552885 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 20:12:20.552885 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 09 20:12:20.552885 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:12:20.552885 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 498/1005] 10.222.0.44 () {56 vars in 1105 bytes} [Mon May 9 20:12:20 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 20:12:20.558274 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2520f5-8dbf-4047-854c-f70b925eba84 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:20.656332 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2520f5-8dbf-4047-854c-f70b925eba84 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:20.689186 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb27dd3b-5424-4d1a-b283-f409cf8060ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:20.689893 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27dd3b-5424-4d1a-b283-f409cf8060ea None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:20.690177 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27dd3b-5424-4d1a-b283-f409cf8060ea None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:20.690448 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27dd3b-5424-4d1a-b283-f409cf8060ea None admin] PATH_INFO: `/v3/services` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:20.691150 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb27dd3b-5424-4d1a-b283-f409cf8060ea None admin] RBAC: Adding query filter params (name=image) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:20.691480 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb27dd3b-5424-4d1a-b283-f409cf8060ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:20.692916 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb27dd3b-5424-4d1a-b283-f409cf8060ea None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:20.702001 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 508/1006] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:12:20 2022] GET /identity/v3/services?name=image => generated 122 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:20.703200 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310a990-1568-49aa-b95d-ec8c4f1ca80b None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:20.801109 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310a990-1568-49aa-b95d-ec8c4f1ca80b None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:20.833447 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef0cd0e-5acd-4605-95ce-7091b9a53f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:20.834107 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0cd0e-5acd-4605-95ce-7091b9a53f58 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:20.834383 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0cd0e-5acd-4605-95ce-7091b9a53f58 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:20.834649 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0cd0e-5acd-4605-95ce-7091b9a53f58 None admin] PATH_INFO: `/v3/services` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:20.835349 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef0cd0e-5acd-4605-95ce-7091b9a53f58 None admin] RBAC: Adding query filter params (type=image) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:20.835689 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef0cd0e-5acd-4605-95ce-7091b9a53f58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:20.837056 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef0cd0e-5acd-4605-95ce-7091b9a53f58 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:20.847428 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 499/1007] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:12:20 2022] GET /identity/v3/services?type=image => generated 122 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:21.136818 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ed6b8-6257-4995-b14c-93bc4800c322 None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:21.137216 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ed6b8-6257-4995-b14c-93bc4800c322 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:21.137409 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ed6b8-6257-4995-b14c-93bc4800c322 None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:21.138861 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 509/1008] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:12:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:12:21.144822 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba73904-e1d5-4406-a873-0e7085d7e34d None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:21.145109 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba73904-e1d5-4406-a873-0e7085d7e34d None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:21.145380 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba73904-e1d5-4406-a873-0e7085d7e34d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:21.161838 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-1ba73904-e1d5-4406-a873-0e7085d7e34d None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:12:21.163009 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-1ba73904-e1d5-4406-a873-0e7085d7e34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:12:21.227020 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 500/1009] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:12:21 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 20:12:21.249358 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9ed6b8-6257-4995-b14c-93bc4800c322 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:21.359308 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9ed6b8-6257-4995-b14c-93bc4800c322 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:21.395832 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc1f2c1-de41-4bcf-b10e-366c1ac53c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:21.397050 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc1f2c1-de41-4bcf-b10e-366c1ac53c81 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:21.397522 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc1f2c1-de41-4bcf-b10e-366c1ac53c81 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:21.397875 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc1f2c1-de41-4bcf-b10e-366c1ac53c81 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:21.398538 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc1f2c1-de41-4bcf-b10e-366c1ac53c81 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:21.400981 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc1f2c1-de41-4bcf-b10e-366c1ac53c81 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:21.416833 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-7cc1f2c1-de41-4bcf-b10e-366c1ac53c81 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 20:12:21.416833 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:12:21.416833 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 20:12:21.416833 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 20:12:21.416833 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 20:12:21.416833 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 20:12:21.416833 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 20:12:21.416833 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 20:12:21.416833 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 20:12:21.416833 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:12:21.416833 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 20:12:21.416833 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:12:21.416833 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:12:21.416833 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:12:21.416833 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:12:21.416833 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:12:21.416833 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:12:21.418013 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:12:21.418013 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:12:21.418013 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:12:21.418013 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:12:21.418013 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:12:21.418013 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:12:21.418013 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 20:12:21.418013 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 20:12:21.418013 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 20:12:21.418013 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 20:12:21.418013 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:12:21.418013 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:12:21.418013 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:12:21.418013 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:12:21.418013 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:12:21.418013 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:12:21.419347 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:12:21.419347 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:12:21.419347 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:12:21.419347 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:12:21.419347 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:12:21.419347 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:12:21.419347 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:12:21.419347 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:12:21.419347 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:12:21.419347 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:12:21.419347 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 20:12:21.419347 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 20:12:21.419347 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 20:12:21.419347 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:12:21.419347 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 510/1010] 10.222.0.44 () {56 vars in 1126 bytes} [Mon May 9 20:12:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:12:21.425350 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba73904-e1d5-4406-a873-0e7085d7e34d None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:21.523609 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba73904-e1d5-4406-a873-0e7085d7e34d None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:21.559605 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54033f37-8c4e-4e08-9a13-45bca80622f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:21.560327 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54033f37-8c4e-4e08-9a13-45bca80622f5 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:21.560605 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54033f37-8c4e-4e08-9a13-45bca80622f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:21.560926 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54033f37-8c4e-4e08-9a13-45bca80622f5 None admin] PATH_INFO: `/v3/services` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:21.561751 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54033f37-8c4e-4e08-9a13-45bca80622f5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:21.562060 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54033f37-8c4e-4e08-9a13-45bca80622f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:21.567785 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54033f37-8c4e-4e08-9a13-45bca80622f5 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:21.579442 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 501/1011] 10.222.0.44 () {56 vars in 1122 bytes} [Mon May 9 20:12:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:21.581019 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc1f2c1-de41-4bcf-b10e-366c1ac53c81 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:21.682484 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc1f2c1-de41-4bcf-b10e-366c1ac53c81 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:21.716645 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd1027c-a0a3-4b41-8ec3-feb65ef50203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:21.717367 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1027c-a0a3-4b41-8ec3-feb65ef50203 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:21.717644 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1027c-a0a3-4b41-8ec3-feb65ef50203 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:21.717912 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1027c-a0a3-4b41-8ec3-feb65ef50203 None admin] PATH_INFO: `/v3/services` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:21.718673 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd1027c-a0a3-4b41-8ec3-feb65ef50203 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:21.718979 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd1027c-a0a3-4b41-8ec3-feb65ef50203 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:21.721305 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd1027c-a0a3-4b41-8ec3-feb65ef50203 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:21.732856 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 511/1012] 10.222.0.44 () {56 vars in 1122 bytes} [Mon May 9 20:12:21 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:21.733039 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54033f37-8c4e-4e08-9a13-45bca80622f5 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:21.833711 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54033f37-8c4e-4e08-9a13-45bca80622f5 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:21.871368 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73772fca-c326-401f-891c-5836398c623b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:21.872457 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73772fca-c326-401f-891c-5836398c623b None admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:21.872944 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73772fca-c326-401f-891c-5836398c623b None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:21.873401 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73772fca-c326-401f-891c-5836398c623b None admin] PATH_INFO: `/v3/endpoints` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:21.874648 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73772fca-c326-401f-891c-5836398c623b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:21.877400 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73772fca-c326-401f-891c-5836398c623b None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:21.893474 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 502/1013] 10.222.0.44 () {60 vars in 1144 bytes} [Mon May 9 20:12:21 2022] POST /identity/v3/endpoints => generated 325 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:12:22.681140 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814babed-e070-4825-b31d-a82138dbb9ac None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:22.681466 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814babed-e070-4825-b31d-a82138dbb9ac None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:22.681715 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814babed-e070-4825-b31d-a82138dbb9ac None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:22.683103 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 512/1014] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:12:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:12:22.688286 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8fa7c5-6e55-4af4-917d-a62bf6c5e5b5 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:22.688580 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8fa7c5-6e55-4af4-917d-a62bf6c5e5b5 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:22.688850 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8fa7c5-6e55-4af4-917d-a62bf6c5e5b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:22.706518 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-8f8fa7c5-6e55-4af4-917d-a62bf6c5e5b5 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:12:22.707731 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-8f8fa7c5-6e55-4af4-917d-a62bf6c5e5b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:12:22.778833 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 503/1015] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:12:22 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 20:12:22.802944 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814babed-e070-4825-b31d-a82138dbb9ac None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:22.901554 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814babed-e070-4825-b31d-a82138dbb9ac None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:22.933188 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab705611-34f8-4c27-a98f-823511cc5a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:22.933985 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab705611-34f8-4c27-a98f-823511cc5a2f None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:22.934264 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab705611-34f8-4c27-a98f-823511cc5a2f None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:22.934538 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab705611-34f8-4c27-a98f-823511cc5a2f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:22.944669 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab705611-34f8-4c27-a98f-823511cc5a2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:12:22.952655 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-ab705611-34f8-4c27-a98f-823511cc5a2f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 20:12:22.952655 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:12:22.952655 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:12:22.952655 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:12:22.952655 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:12:22.952655 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:12:22.952655 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:12:22.952655 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:12:22.952655 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:12:22.952655 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:12:22.952655 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:12:22.952655 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:12:22.952655 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:12:22.952655 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:12:22.952655 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:12:22.952655 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:12:22.953611 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:12:22.953611 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:12:22.953611 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:12:22.953611 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:12:22.953611 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:12:22.953611 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:12:22.953611 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:12:22.953611 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:12:22.953611 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:12:22.953611 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:12:22.953611 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:12:22.953611 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:12:22.953611 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:12:22.953611 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:12:22.953611 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:12:22.953611 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:12:22.955212 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:12:22.955212 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:12:22.955212 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:12:22.955212 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:12:22.955212 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:12:22.955212 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:12:22.955212 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:12:22.955212 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:12:22.955212 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:12:22.955212 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:12:22.955212 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 20:12:22.955212 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:12:22.955212 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 513/1016] 10.222.0.44 () {56 vars in 1120 bytes} [Mon May 9 20:12:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 20:12:22.962063 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8fa7c5-6e55-4af4-917d-a62bf6c5e5b5 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:23.063289 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8fa7c5-6e55-4af4-917d-a62bf6c5e5b5 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:23.096711 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd837f57-17c3-44c9-8d4c-f3f519787cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:23.097617 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd837f57-17c3-44c9-8d4c-f3f519787cd0 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:23.097744 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd837f57-17c3-44c9-8d4c-f3f519787cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:23.097991 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd837f57-17c3-44c9-8d4c-f3f519787cd0 None admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:23.098661 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd837f57-17c3-44c9-8d4c-f3f519787cd0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:23.099010 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd837f57-17c3-44c9-8d4c-f3f519787cd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:23.100382 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd837f57-17c3-44c9-8d4c-f3f519787cd0 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:23.111595 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 504/1017] 10.222.0.44 () {56 vars in 1115 bytes} [Mon May 9 20:12:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:23.114642 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab705611-34f8-4c27-a98f-823511cc5a2f None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:23.167381 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c4a80-7559-4f7e-8020-525c9a258c02 None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:23.167707 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c4a80-7559-4f7e-8020-525c9a258c02 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:23.167871 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c4a80-7559-4f7e-8020-525c9a258c02 None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:23.169367 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 505/1018] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:12:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:12:23.174499 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a89ec-0210-468d-9eef-cfeafedd0549 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:23.174780 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a89ec-0210-468d-9eef-cfeafedd0549 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:23.175052 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a89ec-0210-468d-9eef-cfeafedd0549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:23.191685 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-b59a89ec-0210-468d-9eef-cfeafedd0549 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:12:23.192880 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-b59a89ec-0210-468d-9eef-cfeafedd0549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:12:23.215915 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab705611-34f8-4c27-a98f-823511cc5a2f None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:23.248081 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2372644-e479-4ff3-84ad-d3dd51259c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:23.248860 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2372644-e479-4ff3-84ad-d3dd51259c6a None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:23.249138 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2372644-e479-4ff3-84ad-d3dd51259c6a None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:23.249402 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2372644-e479-4ff3-84ad-d3dd51259c6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:23.258621 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 506/1019] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:12:23 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 20:12:23.259830 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2372644-e479-4ff3-84ad-d3dd51259c6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:23.261262 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2372644-e479-4ff3-84ad-d3dd51259c6a None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:23.277951 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-a2372644-e479-4ff3-84ad-d3dd51259c6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:12:23.277951 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:12:23.277951 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:12:23.277951 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:12:23.277951 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:12:23.277951 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:12:23.277951 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:12:23.277951 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:12:23.277951 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:12:23.277951 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:12:23.277951 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:12:23.277951 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:12:23.277951 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 20:12:23.277951 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 20:12:23.277951 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 20:12:23.278836 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 20:12:23.278836 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:12:23.278836 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:12:23.278836 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:12:23.278836 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:12:23.278836 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:12:23.278836 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:12:23.278836 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:12:23.278836 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:12:23.278836 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:12:23.278836 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:12:23.278836 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:12:23.278836 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:12:23.278836 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:12:23.278836 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:12:23.278836 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:12:23.278836 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:12:23.279919 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 20:12:23.279919 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 20:12:23.279919 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:12:23.279919 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:12:23.279919 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 514/1020] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:12:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:12:23.283592 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59a89ec-0210-468d-9eef-cfeafedd0549 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:23.285979 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2372644-e479-4ff3-84ad-d3dd51259c6a None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:23.384671 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59a89ec-0210-468d-9eef-cfeafedd0549 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:23.390442 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2372644-e479-4ff3-84ad-d3dd51259c6a None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:23.417097 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7dfcc6-52ef-4709-9f9f-45174a035def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:23.417801 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7dfcc6-52ef-4709-9f9f-45174a035def None admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:23.418017 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7dfcc6-52ef-4709-9f9f-45174a035def None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:23.418283 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7dfcc6-52ef-4709-9f9f-45174a035def None admin] PATH_INFO: `/v3/services` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:23.418994 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7dfcc6-52ef-4709-9f9f-45174a035def None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:23.420385 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7dfcc6-52ef-4709-9f9f-45174a035def None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:23.422234 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e81130-23c6-44ab-9553-8b5e74d64ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:23.423050 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e81130-23c6-44ab-9553-8b5e74d64ef8 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:23.423369 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e81130-23c6-44ab-9553-8b5e74d64ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:23.423681 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e81130-23c6-44ab-9553-8b5e74d64ef8 None admin] PATH_INFO: `/v3/domains` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:23.424408 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e81130-23c6-44ab-9553-8b5e74d64ef8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:23.425061 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e81130-23c6-44ab-9553-8b5e74d64ef8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:23.426479 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e81130-23c6-44ab-9553-8b5e74d64ef8 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:23.440613 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 515/1021] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 9 20:12:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:12:23.440964 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 507/1022] 10.222.0.44 () {60 vars in 1141 bytes} [Mon May 9 20:12:23 2022] POST /identity/v3/services => generated 242 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 20:12:23.445485 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e81130-23c6-44ab-9553-8b5e74d64ef8 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:23.550195 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e81130-23c6-44ab-9553-8b5e74d64ef8 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:23.595178 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec9b784-e663-4abd-8912-2f2cdacc2551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:23.596257 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec9b784-e663-4abd-8912-2f2cdacc2551 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:23.596711 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec9b784-e663-4abd-8912-2f2cdacc2551 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:23.597131 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec9b784-e663-4abd-8912-2f2cdacc2551 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:23.605147 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec9b784-e663-4abd-8912-2f2cdacc2551 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:23.606880 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec9b784-e663-4abd-8912-2f2cdacc2551 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:23.622746 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-cec9b784-e663-4abd-8912-2f2cdacc2551 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 09 20:12:23.622746 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:12:23.622746 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:12:23.622746 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:12:23.622746 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:12:23.622746 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:12:23.622746 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:12:23.622746 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:12:23.622746 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:12:23.622746 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:12:23.622746 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:12:23.622746 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:12:23.622746 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 20:12:23.622746 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 20:12:23.622746 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 20:12:23.622746 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 20:12:23.623792 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:12:23.623792 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:12:23.623792 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 20:12:23.623792 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 20:12:23.623792 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 20:12:23.623792 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 20:12:23.623792 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:12:23.623792 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:12:23.623792 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:12:23.623792 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:12:23.623792 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:12:23.623792 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:12:23.623792 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:12:23.623792 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:12:23.623792 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:12:23.623792 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:12:23.623792 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:12:23.623792 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:12:23.624944 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:12:23.624944 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:12:23.624944 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 20:12:23.624944 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 20:12:23.624944 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 20:12:23.624944 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 20:12:23.624944 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 20:12:23.624944 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 20:12:23.624944 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 09 20:12:23.624944 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:12:23.624944 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 516/1023] 10.222.0.44 () {56 vars in 1093 bytes} [Mon May 9 20:12:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 20:12:23.630030 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7dfcc6-52ef-4709-9f9f-45174a035def None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:23.727872 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7dfcc6-52ef-4709-9f9f-45174a035def None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:23.760596 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1df259-7bef-46be-a447-6ad911346478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:23.761259 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1df259-7bef-46be-a447-6ad911346478 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:23.761536 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1df259-7bef-46be-a447-6ad911346478 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:23.761804 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1df259-7bef-46be-a447-6ad911346478 None admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:23.762636 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1df259-7bef-46be-a447-6ad911346478 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:23.762938 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1df259-7bef-46be-a447-6ad911346478 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:23.764416 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1df259-7bef-46be-a447-6ad911346478 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:23.781644 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 508/1024] 10.222.0.44 () {56 vars in 1133 bytes} [Mon May 9 20:12:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:23.788065 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec9b784-e663-4abd-8912-2f2cdacc2551 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:23.885559 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec9b784-e663-4abd-8912-2f2cdacc2551 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:23.917040 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd94c81-de0d-4ab5-a17f-da546ceb6798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:23.917681 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd94c81-de0d-4ab5-a17f-da546ceb6798 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:23.917960 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd94c81-de0d-4ab5-a17f-da546ceb6798 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:23.918231 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd94c81-de0d-4ab5-a17f-da546ceb6798 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:23.987119 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd94c81-de0d-4ab5-a17f-da546ceb6798 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:23.988546 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd94c81-de0d-4ab5-a17f-da546ceb6798 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:24.083244 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 517/1025] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 9 20:12:23 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 09 20:12:24.088887 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1df259-7bef-46be-a447-6ad911346478 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:24.154417 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7f0fe-39e7-43ef-afa0-2c7eb8df55cd None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:24.154707 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7f0fe-39e7-43ef-afa0-2c7eb8df55cd None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:24.154977 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7f0fe-39e7-43ef-afa0-2c7eb8df55cd None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:24.156369 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 518/1026] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:12:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 20:12:24.161968 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb5ac23-8594-4b15-9a74-a4bd41342269 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:24.162250 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb5ac23-8594-4b15-9a74-a4bd41342269 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:24.162532 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb5ac23-8594-4b15-9a74-a4bd41342269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:24.179458 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-fdb5ac23-8594-4b15-9a74-a4bd41342269 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:12:24.180658 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-fdb5ac23-8594-4b15-9a74-a4bd41342269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:12:24.194520 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1df259-7bef-46be-a447-6ad911346478 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:24.227796 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9880e826-8c37-45bf-bbd0-b188c9975762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:24.228570 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9880e826-8c37-45bf-bbd0-b188c9975762 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:24.228846 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9880e826-8c37-45bf-bbd0-b188c9975762 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:24.229109 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9880e826-8c37-45bf-bbd0-b188c9975762 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:24.239565 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9880e826-8c37-45bf-bbd0-b188c9975762 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:24.240953 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9880e826-8c37-45bf-bbd0-b188c9975762 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:24.246438 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 519/1027] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:12:24 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 20:12:24.258246 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-9880e826-8c37-45bf-bbd0-b188c9975762 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:12:24.258246 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:12:24.258246 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:12:24.258246 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:12:24.258246 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:12:24.258246 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:12:24.258246 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:12:24.258246 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:12:24.258246 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:12:24.258246 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:12:24.258246 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:12:24.258246 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:12:24.258246 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 20:12:24.258246 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 20:12:24.258246 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 20:12:24.259176 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 20:12:24.259176 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:12:24.259176 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:12:24.259176 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:12:24.259176 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:12:24.259176 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:12:24.259176 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:12:24.259176 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:12:24.259176 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:12:24.259176 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:12:24.259176 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:12:24.259176 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:12:24.259176 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:12:24.259176 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:12:24.259176 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:12:24.259176 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:12:24.259176 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:12:24.260410 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 20:12:24.260410 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 20:12:24.260410 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:12:24.260410 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:12:24.263682 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 509/1028] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:12:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 20:12:24.264981 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb5ac23-8594-4b15-9a74-a4bd41342269 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:24.270402 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9880e826-8c37-45bf-bbd0-b188c9975762 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:24.361570 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb5ac23-8594-4b15-9a74-a4bd41342269 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:24.370608 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9880e826-8c37-45bf-bbd0-b188c9975762 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:24.395960 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b640d47-7af3-4ae8-b245-5c849ced73c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:24.396606 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b640d47-7af3-4ae8-b245-5c849ced73c8 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:24.396881 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b640d47-7af3-4ae8-b245-5c849ced73c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:24.397145 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b640d47-7af3-4ae8-b245-5c849ced73c8 None admin] PATH_INFO: `/v3/domains` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:24.397856 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b640d47-7af3-4ae8-b245-5c849ced73c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:24.398155 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b640d47-7af3-4ae8-b245-5c849ced73c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:24.399538 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b640d47-7af3-4ae8-b245-5c849ced73c8 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:24.404241 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5eb2e4-2d80-4252-b6e5-350a382c6a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:24.405018 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5eb2e4-2d80-4252-b6e5-350a382c6a96 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:24.405296 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5eb2e4-2d80-4252-b6e5-350a382c6a96 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:24.405567 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5eb2e4-2d80-4252-b6e5-350a382c6a96 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:24.406731 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5eb2e4-2d80-4252-b6e5-350a382c6a96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:24.408758 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5eb2e4-2d80-4252-b6e5-350a382c6a96 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:24.410527 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 510/1029] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:12:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:12:24.415457 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 520/1030] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 9 20:12:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:24.415990 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5eb2e4-2d80-4252-b6e5-350a382c6a96 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:24.416237 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b640d47-7af3-4ae8-b245-5c849ced73c8 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:24.516841 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5eb2e4-2d80-4252-b6e5-350a382c6a96 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:24.525097 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b640d47-7af3-4ae8-b245-5c849ced73c8 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:24.550067 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b154b69e-7475-4964-b728-5c0252f910e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:24.550722 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154b69e-7475-4964-b728-5c0252f910e6 None admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:24.551002 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154b69e-7475-4964-b728-5c0252f910e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:24.551273 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154b69e-7475-4964-b728-5c0252f910e6 None admin] PATH_INFO: `/v3/projects` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:24.552009 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b154b69e-7475-4964-b728-5c0252f910e6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:24.553438 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b154b69e-7475-4964-b728-5c0252f910e6 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:24.560341 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc7eb28-9f5a-41af-90f6-d688721c8280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:24.561131 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7eb28-9f5a-41af-90f6-d688721c8280 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:24.561410 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7eb28-9f5a-41af-90f6-d688721c8280 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:24.561686 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7eb28-9f5a-41af-90f6-d688721c8280 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:24.568601 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc7eb28-9f5a-41af-90f6-d688721c8280 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:24.570127 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc7eb28-9f5a-41af-90f6-d688721c8280 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:24.583560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 511/1031] 10.222.0.44 () {60 vars in 1141 bytes} [Mon May 9 20:12:24 2022] POST /identity/v3/projects => generated 311 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 20:12:24.585823 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-6fc7eb28-9f5a-41af-90f6-d688721c8280 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 20:12:24.585823 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:12:24.585823 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:12:24.585823 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:12:24.585823 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:12:24.585823 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:12:24.585823 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:12:24.585823 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:12:24.585823 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:12:24.585823 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:12:24.585823 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:12:24.585823 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:12:24.585823 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 20:12:24.585823 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 20:12:24.585823 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 20:12:24.586776 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 20:12:24.586776 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:12:24.586776 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:12:24.586776 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:12:24.586776 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:12:24.586776 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:12:24.586776 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:12:24.586776 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:12:24.586776 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:12:24.586776 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:12:24.586776 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:12:24.586776 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:12:24.586776 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:12:24.586776 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:12:24.586776 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:12:24.586776 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:12:24.586776 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:12:24.587735 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 20:12:24.587735 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 20:12:24.587735 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 20:12:24.587735 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 20:12:24.587735 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 20:12:24.587735 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 20:12:24.587735 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 20:12:24.587735 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:12:24.591894 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 521/1032] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 9 20:12:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:12:24.593396 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b154b69e-7475-4964-b728-5c0252f910e6 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:24.701418 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b154b69e-7475-4964-b728-5c0252f910e6 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:24.738733 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935bfbf2-87d5-42c4-886d-1b20c516ca7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:24.739834 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935bfbf2-87d5-42c4-886d-1b20c516ca7f None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:24.740315 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935bfbf2-87d5-42c4-886d-1b20c516ca7f None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:24.740802 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935bfbf2-87d5-42c4-886d-1b20c516ca7f None admin] PATH_INFO: `/v3/projects` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:24.741794 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935bfbf2-87d5-42c4-886d-1b20c516ca7f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:24.742309 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935bfbf2-87d5-42c4-886d-1b20c516ca7f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:24.743979 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935bfbf2-87d5-42c4-886d-1b20c516ca7f None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:24.757982 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 512/1033] 10.222.0.44 () {56 vars in 1148 bytes} [Mon May 9 20:12:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:24.764364 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc7eb28-9f5a-41af-90f6-d688721c8280 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:24.867912 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc7eb28-9f5a-41af-90f6-d688721c8280 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:24.899701 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7178af91-38c8-4ee5-95ed-0baf39da05ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:24.900340 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7178af91-38c8-4ee5-95ed-0baf39da05ad None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:24.900618 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7178af91-38c8-4ee5-95ed-0baf39da05ad None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:24.900889 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7178af91-38c8-4ee5-95ed-0baf39da05ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:24.901712 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7178af91-38c8-4ee5-95ed-0baf39da05ad None admin] RBAC: Adding query filter params (role.id=397402b5f9aa441e966bdc8d463504e7, scope.project.id=563db7f5a25f480e8e6568b92ec3f195, user.id=eb59440b21074d9da15679dc2d745f72) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:24.902021 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7178af91-38c8-4ee5-95ed-0baf39da05ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:24.903460 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7178af91-38c8-4ee5-95ed-0baf39da05ad None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:24.909490 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 522/1034] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 9 20:12:24 2022] GET /identity/v3/role_assignments?user.id=eb59440b21074d9da15679dc2d745f72&scope.project.id=563db7f5a25f480e8e6568b92ec3f195&role.id=397402b5f9aa441e966bdc8d463504e7 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:12:25.711813 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec2cb9-0ed2-4229-999f-7b27d90bdef0 None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:25.712352 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec2cb9-0ed2-4229-999f-7b27d90bdef0 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:25.712352 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec2cb9-0ed2-4229-999f-7b27d90bdef0 None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:25.713837 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 513/1035] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:12:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:12:25.718948 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d30af-70f3-422c-9d73-0b4a25f13ab2 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:25.719238 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d30af-70f3-422c-9d73-0b4a25f13ab2 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:25.720078 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d30af-70f3-422c-9d73-0b4a25f13ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:25.736506 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-9e9d30af-70f3-422c-9d73-0b4a25f13ab2 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:12:25.737669 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-9e9d30af-70f3-422c-9d73-0b4a25f13ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:12:25.804854 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 523/1036] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:12:25 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 20:12:25.829777 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ec2cb9-0ed2-4229-999f-7b27d90bdef0 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:25.926801 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ec2cb9-0ed2-4229-999f-7b27d90bdef0 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:25.959437 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de7b6da-b6ac-4d11-af65-538f8a7aa0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:25.960219 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7b6da-b6ac-4d11-af65-538f8a7aa0da None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:25.960499 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7b6da-b6ac-4d11-af65-538f8a7aa0da None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:25.960767 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7b6da-b6ac-4d11-af65-538f8a7aa0da None admin] PATH_INFO: `/v3/services/image` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:25.961410 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de7b6da-b6ac-4d11-af65-538f8a7aa0da None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:25.962779 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de7b6da-b6ac-4d11-af65-538f8a7aa0da None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:25.973985 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-2de7b6da-b6ac-4d11-af65-538f8a7aa0da None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 09 20:12:25.973985 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:12:25.973985 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 20:12:25.973985 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 20:12:25.973985 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 20:12:25.973985 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 20:12:25.973985 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 20:12:25.973985 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 20:12:25.973985 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 09 20:12:25.973985 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:12:25.973985 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 20:12:25.973985 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:12:25.973985 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:12:25.973985 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:12:25.973985 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:12:25.973985 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:12:25.973985 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:12:25.974969 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:12:25.974969 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:12:25.974969 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:12:25.974969 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:12:25.974969 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:12:25.974969 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:12:25.974969 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 20:12:25.974969 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 20:12:25.974969 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 20:12:25.974969 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 20:12:25.974969 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:12:25.974969 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:12:25.974969 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:12:25.974969 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:12:25.974969 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:12:25.974969 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:12:25.975843 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:12:25.975843 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:12:25.975843 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:12:25.975843 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:12:25.975843 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:12:25.975843 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:12:25.975843 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:12:25.975843 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:12:25.975843 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:12:25.975843 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:12:25.975843 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 20:12:25.975843 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 20:12:25.975843 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 09 20:12:25.975843 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:12:25.979478 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 514/1037] 10.222.0.44 () {56 vars in 1105 bytes} [Mon May 9 20:12:25 2022] GET /identity/v3/services/image => generated 86 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:12:25.981201 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d30af-70f3-422c-9d73-0b4a25f13ab2 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:26.085138 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d30af-70f3-422c-9d73-0b4a25f13ab2 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:26.118494 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e9518-adfa-4dbd-81e4-c2bfa69602cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:26.119529 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e9518-adfa-4dbd-81e4-c2bfa69602cf None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:26.120030 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e9518-adfa-4dbd-81e4-c2bfa69602cf None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:26.120529 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e9518-adfa-4dbd-81e4-c2bfa69602cf None admin] PATH_INFO: `/v3/services` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:26.121485 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392e9518-adfa-4dbd-81e4-c2bfa69602cf None admin] RBAC: Adding query filter params (name=image) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:26.121988 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392e9518-adfa-4dbd-81e4-c2bfa69602cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:26.123573 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392e9518-adfa-4dbd-81e4-c2bfa69602cf None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:26.129078 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 524/1038] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:12:25 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:26.134647 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de7b6da-b6ac-4d11-af65-538f8a7aa0da None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:26.230722 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de7b6da-b6ac-4d11-af65-538f8a7aa0da None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:26.262458 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fb0975-0a09-4de9-b25d-930249bb2c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:26.263109 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb0975-0a09-4de9-b25d-930249bb2c18 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:26.263384 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb0975-0a09-4de9-b25d-930249bb2c18 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:26.263677 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb0975-0a09-4de9-b25d-930249bb2c18 None admin] PATH_INFO: `/v3/services` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:26.264374 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fb0975-0a09-4de9-b25d-930249bb2c18 None admin] RBAC: Adding query filter params (type=image) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:26.264673 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fb0975-0a09-4de9-b25d-930249bb2c18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:26.266039 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fb0975-0a09-4de9-b25d-930249bb2c18 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:26.271230 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 515/1039] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:12:26 2022] GET /identity/v3/services?type=image => generated 350 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:26.276855 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e9518-adfa-4dbd-81e4-c2bfa69602cf None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:26.369761 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e9518-adfa-4dbd-81e4-c2bfa69602cf None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:26.402247 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabb1ec3-fe0f-4f5f-93e6-cd1ff02e4e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:26.402904 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb1ec3-fe0f-4f5f-93e6-cd1ff02e4e73 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:26.403181 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb1ec3-fe0f-4f5f-93e6-cd1ff02e4e73 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:26.403473 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb1ec3-fe0f-4f5f-93e6-cd1ff02e4e73 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:26.404266 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabb1ec3-fe0f-4f5f-93e6-cd1ff02e4e73 None admin] RBAC: Adding query filter params (interface=public, service_id=9793404265d443a09744ac8126b8cda9, region_id=RegionOne) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:26.404574 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabb1ec3-fe0f-4f5f-93e6-cd1ff02e4e73 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:26.405933 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabb1ec3-fe0f-4f5f-93e6-cd1ff02e4e73 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:26.416160 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 525/1040] 10.222.0.44 () {56 vars in 1251 bytes} [Mon May 9 20:12:26 2022] GET /identity/v3/endpoints?service_id=9793404265d443a09744ac8126b8cda9&interface=public®ion_id=RegionOne => generated 194 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:26.417477 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fb0975-0a09-4de9-b25d-930249bb2c18 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:26.514159 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fb0975-0a09-4de9-b25d-930249bb2c18 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:26.545773 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49b52ef-1c34-497d-b83c-b0c4146e2534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:26.546434 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b52ef-1c34-497d-b83c-b0c4146e2534 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:26.546710 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b52ef-1c34-497d-b83c-b0c4146e2534 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:26.546977 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b52ef-1c34-497d-b83c-b0c4146e2534 None admin] PATH_INFO: `/v3/services` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:26.548319 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49b52ef-1c34-497d-b83c-b0c4146e2534 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:26.549678 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49b52ef-1c34-497d-b83c-b0c4146e2534 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:26.563496 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 516/1041] 10.222.0.44 () {56 vars in 1087 bytes} [Mon May 9 20:12:26 2022] GET /identity/v3/services => generated 1957 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:12:26.904965 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a441e-e032-4891-9b4e-6bdc9d1d95a6 None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:26.905140 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a441e-e032-4891-9b4e-6bdc9d1d95a6 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:26.905415 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a441e-e032-4891-9b4e-6bdc9d1d95a6 None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:26.906994 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 526/1042] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:12:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:12:26.912695 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37f410-b127-405d-b658-f275dd103bee None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:26.913164 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37f410-b127-405d-b658-f275dd103bee None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:26.913240 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37f410-b127-405d-b658-f275dd103bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:26.930388 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-3f37f410-b127-405d-b658-f275dd103bee None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:12:26.931613 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-3f37f410-b127-405d-b658-f275dd103bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:12:27.001516 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 517/1043] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:12:26 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 20:12:27.025731 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a441e-e032-4891-9b4e-6bdc9d1d95a6 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:27.125280 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a441e-e032-4891-9b4e-6bdc9d1d95a6 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:27.139048 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38abae9b-1422-4f06-b463-862592afff0a None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:27.139334 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38abae9b-1422-4f06-b463-862592afff0a None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:27.139639 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38abae9b-1422-4f06-b463-862592afff0a None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:27.141157 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 518/1044] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:12:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 20:12:27.146135 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d95303-bd46-47af-a9c0-e932d3629230 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:27.146438 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d95303-bd46-47af-a9c0-e932d3629230 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:27.146709 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d95303-bd46-47af-a9c0-e932d3629230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:27.159618 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d66ff9-3c3b-4f20-b5d6-1d486dcc7364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:27.160330 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d66ff9-3c3b-4f20-b5d6-1d486dcc7364 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:27.160607 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d66ff9-3c3b-4f20-b5d6-1d486dcc7364 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:27.160874 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d66ff9-3c3b-4f20-b5d6-1d486dcc7364 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:27.162039 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d66ff9-3c3b-4f20-b5d6-1d486dcc7364 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:27.163487 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d66ff9-3c3b-4f20-b5d6-1d486dcc7364 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:27.165102 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 527/1045] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:12:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:27.170745 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d66ff9-3c3b-4f20-b5d6-1d486dcc7364 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:27.170886 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-43d95303-bd46-47af-a9c0-e932d3629230 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:12:27.171943 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-43d95303-bd46-47af-a9c0-e932d3629230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:12:27.235955 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 519/1046] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:12:27 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 20:12:27.259033 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d95303-bd46-47af-a9c0-e932d3629230 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:27.265251 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d66ff9-3c3b-4f20-b5d6-1d486dcc7364 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:27.299086 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b4bde-9faa-40fa-8441-5cb2a91bb5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:27.299789 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b4bde-9faa-40fa-8441-5cb2a91bb5d7 None admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:27.300076 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b4bde-9faa-40fa-8441-5cb2a91bb5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:27.300357 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b4bde-9faa-40fa-8441-5cb2a91bb5d7 None admin] PATH_INFO: `/v3/users` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:27.301057 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53b4bde-9faa-40fa-8441-5cb2a91bb5d7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:27.302487 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53b4bde-9faa-40fa-8441-5cb2a91bb5d7 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:27.324349 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 528/1047] 10.222.0.44 () {60 vars in 1132 bytes} [Mon May 9 20:12:27 2022] POST /identity/v3/users => generated 285 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 20:12:27.360871 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d95303-bd46-47af-a9c0-e932d3629230 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:27.397683 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879323fb-9671-46cf-ac86-750bc917868c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:27.398493 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879323fb-9671-46cf-ac86-750bc917868c None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:27.398766 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879323fb-9671-46cf-ac86-750bc917868c None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:27.399031 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879323fb-9671-46cf-ac86-750bc917868c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:27.410999 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879323fb-9671-46cf-ac86-750bc917868c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:12:27.419091 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-879323fb-9671-46cf-ac86-750bc917868c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 20:12:27.419091 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:12:27.419091 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:12:27.419091 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:12:27.419091 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:12:27.419091 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:12:27.419091 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:12:27.419091 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:12:27.419091 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:12:27.419091 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:12:27.419091 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:12:27.419091 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:12:27.419091 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:12:27.419091 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:12:27.419091 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:12:27.419091 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:12:27.420176 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:12:27.420176 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:12:27.420176 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:12:27.420176 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:12:27.420176 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:12:27.420176 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:12:27.420176 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:12:27.420176 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:12:27.420176 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:12:27.420176 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:12:27.420176 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:12:27.420176 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:12:27.420176 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:12:27.420176 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:12:27.420176 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:12:27.420176 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:12:27.421585 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:12:27.421585 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:12:27.421585 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:12:27.421585 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:12:27.421585 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:12:27.421585 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:12:27.421585 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:12:27.421585 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:12:27.421585 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:12:27.421585 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:12:27.421585 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 20:12:27.421585 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:12:27.421585 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 520/1048] 10.222.0.44 () {56 vars in 1120 bytes} [Mon May 9 20:12:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 20:12:27.427103 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b4bde-9faa-40fa-8441-5cb2a91bb5d7 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:27.528960 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b4bde-9faa-40fa-8441-5cb2a91bb5d7 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:27.561505 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5489af-5e58-4156-8d70-d0dd332dd63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:27.562158 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5489af-5e58-4156-8d70-d0dd332dd63a None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:27.562435 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5489af-5e58-4156-8d70-d0dd332dd63a None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:27.562765 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5489af-5e58-4156-8d70-d0dd332dd63a None admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:27.564259 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5489af-5e58-4156-8d70-d0dd332dd63a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:27.564562 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5489af-5e58-4156-8d70-d0dd332dd63a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:27.565936 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5489af-5e58-4156-8d70-d0dd332dd63a None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:27.574279 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 529/1049] 10.222.0.44 () {56 vars in 1115 bytes} [Mon May 9 20:12:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:27.581693 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879323fb-9671-46cf-ac86-750bc917868c None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:27.676856 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879323fb-9671-46cf-ac86-750bc917868c None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:27.710234 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662d1a24-5b1d-4bb3-8d14-53193d3873b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:27.711045 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d1a24-5b1d-4bb3-8d14-53193d3873b3 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:27.711320 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d1a24-5b1d-4bb3-8d14-53193d3873b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:27.711624 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d1a24-5b1d-4bb3-8d14-53193d3873b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:27.723486 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662d1a24-5b1d-4bb3-8d14-53193d3873b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:27.724952 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662d1a24-5b1d-4bb3-8d14-53193d3873b3 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:27.741794 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-662d1a24-5b1d-4bb3-8d14-53193d3873b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:12:27.741794 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:12:27.741794 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:12:27.741794 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:12:27.741794 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:12:27.741794 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:12:27.741794 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:12:27.741794 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:12:27.741794 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:12:27.741794 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:12:27.741794 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:12:27.741794 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:12:27.741794 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 20:12:27.741794 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 20:12:27.741794 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 20:12:27.742701 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 20:12:27.742701 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:12:27.742701 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:12:27.742701 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:12:27.742701 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:12:27.742701 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:12:27.742701 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:12:27.742701 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:12:27.742701 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:12:27.742701 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:12:27.742701 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:12:27.742701 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:12:27.742701 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:12:27.742701 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:12:27.742701 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:12:27.742701 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:12:27.742701 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:12:27.744258 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 20:12:27.744258 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 20:12:27.744258 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:12:27.744258 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:12:27.744258 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 521/1050] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:12:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:12:27.748598 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5489af-5e58-4156-8d70-d0dd332dd63a None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:27.847285 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5489af-5e58-4156-8d70-d0dd332dd63a None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:27.879346 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5138d413-6cd0-437c-91cb-aaabeba21174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:27.880032 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5138d413-6cd0-437c-91cb-aaabeba21174 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:27.880314 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5138d413-6cd0-437c-91cb-aaabeba21174 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:27.880589 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5138d413-6cd0-437c-91cb-aaabeba21174 None admin] PATH_INFO: `/v3/domains` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:27.881563 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5138d413-6cd0-437c-91cb-aaabeba21174 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:27.881870 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5138d413-6cd0-437c-91cb-aaabeba21174 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:27.883235 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5138d413-6cd0-437c-91cb-aaabeba21174 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:27.895670 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 530/1051] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 9 20:12:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:27.901106 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662d1a24-5b1d-4bb3-8d14-53193d3873b3 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:27.995409 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662d1a24-5b1d-4bb3-8d14-53193d3873b3 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:28.028562 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ebd4d3-3569-416d-b1f9-6de2dbdfb879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:28.029343 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ebd4d3-3569-416d-b1f9-6de2dbdfb879 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:28.029625 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ebd4d3-3569-416d-b1f9-6de2dbdfb879 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:28.029896 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ebd4d3-3569-416d-b1f9-6de2dbdfb879 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:28.037537 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ebd4d3-3569-416d-b1f9-6de2dbdfb879 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:28.039053 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ebd4d3-3569-416d-b1f9-6de2dbdfb879 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:28.053314 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-62ebd4d3-3569-416d-b1f9-6de2dbdfb879 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 09 20:12:28.053314 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:12:28.053314 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:12:28.053314 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:12:28.053314 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:12:28.053314 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:12:28.053314 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:12:28.053314 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:12:28.053314 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:12:28.053314 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:12:28.053314 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:12:28.053314 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:12:28.053314 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 20:12:28.053314 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 20:12:28.053314 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 20:12:28.053314 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 20:12:28.054225 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:12:28.054225 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:12:28.054225 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 20:12:28.054225 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 20:12:28.054225 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 20:12:28.054225 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 20:12:28.054225 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:12:28.054225 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:12:28.054225 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:12:28.054225 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:12:28.054225 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:12:28.054225 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:12:28.054225 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:12:28.054225 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:12:28.054225 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:12:28.054225 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:12:28.054225 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:12:28.054225 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:12:28.055816 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:12:28.055816 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:12:28.055816 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 20:12:28.055816 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 20:12:28.055816 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 20:12:28.055816 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 20:12:28.055816 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 20:12:28.055816 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 20:12:28.055816 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 09 20:12:28.055816 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:12:28.055816 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 522/1052] 10.222.0.44 () {56 vars in 1093 bytes} [Mon May 9 20:12:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:12:28.060212 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5138d413-6cd0-437c-91cb-aaabeba21174 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:28.157576 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5138d413-6cd0-437c-91cb-aaabeba21174 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:28.189823 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad85c693-7993-4746-b04a-3955d522c881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:28.190482 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad85c693-7993-4746-b04a-3955d522c881 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:28.190757 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad85c693-7993-4746-b04a-3955d522c881 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:28.191024 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad85c693-7993-4746-b04a-3955d522c881 None admin] PATH_INFO: `/v3/users` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:28.191885 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad85c693-7993-4746-b04a-3955d522c881 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:28.192188 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad85c693-7993-4746-b04a-3955d522c881 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:28.193613 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad85c693-7993-4746-b04a-3955d522c881 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:28.215420 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 531/1053] 10.222.0.44 () {56 vars in 1133 bytes} [Mon May 9 20:12:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:28.216370 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ebd4d3-3569-416d-b1f9-6de2dbdfb879 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:28.311942 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ebd4d3-3569-416d-b1f9-6de2dbdfb879 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:28.344037 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8067545-b745-4169-b6f9-fe8c41bea6a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:28.345553 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8067545-b745-4169-b6f9-fe8c41bea6a4 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:28.345825 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8067545-b745-4169-b6f9-fe8c41bea6a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:28.346089 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8067545-b745-4169-b6f9-fe8c41bea6a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:28.356005 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8067545-b745-4169-b6f9-fe8c41bea6a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:28.357438 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8067545-b745-4169-b6f9-fe8c41bea6a4 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:28.373523 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-b8067545-b745-4169-b6f9-fe8c41bea6a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:12:28.373523 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:12:28.373523 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:12:28.373523 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:12:28.373523 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:12:28.373523 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:12:28.373523 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:12:28.373523 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:12:28.373523 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:12:28.373523 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:12:28.373523 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:12:28.373523 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:12:28.373523 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 20:12:28.373523 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 20:12:28.373523 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 20:12:28.374470 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 20:12:28.374470 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:12:28.374470 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:12:28.374470 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:12:28.374470 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:12:28.374470 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:12:28.374470 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:12:28.374470 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:12:28.374470 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:12:28.374470 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:12:28.374470 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:12:28.374470 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:12:28.374470 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:12:28.374470 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:12:28.374470 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:12:28.374470 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:12:28.374470 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:12:28.382077 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 20:12:28.382077 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 20:12:28.382077 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:12:28.382077 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:12:28.382077 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 523/1054] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:12:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 20:12:28.382381 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad85c693-7993-4746-b04a-3955d522c881 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:28.478515 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad85c693-7993-4746-b04a-3955d522c881 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:28.511783 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac99eb4-280b-4637-aeb2-f551aea2f27b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:28.512446 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac99eb4-280b-4637-aeb2-f551aea2f27b None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:28.512727 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac99eb4-280b-4637-aeb2-f551aea2f27b None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:28.512999 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac99eb4-280b-4637-aeb2-f551aea2f27b None admin] PATH_INFO: `/v3/domains` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:28.513717 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac99eb4-280b-4637-aeb2-f551aea2f27b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:28.514020 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac99eb4-280b-4637-aeb2-f551aea2f27b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:28.515384 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac99eb4-280b-4637-aeb2-f551aea2f27b None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:28.532869 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 532/1055] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 9 20:12:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:28.534175 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8067545-b745-4169-b6f9-fe8c41bea6a4 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:28.630577 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8067545-b745-4169-b6f9-fe8c41bea6a4 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:28.665821 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a01fa4c-c2b3-45ef-b4b5-5f1a46750756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:28.666652 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a01fa4c-c2b3-45ef-b4b5-5f1a46750756 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:28.666953 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a01fa4c-c2b3-45ef-b4b5-5f1a46750756 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:28.667187 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a01fa4c-c2b3-45ef-b4b5-5f1a46750756 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:28.674455 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a01fa4c-c2b3-45ef-b4b5-5f1a46750756 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:28.675935 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a01fa4c-c2b3-45ef-b4b5-5f1a46750756 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:28.690258 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-9a01fa4c-c2b3-45ef-b4b5-5f1a46750756 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 20:12:28.690258 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:12:28.690258 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:12:28.690258 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:12:28.690258 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:12:28.690258 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:12:28.690258 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:12:28.690258 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:12:28.690258 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:12:28.690258 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:12:28.690258 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:12:28.690258 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:12:28.690258 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 20:12:28.690258 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 20:12:28.690258 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 20:12:28.691158 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 20:12:28.691158 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:12:28.691158 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:12:28.691158 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:12:28.691158 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:12:28.691158 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:12:28.691158 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:12:28.691158 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:12:28.691158 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:12:28.691158 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:12:28.691158 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:12:28.691158 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:12:28.691158 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:12:28.691158 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:12:28.691158 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:12:28.691158 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:12:28.691158 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:12:28.697260 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 20:12:28.697260 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 20:12:28.697260 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 20:12:28.697260 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 20:12:28.697260 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 20:12:28.697260 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 20:12:28.697260 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 20:12:28.697260 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:12:28.697260 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 524/1056] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 9 20:12:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:12:28.697848 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac99eb4-280b-4637-aeb2-f551aea2f27b None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:28.790336 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac99eb4-280b-4637-aeb2-f551aea2f27b None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:28.822516 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba97b7cb-a996-4e9e-932b-81d87d7d9882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:28.823170 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97b7cb-a996-4e9e-932b-81d87d7d9882 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:28.823470 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97b7cb-a996-4e9e-932b-81d87d7d9882 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:28.823742 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97b7cb-a996-4e9e-932b-81d87d7d9882 None admin] PATH_INFO: `/v3/projects` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:28.824518 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba97b7cb-a996-4e9e-932b-81d87d7d9882 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:28.824832 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba97b7cb-a996-4e9e-932b-81d87d7d9882 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:28.826233 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba97b7cb-a996-4e9e-932b-81d87d7d9882 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:28.835102 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a92968b-72a9-4b7e-a6cb-994b23e9edb9 None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:28.835322 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a92968b-72a9-4b7e-a6cb-994b23e9edb9 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:28.835616 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a92968b-72a9-4b7e-a6cb-994b23e9edb9 None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:28.837098 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 525/1057] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:12:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:12:28.843389 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 533/1058] 10.222.0.44 () {56 vars in 1148 bytes} [Mon May 9 20:12:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:12:28.843586 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd16837-5771-4ac6-9802-4c8c6285019e None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:28.843586 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd16837-5771-4ac6-9802-4c8c6285019e None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:28.843586 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd16837-5771-4ac6-9802-4c8c6285019e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:28.844909 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba97b7cb-a996-4e9e-932b-81d87d7d9882 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:28.859421 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-dcd16837-5771-4ac6-9802-4c8c6285019e None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:12:28.860620 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-dcd16837-5771-4ac6-9802-4c8c6285019e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:12:28.924603 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 526/1059] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:12:28 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 20:12:28.939828 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba97b7cb-a996-4e9e-932b-81d87d7d9882 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:28.947106 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd16837-5771-4ac6-9802-4c8c6285019e None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:28.973636 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab40089-80af-4ed3-884b-63b856fb867a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:28.974513 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab40089-80af-4ed3-884b-63b856fb867a None admin] REQUEST_METHOD: `PUT` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:28.974790 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab40089-80af-4ed3-884b-63b856fb867a None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:28.975062 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab40089-80af-4ed3-884b-63b856fb867a None admin] PATH_INFO: `/v3/projects/563db7f5a25f480e8e6568b92ec3f195/users/eb59440b21074d9da15679dc2d745f72/roles/397402b5f9aa441e966bdc8d463504e7` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:28.977668 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab40089-80af-4ed3-884b-63b856fb867a None admin] RBAC: Authorizing `identity:create_grant(project_id=563db7f5a25f480e8e6568b92ec3f195, user_id=eb59440b21074d9da15679dc2d745f72, role_id=397402b5f9aa441e966bdc8d463504e7)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:28.979186 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab40089-80af-4ed3-884b-63b856fb867a None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:28.993615 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 534/1060] 10.222.0.44 () {58 vars in 1439 bytes} [Mon May 9 20:12:28 2022] PUT /identity/v3/projects/563db7f5a25f480e8e6568b92ec3f195/users/eb59440b21074d9da15679dc2d745f72/roles/397402b5f9aa441e966bdc8d463504e7 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:12:29.047801 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd16837-5771-4ac6-9802-4c8c6285019e None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:29.084319 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dee232-e292-40f6-bb74-f9151d8ac475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:29.085173 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dee232-e292-40f6-bb74-f9151d8ac475 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:29.085390 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dee232-e292-40f6-bb74-f9151d8ac475 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:29.085656 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dee232-e292-40f6-bb74-f9151d8ac475 None admin] PATH_INFO: `/v3/services/image` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:29.086300 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dee232-e292-40f6-bb74-f9151d8ac475 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:29.087721 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dee232-e292-40f6-bb74-f9151d8ac475 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:29.100563 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-11dee232-e292-40f6-bb74-f9151d8ac475 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 09 20:12:29.100563 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:12:29.100563 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 20:12:29.100563 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 20:12:29.100563 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 20:12:29.100563 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 20:12:29.100563 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 20:12:29.100563 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 20:12:29.100563 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 09 20:12:29.100563 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:12:29.100563 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 20:12:29.100563 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:12:29.100563 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:12:29.100563 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:12:29.100563 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:12:29.100563 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:12:29.100563 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:12:29.101673 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:12:29.101673 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:12:29.101673 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:12:29.101673 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:12:29.101673 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:12:29.101673 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:12:29.101673 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 20:12:29.101673 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 20:12:29.101673 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 20:12:29.101673 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 20:12:29.101673 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:12:29.101673 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:12:29.101673 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:12:29.101673 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:12:29.101673 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:12:29.101673 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:12:29.107768 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:12:29.107768 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:12:29.107768 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:12:29.107768 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:12:29.107768 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:12:29.107768 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:12:29.107768 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:12:29.107768 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:12:29.107768 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:12:29.107768 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:12:29.107768 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 20:12:29.107768 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 20:12:29.107768 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 09 20:12:29.107768 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:12:29.107768 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 527/1061] 10.222.0.44 () {56 vars in 1105 bytes} [Mon May 9 20:12:28 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 20:12:29.108576 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab40089-80af-4ed3-884b-63b856fb867a None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:29.209094 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab40089-80af-4ed3-884b-63b856fb867a None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:29.242019 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35450336-3e14-45e6-8356-22c06e6ff83d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:29.242674 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35450336-3e14-45e6-8356-22c06e6ff83d None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:29.242949 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35450336-3e14-45e6-8356-22c06e6ff83d None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:29.243243 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35450336-3e14-45e6-8356-22c06e6ff83d None admin] PATH_INFO: `/v3/services` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:29.243969 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35450336-3e14-45e6-8356-22c06e6ff83d None admin] RBAC: Adding query filter params (name=image) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:29.244274 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35450336-3e14-45e6-8356-22c06e6ff83d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:29.245621 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35450336-3e14-45e6-8356-22c06e6ff83d None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:29.250394 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 535/1062] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:12:29 2022] GET /identity/v3/services?name=image => generated 122 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:29.256517 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dee232-e292-40f6-bb74-f9151d8ac475 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:29.351457 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dee232-e292-40f6-bb74-f9151d8ac475 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:29.392312 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e868dcc-bc29-4444-b661-8cad32264f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:29.393116 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e868dcc-bc29-4444-b661-8cad32264f34 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:29.393393 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e868dcc-bc29-4444-b661-8cad32264f34 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:29.393659 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e868dcc-bc29-4444-b661-8cad32264f34 None admin] PATH_INFO: `/v3/services` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:29.394384 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e868dcc-bc29-4444-b661-8cad32264f34 None admin] RBAC: Adding query filter params (type=image) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:29.394682 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e868dcc-bc29-4444-b661-8cad32264f34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:29.396071 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e868dcc-bc29-4444-b661-8cad32264f34 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:29.407871 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 528/1063] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:12:29 2022] GET /identity/v3/services?type=image => generated 350 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:12:29.408180 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35450336-3e14-45e6-8356-22c06e6ff83d None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:29.505390 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35450336-3e14-45e6-8356-22c06e6ff83d None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:29.539125 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454988e9-a04a-43b4-a590-ca52ba0cf781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:29.539820 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454988e9-a04a-43b4-a590-ca52ba0cf781 None admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:29.540101 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454988e9-a04a-43b4-a590-ca52ba0cf781 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:29.540369 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454988e9-a04a-43b4-a590-ca52ba0cf781 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:29.541098 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454988e9-a04a-43b4-a590-ca52ba0cf781 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:29.542465 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454988e9-a04a-43b4-a590-ca52ba0cf781 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:29.561684 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 536/1064] 10.222.0.44 () {60 vars in 1144 bytes} [Mon May 9 20:12:29 2022] POST /identity/v3/endpoints => generated 327 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 20:12:29.680487 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc3e4f2-c3fd-421d-ae41-46466ca3182e None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:29.680668 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc3e4f2-c3fd-421d-ae41-46466ca3182e None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:29.681074 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc3e4f2-c3fd-421d-ae41-46466ca3182e None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:29.682552 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 529/1065] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:12:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:12:29.689130 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f302b82-27e3-4c19-9df2-4aff520f2f78 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:29.689130 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f302b82-27e3-4c19-9df2-4aff520f2f78 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:29.689388 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f302b82-27e3-4c19-9df2-4aff520f2f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:29.707175 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-4f302b82-27e3-4c19-9df2-4aff520f2f78 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:12:29.708430 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-4f302b82-27e3-4c19-9df2-4aff520f2f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:12:29.784830 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 537/1066] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:12:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 20:12:29.809111 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc3e4f2-c3fd-421d-ae41-46466ca3182e None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:29.908164 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc3e4f2-c3fd-421d-ae41-46466ca3182e None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:29.940673 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dda8ac-67c2-4c83-a3af-1e7a22e163db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:29.941375 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dda8ac-67c2-4c83-a3af-1e7a22e163db None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:29.941653 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dda8ac-67c2-4c83-a3af-1e7a22e163db None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:29.941921 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dda8ac-67c2-4c83-a3af-1e7a22e163db None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:29.951649 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dda8ac-67c2-4c83-a3af-1e7a22e163db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:12:29.959283 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-31dda8ac-67c2-4c83-a3af-1e7a22e163db None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 20:12:29.959283 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:12:29.959283 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:12:29.959283 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:12:29.959283 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:12:29.959283 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:12:29.959283 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:12:29.959283 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:12:29.959283 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:12:29.959283 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:12:29.959283 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:12:29.959283 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:12:29.959283 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:12:29.959283 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:12:29.959283 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:12:29.959283 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:12:29.960242 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:12:29.960242 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:12:29.960242 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:12:29.960242 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:12:29.960242 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:12:29.960242 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:12:29.960242 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:12:29.960242 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:12:29.960242 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:12:29.960242 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:12:29.960242 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:12:29.960242 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:12:29.960242 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:12:29.960242 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:12:29.960242 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:12:29.960242 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:12:29.961115 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:12:29.961115 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:12:29.961115 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:12:29.961115 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:12:29.961115 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:12:29.961115 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:12:29.961115 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:12:29.961115 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:12:29.961115 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:12:29.961115 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:12:29.961115 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 20:12:29.961115 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:12:29.961115 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 530/1067] 10.222.0.44 () {56 vars in 1096 bytes} [Mon May 9 20:12:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:12:29.967821 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f302b82-27e3-4c19-9df2-4aff520f2f78 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:30.061401 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f302b82-27e3-4c19-9df2-4aff520f2f78 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:30.094899 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bff8c6-ca34-4275-a6da-98712ae93b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:30.094899 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bff8c6-ca34-4275-a6da-98712ae93b35 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:30.094899 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bff8c6-ca34-4275-a6da-98712ae93b35 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:30.094899 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bff8c6-ca34-4275-a6da-98712ae93b35 None admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:30.096021 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bff8c6-ca34-4275-a6da-98712ae93b35 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:30.096325 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bff8c6-ca34-4275-a6da-98712ae93b35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:30.097708 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bff8c6-ca34-4275-a6da-98712ae93b35 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:30.106474 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 538/1068] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 9 20:12:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:30.113405 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dda8ac-67c2-4c83-a3af-1e7a22e163db None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:30.211116 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dda8ac-67c2-4c83-a3af-1e7a22e163db None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:30.243862 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b610dd-df13-4d6e-94a6-175ffe9e0731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:30.244726 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b610dd-df13-4d6e-94a6-175ffe9e0731 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:30.245005 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b610dd-df13-4d6e-94a6-175ffe9e0731 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:30.245271 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b610dd-df13-4d6e-94a6-175ffe9e0731 None admin] PATH_INFO: `/v3/users/979970baddb74a7c9073fcd855d45a56` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:30.258551 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b610dd-df13-4d6e-94a6-175ffe9e0731 None admin] RBAC: Authorizing `identity:get_user(user_id=979970baddb74a7c9073fcd855d45a56)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:30.260037 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b610dd-df13-4d6e-94a6-175ffe9e0731 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:30.266345 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 531/1069] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 9 20:12:30 2022] GET /identity/v3/users/979970baddb74a7c9073fcd855d45a56 => generated 285 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:30.267496 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bff8c6-ca34-4275-a6da-98712ae93b35 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:30.365544 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bff8c6-ca34-4275-a6da-98712ae93b35 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:30.397650 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbabd838-9728-4354-91fb-6165b1d9ea2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:30.398293 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbabd838-9728-4354-91fb-6165b1d9ea2d None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:30.398571 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbabd838-9728-4354-91fb-6165b1d9ea2d None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:30.398900 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbabd838-9728-4354-91fb-6165b1d9ea2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:30.462508 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbabd838-9728-4354-91fb-6165b1d9ea2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:30.464780 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbabd838-9728-4354-91fb-6165b1d9ea2d None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:30.563436 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 539/1070] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 9 20:12:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 20:12:30.565021 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b610dd-df13-4d6e-94a6-175ffe9e0731 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:30.663140 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b610dd-df13-4d6e-94a6-175ffe9e0731 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:30.695254 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518fe5dd-e926-4840-a79d-203b28fa2790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:30.696147 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518fe5dd-e926-4840-a79d-203b28fa2790 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:30.696425 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518fe5dd-e926-4840-a79d-203b28fa2790 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:30.696693 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518fe5dd-e926-4840-a79d-203b28fa2790 None admin] PATH_INFO: `/v3/projects/fe9da5082ada4bdd8c3ba73b689f558c` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:30.697863 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518fe5dd-e926-4840-a79d-203b28fa2790 None admin] RBAC: Authorizing `identity:get_project(project_id=fe9da5082ada4bdd8c3ba73b689f558c)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:30.699354 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518fe5dd-e926-4840-a79d-203b28fa2790 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:30.706868 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 532/1071] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 9 20:12:30 2022] GET /identity/v3/projects/fe9da5082ada4bdd8c3ba73b689f558c => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:30.707988 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbabd838-9728-4354-91fb-6165b1d9ea2d None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:30.805325 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbabd838-9728-4354-91fb-6165b1d9ea2d None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:30.839458 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54370e5a-3d67-46b9-82be-e55c7943b5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:30.840110 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54370e5a-3d67-46b9-82be-e55c7943b5d2 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:30.840388 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54370e5a-3d67-46b9-82be-e55c7943b5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:30.840658 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54370e5a-3d67-46b9-82be-e55c7943b5d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:30.841481 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54370e5a-3d67-46b9-82be-e55c7943b5d2 None admin] RBAC: Adding query filter params (role.id=274130b78e304bb88789c1b349263f3c, scope.project.id=fe9da5082ada4bdd8c3ba73b689f558c, user.id=979970baddb74a7c9073fcd855d45a56) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:30.841788 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54370e5a-3d67-46b9-82be-e55c7943b5d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:30.843274 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54370e5a-3d67-46b9-82be-e55c7943b5d2 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:30.855426 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 540/1072] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 9 20:12:30 2022] GET /identity/v3/role_assignments?user.id=979970baddb74a7c9073fcd855d45a56&scope.project.id=fe9da5082ada4bdd8c3ba73b689f558c&role.id=274130b78e304bb88789c1b349263f3c => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:31.237355 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33747522-9376-40e0-90e6-6a5924691244 None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:31.237876 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33747522-9376-40e0-90e6-6a5924691244 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:31.237876 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33747522-9376-40e0-90e6-6a5924691244 None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:31.239353 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 533/1073] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:12:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:12:31.244555 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a43c4d7-96f2-405f-9e10-49ddeb7932f3 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:31.244841 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a43c4d7-96f2-405f-9e10-49ddeb7932f3 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:31.245112 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a43c4d7-96f2-405f-9e10-49ddeb7932f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:31.262066 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-0a43c4d7-96f2-405f-9e10-49ddeb7932f3 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:12:31.263233 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-0a43c4d7-96f2-405f-9e10-49ddeb7932f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:12:31.328119 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 541/1074] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:12:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 20:12:31.351073 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33747522-9376-40e0-90e6-6a5924691244 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:31.448063 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33747522-9376-40e0-90e6-6a5924691244 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:31.480879 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e3e4dc-a29e-4c00-a52b-b6b4c7755584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:31.481666 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e3e4dc-a29e-4c00-a52b-b6b4c7755584 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:31.481939 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e3e4dc-a29e-4c00-a52b-b6b4c7755584 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:31.482200 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e3e4dc-a29e-4c00-a52b-b6b4c7755584 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:31.492487 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e3e4dc-a29e-4c00-a52b-b6b4c7755584 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:12:31.500228 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-48e3e4dc-a29e-4c00-a52b-b6b4c7755584 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 20:12:31.500228 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:12:31.500228 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:12:31.500228 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:12:31.500228 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:12:31.500228 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:12:31.500228 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:12:31.500228 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:12:31.500228 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:12:31.500228 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:12:31.500228 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:12:31.500228 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:12:31.500228 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:12:31.500228 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:12:31.500228 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:12:31.500228 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:12:31.501416 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:12:31.501416 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:12:31.501416 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:12:31.501416 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:12:31.501416 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:12:31.501416 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:12:31.501416 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:12:31.501416 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:12:31.501416 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:12:31.501416 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:12:31.501416 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:12:31.501416 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:12:31.501416 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:12:31.501416 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:12:31.501416 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:12:31.501416 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:12:31.502258 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:12:31.502258 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:12:31.502258 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:12:31.502258 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:12:31.502258 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:12:31.502258 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:12:31.502258 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:12:31.502258 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:12:31.502258 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:12:31.502258 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:12:31.502258 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 20:12:31.502258 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:12:31.503486 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 534/1075] 10.222.0.44 () {56 vars in 1120 bytes} [Mon May 9 20:12:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 20:12:31.507958 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a43c4d7-96f2-405f-9e10-49ddeb7932f3 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:31.603385 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a43c4d7-96f2-405f-9e10-49ddeb7932f3 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:31.636045 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cc5fe1-2efc-488b-ac7e-936c2fccb7b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:31.636700 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc5fe1-2efc-488b-ac7e-936c2fccb7b0 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:31.636975 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc5fe1-2efc-488b-ac7e-936c2fccb7b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:31.637239 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc5fe1-2efc-488b-ac7e-936c2fccb7b0 None admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:31.637970 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cc5fe1-2efc-488b-ac7e-936c2fccb7b0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:31.638267 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cc5fe1-2efc-488b-ac7e-936c2fccb7b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:31.639652 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cc5fe1-2efc-488b-ac7e-936c2fccb7b0 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:31.652340 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 542/1076] 10.222.0.44 () {56 vars in 1115 bytes} [Mon May 9 20:12:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:31.653907 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e3e4dc-a29e-4c00-a52b-b6b4c7755584 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:31.752593 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e3e4dc-a29e-4c00-a52b-b6b4c7755584 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:31.784416 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa4e35a-2fd4-4daf-b515-02547ede6fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:31.785198 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa4e35a-2fd4-4daf-b515-02547ede6fde None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:31.785472 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa4e35a-2fd4-4daf-b515-02547ede6fde None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:31.785736 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa4e35a-2fd4-4daf-b515-02547ede6fde None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:31.795615 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa4e35a-2fd4-4daf-b515-02547ede6fde None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:31.797055 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa4e35a-2fd4-4daf-b515-02547ede6fde None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:31.814268 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-aaa4e35a-2fd4-4daf-b515-02547ede6fde None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:12:31.814268 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:12:31.814268 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:12:31.814268 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:12:31.814268 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:12:31.814268 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:12:31.814268 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:12:31.814268 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:12:31.814268 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:12:31.814268 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:12:31.814268 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:12:31.814268 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:12:31.814268 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 20:12:31.814268 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 20:12:31.814268 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 20:12:31.815221 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 20:12:31.815221 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:12:31.815221 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:12:31.815221 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:12:31.815221 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:12:31.815221 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:12:31.815221 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:12:31.815221 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:12:31.815221 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:12:31.815221 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:12:31.815221 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:12:31.815221 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:12:31.815221 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:12:31.815221 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:12:31.815221 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:12:31.815221 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:12:31.815221 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:12:31.816151 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 20:12:31.816151 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 20:12:31.816151 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:12:31.816151 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:12:31.819562 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 535/1077] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:12:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:12:31.821134 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cc5fe1-2efc-488b-ac7e-936c2fccb7b0 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:31.854062 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726766e1-fa6b-4fdc-a874-5b87dfa08f94 None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:31.854372 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726766e1-fa6b-4fdc-a874-5b87dfa08f94 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:31.854617 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726766e1-fa6b-4fdc-a874-5b87dfa08f94 None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:31.856149 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 536/1078] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:12:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 20:12:31.861436 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b395fc4-80fa-406d-a09a-dc6ea67ae1e2 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:31.861722 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b395fc4-80fa-406d-a09a-dc6ea67ae1e2 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:31.861993 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b395fc4-80fa-406d-a09a-dc6ea67ae1e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:31.878541 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-7b395fc4-80fa-406d-a09a-dc6ea67ae1e2 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:12:31.879763 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-7b395fc4-80fa-406d-a09a-dc6ea67ae1e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:12:31.920057 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cc5fe1-2efc-488b-ac7e-936c2fccb7b0 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:31.945511 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 537/1079] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:12:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 20:12:31.953331 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c013b0-a059-4f02-bf8d-2a38b6ce7b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:31.954553 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c013b0-a059-4f02-bf8d-2a38b6ce7b8f None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:31.954833 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c013b0-a059-4f02-bf8d-2a38b6ce7b8f None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:31.955104 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c013b0-a059-4f02-bf8d-2a38b6ce7b8f None admin] PATH_INFO: `/v3/domains` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:31.955905 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c013b0-a059-4f02-bf8d-2a38b6ce7b8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:31.956213 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c013b0-a059-4f02-bf8d-2a38b6ce7b8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:31.957633 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c013b0-a059-4f02-bf8d-2a38b6ce7b8f None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:31.968949 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b395fc4-80fa-406d-a09a-dc6ea67ae1e2 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:31.971563 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 543/1080] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 9 20:12:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:12:31.976640 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c013b0-a059-4f02-bf8d-2a38b6ce7b8f None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:32.067261 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b395fc4-80fa-406d-a09a-dc6ea67ae1e2 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:32.073378 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c013b0-a059-4f02-bf8d-2a38b6ce7b8f None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:32.100133 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9505046-0a9e-4947-9738-4de4c4a3222d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:32.100780 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9505046-0a9e-4947-9738-4de4c4a3222d None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:32.101059 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9505046-0a9e-4947-9738-4de4c4a3222d None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:32.101332 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9505046-0a9e-4947-9738-4de4c4a3222d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:32.105884 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1492f4ca-997b-4f8d-9d17-bb380f8c1960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:32.106662 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492f4ca-997b-4f8d-9d17-bb380f8c1960 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:32.106938 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492f4ca-997b-4f8d-9d17-bb380f8c1960 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:32.107208 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492f4ca-997b-4f8d-9d17-bb380f8c1960 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:32.115019 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1492f4ca-997b-4f8d-9d17-bb380f8c1960 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:32.116591 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1492f4ca-997b-4f8d-9d17-bb380f8c1960 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:32.131749 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-1492f4ca-997b-4f8d-9d17-bb380f8c1960 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 09 20:12:32.131749 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:12:32.131749 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:12:32.131749 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:12:32.131749 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:12:32.131749 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:12:32.131749 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:12:32.131749 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:12:32.131749 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:12:32.131749 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:12:32.131749 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:12:32.131749 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:12:32.131749 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 20:12:32.131749 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 20:12:32.131749 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 20:12:32.131749 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 20:12:32.132777 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:12:32.132777 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:12:32.132777 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 20:12:32.132777 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 20:12:32.132777 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 20:12:32.132777 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 20:12:32.132777 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:12:32.132777 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:12:32.132777 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:12:32.132777 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:12:32.132777 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:12:32.132777 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:12:32.132777 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:12:32.132777 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:12:32.132777 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:12:32.132777 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:12:32.132777 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:12:32.132777 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:12:32.133783 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:12:32.133783 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:12:32.133783 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 20:12:32.133783 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 20:12:32.133783 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 20:12:32.133783 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 20:12:32.133783 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 20:12:32.133783 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 20:12:32.133783 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 09 20:12:32.133783 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:12:32.133783 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 544/1081] 10.222.0.44 () {56 vars in 1093 bytes} [Mon May 9 20:12:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:12:32.138435 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1492f4ca-997b-4f8d-9d17-bb380f8c1960 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:32.171475 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9505046-0a9e-4947-9738-4de4c4a3222d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:32.173485 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9505046-0a9e-4947-9738-4de4c4a3222d None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:32.235280 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1492f4ca-997b-4f8d-9d17-bb380f8c1960 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:32.273154 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf196040-66cd-49cf-aa5c-56c95e7a6622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:32.273373 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 538/1082] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 9 20:12:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 09 20:12:32.273798 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf196040-66cd-49cf-aa5c-56c95e7a6622 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:32.273798 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf196040-66cd-49cf-aa5c-56c95e7a6622 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:32.273798 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf196040-66cd-49cf-aa5c-56c95e7a6622 None admin] PATH_INFO: `/v3/users` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:32.273798 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf196040-66cd-49cf-aa5c-56c95e7a6622 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:32.273798 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf196040-66cd-49cf-aa5c-56c95e7a6622 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:32.273798 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf196040-66cd-49cf-aa5c-56c95e7a6622 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:32.275354 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9505046-0a9e-4947-9738-4de4c4a3222d None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:32.294043 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 545/1083] 10.222.0.44 () {56 vars in 1133 bytes} [Mon May 9 20:12:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:32.295509 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf196040-66cd-49cf-aa5c-56c95e7a6622 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:32.374043 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9505046-0a9e-4947-9738-4de4c4a3222d None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:32.394229 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf196040-66cd-49cf-aa5c-56c95e7a6622 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:32.408181 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a45af4-0c0e-4a99-8bbc-98ca5e18132b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:32.408956 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a45af4-0c0e-4a99-8bbc-98ca5e18132b None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:32.409228 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a45af4-0c0e-4a99-8bbc-98ca5e18132b None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:32.409495 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a45af4-0c0e-4a99-8bbc-98ca5e18132b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:32.419015 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a45af4-0c0e-4a99-8bbc-98ca5e18132b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:32.420484 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a45af4-0c0e-4a99-8bbc-98ca5e18132b None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:32.431061 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f43890-fd35-47ec-a8c1-f4b584ce0ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:32.431993 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f43890-fd35-47ec-a8c1-f4b584ce0ca0 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:32.432443 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f43890-fd35-47ec-a8c1-f4b584ce0ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:32.432863 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f43890-fd35-47ec-a8c1-f4b584ce0ca0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:32.437137 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-b1a45af4-0c0e-4a99-8bbc-98ca5e18132b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:12:32.437137 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:12:32.437137 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:12:32.437137 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:12:32.437137 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:12:32.437137 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:12:32.437137 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:12:32.437137 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:12:32.437137 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:12:32.437137 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:12:32.437137 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:12:32.437137 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:12:32.437137 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 20:12:32.437137 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 20:12:32.437137 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 20:12:32.438828 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 20:12:32.438828 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:12:32.438828 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:12:32.438828 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:12:32.438828 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:12:32.438828 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:12:32.438828 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:12:32.438828 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:12:32.438828 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:12:32.438828 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:12:32.438828 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:12:32.438828 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:12:32.438828 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:12:32.438828 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:12:32.438828 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:12:32.438828 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:12:32.438828 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:12:32.439798 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 20:12:32.439798 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 20:12:32.439798 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:12:32.439798 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:12:32.439798 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 539/1084] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:12:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 20:12:32.444692 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a45af4-0c0e-4a99-8bbc-98ca5e18132b None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:32.501875 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f43890-fd35-47ec-a8c1-f4b584ce0ca0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:32.503340 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f43890-fd35-47ec-a8c1-f4b584ce0ca0 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:32.545009 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a45af4-0c0e-4a99-8bbc-98ca5e18132b None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:32.585153 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831d6ff-aea2-40e5-bb05-5436730aabaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:32.585808 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831d6ff-aea2-40e5-bb05-5436730aabaf None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:32.586083 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831d6ff-aea2-40e5-bb05-5436730aabaf None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:32.586347 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831d6ff-aea2-40e5-bb05-5436730aabaf None admin] PATH_INFO: `/v3/domains` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:32.587053 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d831d6ff-aea2-40e5-bb05-5436730aabaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:32.587353 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d831d6ff-aea2-40e5-bb05-5436730aabaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:32.588747 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d831d6ff-aea2-40e5-bb05-5436730aabaf None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:32.599817 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 540/1085] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 9 20:12:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:12:32.602593 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 546/1086] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 9 20:12:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 09 20:12:32.608424 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831d6ff-aea2-40e5-bb05-5436730aabaf None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:32.712910 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831d6ff-aea2-40e5-bb05-5436730aabaf None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:32.747221 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f888ceeb-e7a2-4223-8d83-67fbad22ef6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:32.748036 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f888ceeb-e7a2-4223-8d83-67fbad22ef6d None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:32.748315 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f888ceeb-e7a2-4223-8d83-67fbad22ef6d None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:32.748582 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f888ceeb-e7a2-4223-8d83-67fbad22ef6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:32.759999 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f888ceeb-e7a2-4223-8d83-67fbad22ef6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:32.761469 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f888ceeb-e7a2-4223-8d83-67fbad22ef6d None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:32.779479 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-f888ceeb-e7a2-4223-8d83-67fbad22ef6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:12:32.779479 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:12:32.779479 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:12:32.779479 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:12:32.779479 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:12:32.779479 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:12:32.779479 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:12:32.779479 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:12:32.779479 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:12:32.779479 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:12:32.779479 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:12:32.779479 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:12:32.779479 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 20:12:32.779479 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 20:12:32.779479 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 20:12:32.780454 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 20:12:32.780454 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:12:32.780454 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:12:32.780454 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:12:32.780454 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:12:32.780454 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:12:32.780454 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:12:32.780454 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:12:32.780454 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:12:32.780454 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:12:32.780454 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:12:32.780454 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:12:32.780454 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:12:32.780454 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:12:32.780454 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:12:32.780454 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:12:32.780454 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:12:32.781455 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 20:12:32.781455 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 20:12:32.781455 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:12:32.781455 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:12:32.781455 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 541/1087] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:12:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:12:32.787738 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f43890-fd35-47ec-a8c1-f4b584ce0ca0 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:32.892194 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f43890-fd35-47ec-a8c1-f4b584ce0ca0 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:32.929420 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfac7b6-253f-45fa-aeba-0c50e6776026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:32.930093 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfac7b6-253f-45fa-aeba-0c50e6776026 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:32.930399 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfac7b6-253f-45fa-aeba-0c50e6776026 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:32.930669 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfac7b6-253f-45fa-aeba-0c50e6776026 None admin] PATH_INFO: `/v3/domains` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:32.931464 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfac7b6-253f-45fa-aeba-0c50e6776026 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:32.931732 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfac7b6-253f-45fa-aeba-0c50e6776026 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:32.933107 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfac7b6-253f-45fa-aeba-0c50e6776026 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:32.944792 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 547/1088] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 9 20:12:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:32.950450 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f888ceeb-e7a2-4223-8d83-67fbad22ef6d None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:33.044428 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f888ceeb-e7a2-4223-8d83-67fbad22ef6d None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:33.076907 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3886d8c-10c5-4ddc-a1c4-f828b35e01d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:33.077686 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3886d8c-10c5-4ddc-a1c4-f828b35e01d8 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:33.077961 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3886d8c-10c5-4ddc-a1c4-f828b35e01d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:33.078228 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3886d8c-10c5-4ddc-a1c4-f828b35e01d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:33.084788 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3886d8c-10c5-4ddc-a1c4-f828b35e01d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:33.086226 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3886d8c-10c5-4ddc-a1c4-f828b35e01d8 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:33.094019 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b7520-4b95-4cb7-909b-130277434c6a None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:33.094873 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b7520-4b95-4cb7-909b-130277434c6a None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:33.095151 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b7520-4b95-4cb7-909b-130277434c6a None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:33.096585 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 548/1089] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:12:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 20:12:33.100528 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-e3886d8c-10c5-4ddc-a1c4-f828b35e01d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 20:12:33.100528 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:12:33.100528 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:12:33.100528 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:12:33.100528 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:12:33.100528 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:12:33.100528 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:12:33.100528 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:12:33.100528 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:12:33.100528 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:12:33.100528 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:12:33.100528 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:12:33.100528 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 20:12:33.100528 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 20:12:33.100528 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 20:12:33.101572 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 20:12:33.101572 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:12:33.101572 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:12:33.101572 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:12:33.101572 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:12:33.101572 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:12:33.101572 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:12:33.101572 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:12:33.101572 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:12:33.101572 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:12:33.101572 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:12:33.101572 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:12:33.101572 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:12:33.101572 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:12:33.101572 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:12:33.101572 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:12:33.101572 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:12:33.102511 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 20:12:33.102511 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 20:12:33.102511 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 20:12:33.102511 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 20:12:33.102511 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 20:12:33.102511 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 20:12:33.102511 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 20:12:33.102511 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:12:33.102945 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3eaaf8-4e02-4dc3-8b58-a47613bbea21 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:33.102945 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3eaaf8-4e02-4dc3-8b58-a47613bbea21 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:33.103072 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 542/1090] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 9 20:12:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:12:33.103138 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3eaaf8-4e02-4dc3-8b58-a47613bbea21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:33.107243 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3886d8c-10c5-4ddc-a1c4-f828b35e01d8 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:33.118993 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-6b3eaaf8-4e02-4dc3-8b58-a47613bbea21 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:12:33.120201 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-6b3eaaf8-4e02-4dc3-8b58-a47613bbea21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:12:33.181984 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 549/1091] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:12:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 20:12:33.198678 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3886d8c-10c5-4ddc-a1c4-f828b35e01d8 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:33.204031 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3eaaf8-4e02-4dc3-8b58-a47613bbea21 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:33.230408 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f614478-9fd9-4db9-80e2-10c28de53e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:33.231054 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f614478-9fd9-4db9-80e2-10c28de53e0c None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:33.231331 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f614478-9fd9-4db9-80e2-10c28de53e0c None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:33.231629 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f614478-9fd9-4db9-80e2-10c28de53e0c None admin] PATH_INFO: `/v3/projects` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:33.232399 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f614478-9fd9-4db9-80e2-10c28de53e0c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:33.232702 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f614478-9fd9-4db9-80e2-10c28de53e0c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:33.234136 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f614478-9fd9-4db9-80e2-10c28de53e0c None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:33.245592 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 543/1092] 10.222.0.44 () {56 vars in 1148 bytes} [Mon May 9 20:12:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:12:33.251522 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f614478-9fd9-4db9-80e2-10c28de53e0c None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:33.295490 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3eaaf8-4e02-4dc3-8b58-a47613bbea21 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:33.327576 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1141bc5c-bc04-418a-bf10-2f42ea538855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:33.328345 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1141bc5c-bc04-418a-bf10-2f42ea538855 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:33.329145 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1141bc5c-bc04-418a-bf10-2f42ea538855 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:33.329414 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1141bc5c-bc04-418a-bf10-2f42ea538855 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:33.338986 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1141bc5c-bc04-418a-bf10-2f42ea538855 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:12:33.345330 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f614478-9fd9-4db9-80e2-10c28de53e0c None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:33.346511 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-1141bc5c-bc04-418a-bf10-2f42ea538855 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 20:12:33.346511 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:12:33.346511 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:12:33.346511 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:12:33.346511 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:12:33.346511 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:12:33.346511 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:12:33.346511 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:12:33.346511 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:12:33.346511 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:12:33.346511 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:12:33.346511 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:12:33.346511 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:12:33.346511 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:12:33.346511 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:12:33.346511 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:12:33.347430 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:12:33.347430 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:12:33.347430 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:12:33.347430 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:12:33.347430 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:12:33.347430 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:12:33.347430 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:12:33.347430 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:12:33.347430 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:12:33.347430 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:12:33.347430 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:12:33.347430 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:12:33.347430 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:12:33.347430 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:12:33.347430 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:12:33.347430 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:12:33.348310 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:12:33.348310 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:12:33.348310 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:12:33.348310 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:12:33.348310 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:12:33.348310 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:12:33.348310 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:12:33.348310 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:12:33.348310 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:12:33.348310 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:12:33.348310 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 20:12:33.348310 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:12:33.348310 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 550/1093] 10.222.0.44 () {56 vars in 1096 bytes} [Mon May 9 20:12:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 20:12:33.353634 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1141bc5c-bc04-418a-bf10-2f42ea538855 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:33.377174 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6ceca7-a723-4416-acf9-351dc53ae7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:33.377818 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ceca7-a723-4416-acf9-351dc53ae7bb None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:33.378096 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ceca7-a723-4416-acf9-351dc53ae7bb None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:33.378362 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ceca7-a723-4416-acf9-351dc53ae7bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:33.379169 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6ceca7-a723-4416-acf9-351dc53ae7bb None admin] RBAC: Adding query filter params (role.id=397402b5f9aa441e966bdc8d463504e7, scope.project.id=563db7f5a25f480e8e6568b92ec3f195, user.id=eb59440b21074d9da15679dc2d745f72) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:33.379506 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6ceca7-a723-4416-acf9-351dc53ae7bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:33.381186 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6ceca7-a723-4416-acf9-351dc53ae7bb None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:33.386834 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 544/1094] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 9 20:12:33 2022] GET /identity/v3/role_assignments?user.id=eb59440b21074d9da15679dc2d745f72&scope.project.id=563db7f5a25f480e8e6568b92ec3f195&role.id=397402b5f9aa441e966bdc8d463504e7 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:12:33.453205 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1141bc5c-bc04-418a-bf10-2f42ea538855 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:33.488675 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ee9e4c-6319-4861-a53f-5a839059a55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:33.489347 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee9e4c-6319-4861-a53f-5a839059a55c None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:33.489634 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee9e4c-6319-4861-a53f-5a839059a55c None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:33.489907 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee9e4c-6319-4861-a53f-5a839059a55c None admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:33.490661 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ee9e4c-6319-4861-a53f-5a839059a55c None admin] RBAC: Adding query filter params (name=admin) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:33.490967 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ee9e4c-6319-4861-a53f-5a839059a55c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:33.492427 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ee9e4c-6319-4861-a53f-5a839059a55c None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:33.502488 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 551/1095] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 9 20:12:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:12:33.508797 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6ceca7-a723-4416-acf9-351dc53ae7bb None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:33.608500 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6ceca7-a723-4416-acf9-351dc53ae7bb None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:33.642470 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39d6449-c286-441a-ba93-3d48451c5965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:33.643334 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39d6449-c286-441a-ba93-3d48451c5965 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:33.643686 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39d6449-c286-441a-ba93-3d48451c5965 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:33.643966 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39d6449-c286-441a-ba93-3d48451c5965 None admin] PATH_INFO: `/v3/users/979970baddb74a7c9073fcd855d45a56` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:33.645145 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39d6449-c286-441a-ba93-3d48451c5965 None admin] RBAC: Authorizing `identity:get_user(user_id=979970baddb74a7c9073fcd855d45a56)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:33.646578 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39d6449-c286-441a-ba93-3d48451c5965 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:33.648234 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 545/1096] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 9 20:12:33 2022] GET /identity/v3/users/979970baddb74a7c9073fcd855d45a56 => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:33.654179 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ee9e4c-6319-4861-a53f-5a839059a55c None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:33.752355 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ee9e4c-6319-4861-a53f-5a839059a55c None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:33.784984 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3919b064-e66c-4325-9e50-ec83751a05b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:33.785825 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3919b064-e66c-4325-9e50-ec83751a05b8 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:33.786095 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3919b064-e66c-4325-9e50-ec83751a05b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:33.786361 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3919b064-e66c-4325-9e50-ec83751a05b8 None admin] PATH_INFO: `/v3/projects/fe9da5082ada4bdd8c3ba73b689f558c` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:33.787545 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3919b064-e66c-4325-9e50-ec83751a05b8 None admin] RBAC: Authorizing `identity:get_project(project_id=fe9da5082ada4bdd8c3ba73b689f558c)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:33.788961 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3919b064-e66c-4325-9e50-ec83751a05b8 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:33.790652 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 552/1097] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 9 20:12:33 2022] GET /identity/v3/projects/fe9da5082ada4bdd8c3ba73b689f558c => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:33.796668 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39d6449-c286-441a-ba93-3d48451c5965 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:33.896373 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39d6449-c286-441a-ba93-3d48451c5965 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:33.929114 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1077403-d1fd-46bc-a04f-2173f433439d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:33.929997 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1077403-d1fd-46bc-a04f-2173f433439d None admin] REQUEST_METHOD: `PUT` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:33.930272 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1077403-d1fd-46bc-a04f-2173f433439d None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:33.930538 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1077403-d1fd-46bc-a04f-2173f433439d None admin] PATH_INFO: `/v3/projects/fe9da5082ada4bdd8c3ba73b689f558c/users/979970baddb74a7c9073fcd855d45a56/roles/274130b78e304bb88789c1b349263f3c` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:33.932502 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1077403-d1fd-46bc-a04f-2173f433439d None admin] RBAC: Authorizing `identity:create_grant(project_id=fe9da5082ada4bdd8c3ba73b689f558c, user_id=979970baddb74a7c9073fcd855d45a56, role_id=274130b78e304bb88789c1b349263f3c)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:33.933920 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1077403-d1fd-46bc-a04f-2173f433439d None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:33.948085 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 546/1098] 10.222.0.44 () {58 vars in 1439 bytes} [Mon May 9 20:12:33 2022] PUT /identity/v3/projects/fe9da5082ada4bdd8c3ba73b689f558c/users/979970baddb74a7c9073fcd855d45a56/roles/274130b78e304bb88789c1b349263f3c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:12:36.129424 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6bc39-c5de-423d-b156-9480f69a228c None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:36.129998 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6bc39-c5de-423d-b156-9480f69a228c None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:36.129998 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6bc39-c5de-423d-b156-9480f69a228c None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:36.131589 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 553/1099] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:12:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:12:36.136818 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5701223a-0c60-42d4-82f6-81e70e8c9aad None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:36.137242 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5701223a-0c60-42d4-82f6-81e70e8c9aad None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:36.137373 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5701223a-0c60-42d4-82f6-81e70e8c9aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:36.153488 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-5701223a-0c60-42d4-82f6-81e70e8c9aad None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:12:36.154687 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-5701223a-0c60-42d4-82f6-81e70e8c9aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:12:36.216856 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 547/1100] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:12:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 20:12:36.240713 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef6bc39-c5de-423d-b156-9480f69a228c None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:36.334249 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef6bc39-c5de-423d-b156-9480f69a228c None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:36.365340 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0229de60-f6e1-4af5-a31d-9075e2cc9aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:36.366096 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0229de60-f6e1-4af5-a31d-9075e2cc9aea None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:36.366369 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0229de60-f6e1-4af5-a31d-9075e2cc9aea None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:36.366636 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0229de60-f6e1-4af5-a31d-9075e2cc9aea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:36.376002 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0229de60-f6e1-4af5-a31d-9075e2cc9aea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:12:36.383702 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-0229de60-f6e1-4af5-a31d-9075e2cc9aea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 20:12:36.383702 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:12:36.383702 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:12:36.383702 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:12:36.383702 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:12:36.383702 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:12:36.383702 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:12:36.383702 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:12:36.383702 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:12:36.383702 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:12:36.383702 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:12:36.383702 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:12:36.383702 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:12:36.383702 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:12:36.383702 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:12:36.383702 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:12:36.384778 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:12:36.384778 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:12:36.384778 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:12:36.384778 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:12:36.384778 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:12:36.384778 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:12:36.384778 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:12:36.384778 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:12:36.384778 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:12:36.384778 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:12:36.384778 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:12:36.384778 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:12:36.384778 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:12:36.384778 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:12:36.384778 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:12:36.384778 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:12:36.385920 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:12:36.385920 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:12:36.385920 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:12:36.385920 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:12:36.385920 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:12:36.385920 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:12:36.385920 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:12:36.385920 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:12:36.385920 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:12:36.385920 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:12:36.385920 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 20:12:36.385920 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:12:36.385920 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 554/1101] 10.222.0.44 () {56 vars in 1096 bytes} [Mon May 9 20:12:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:12:36.390717 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5701223a-0c60-42d4-82f6-81e70e8c9aad None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:36.481732 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5701223a-0c60-42d4-82f6-81e70e8c9aad None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:36.515421 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9541855-de11-446c-8706-8f423261c241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:36.517414 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9541855-de11-446c-8706-8f423261c241 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:36.518210 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9541855-de11-446c-8706-8f423261c241 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:36.518894 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9541855-de11-446c-8706-8f423261c241 None admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:36.519942 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9541855-de11-446c-8706-8f423261c241 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:36.520245 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9541855-de11-446c-8706-8f423261c241 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:36.521622 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9541855-de11-446c-8706-8f423261c241 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:36.529802 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 548/1102] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 9 20:12:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:36.536171 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0229de60-f6e1-4af5-a31d-9075e2cc9aea None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:36.630118 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0229de60-f6e1-4af5-a31d-9075e2cc9aea None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:36.662179 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd085bc-376b-4a16-ab72-1fa00e5f49e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:36.662964 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd085bc-376b-4a16-ab72-1fa00e5f49e5 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:36.663244 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd085bc-376b-4a16-ab72-1fa00e5f49e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:36.663545 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd085bc-376b-4a16-ab72-1fa00e5f49e5 None admin] PATH_INFO: `/v3/users/979970baddb74a7c9073fcd855d45a56` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:36.664710 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd085bc-376b-4a16-ab72-1fa00e5f49e5 None admin] RBAC: Authorizing `identity:get_user(user_id=979970baddb74a7c9073fcd855d45a56)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:36.666116 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd085bc-376b-4a16-ab72-1fa00e5f49e5 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:36.667750 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 555/1103] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 9 20:12:36 2022] GET /identity/v3/users/979970baddb74a7c9073fcd855d45a56 => generated 285 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:36.673912 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9541855-de11-446c-8706-8f423261c241 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:36.765799 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9541855-de11-446c-8706-8f423261c241 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:36.796823 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a33d6-0f88-48ba-b578-f11942aad1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:36.797482 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a33d6-0f88-48ba-b578-f11942aad1d4 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:36.797855 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a33d6-0f88-48ba-b578-f11942aad1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:36.798128 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a33d6-0f88-48ba-b578-f11942aad1d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:36.861719 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9a33d6-0f88-48ba-b578-f11942aad1d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:36.863154 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9a33d6-0f88-48ba-b578-f11942aad1d4 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:36.952997 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 549/1104] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 9 20:12:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 20:12:36.958892 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd085bc-376b-4a16-ab72-1fa00e5f49e5 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:37.053007 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd085bc-376b-4a16-ab72-1fa00e5f49e5 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:37.084342 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f0f47c-0587-4fbf-8a71-063e2f9ddc34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:37.085180 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f0f47c-0587-4fbf-8a71-063e2f9ddc34 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:37.085464 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f0f47c-0587-4fbf-8a71-063e2f9ddc34 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:37.085739 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f0f47c-0587-4fbf-8a71-063e2f9ddc34 None admin] PATH_INFO: `/v3/projects/fe9da5082ada4bdd8c3ba73b689f558c` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:37.086891 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f0f47c-0587-4fbf-8a71-063e2f9ddc34 None admin] RBAC: Authorizing `identity:get_project(project_id=fe9da5082ada4bdd8c3ba73b689f558c)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:37.088338 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f0f47c-0587-4fbf-8a71-063e2f9ddc34 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:37.090011 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 556/1105] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 9 20:12:36 2022] GET /identity/v3/projects/fe9da5082ada4bdd8c3ba73b689f558c => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:37.096710 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a33d6-0f88-48ba-b578-f11942aad1d4 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:37.187028 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a33d6-0f88-48ba-b578-f11942aad1d4 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:37.217938 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e178208-572d-4455-980e-431a38f7df7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:37.218504 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e178208-572d-4455-980e-431a38f7df7e None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:37.218775 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e178208-572d-4455-980e-431a38f7df7e None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:37.219657 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e178208-572d-4455-980e-431a38f7df7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:37.220478 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e178208-572d-4455-980e-431a38f7df7e None admin] RBAC: Adding query filter params (role.id=274130b78e304bb88789c1b349263f3c, scope.project.id=fe9da5082ada4bdd8c3ba73b689f558c, user.id=979970baddb74a7c9073fcd855d45a56) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:37.220776 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e178208-572d-4455-980e-431a38f7df7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:37.222189 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e178208-572d-4455-980e-431a38f7df7e None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:37.227632 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 550/1106] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 9 20:12:37 2022] GET /identity/v3/role_assignments?user.id=979970baddb74a7c9073fcd855d45a56&scope.project.id=fe9da5082ada4bdd8c3ba73b689f558c&role.id=274130b78e304bb88789c1b349263f3c => generated 608 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:39.447887 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797be0dc-9c46-4ad1-ac72-b1616e426868 None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:39.448467 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797be0dc-9c46-4ad1-ac72-b1616e426868 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:39.448467 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797be0dc-9c46-4ad1-ac72-b1616e426868 None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:39.449786 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 557/1107] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:12:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:12:39.455823 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d6cb6-87eb-489b-b685-4c9e8d168cf5 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:39.456242 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d6cb6-87eb-489b-b685-4c9e8d168cf5 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:39.456375 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d6cb6-87eb-489b-b685-4c9e8d168cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:39.473178 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-046d6cb6-87eb-489b-b685-4c9e8d168cf5 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:12:39.474358 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-046d6cb6-87eb-489b-b685-4c9e8d168cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:12:39.537449 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 551/1108] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:12:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 20:12:39.561420 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797be0dc-9c46-4ad1-ac72-b1616e426868 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:39.658227 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797be0dc-9c46-4ad1-ac72-b1616e426868 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:39.689369 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c6002d-2def-4592-83b6-69312c78ab3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:39.690131 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6002d-2def-4592-83b6-69312c78ab3d None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:39.690409 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6002d-2def-4592-83b6-69312c78ab3d None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:39.690677 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6002d-2def-4592-83b6-69312c78ab3d None admin] PATH_INFO: `/v3/domains/default` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:39.691854 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c6002d-2def-4592-83b6-69312c78ab3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:39.693263 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c6002d-2def-4592-83b6-69312c78ab3d None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:39.694864 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 558/1109] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:12:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:39.700601 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046d6cb6-87eb-489b-b685-4c9e8d168cf5 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:39.793090 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046d6cb6-87eb-489b-b685-4c9e8d168cf5 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:39.830389 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66182165-94a9-41f8-a6de-9e43dd3d8f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:39.831045 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66182165-94a9-41f8-a6de-9e43dd3d8f4d None admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:39.831323 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66182165-94a9-41f8-a6de-9e43dd3d8f4d None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:39.831620 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66182165-94a9-41f8-a6de-9e43dd3d8f4d None admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:39.832323 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66182165-94a9-41f8-a6de-9e43dd3d8f4d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:39.833742 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66182165-94a9-41f8-a6de-9e43dd3d8f4d None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:39.852191 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 552/1110] 10.222.0.44 () {60 vars in 1132 bytes} [Mon May 9 20:12:39 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 20:12:42.091512 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f65c49c-505a-4a3a-8f41-fdd2de64a510 None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:42.092043 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f65c49c-505a-4a3a-8f41-fdd2de64a510 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:42.092043 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f65c49c-505a-4a3a-8f41-fdd2de64a510 None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:42.093406 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 559/1111] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:12:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:12:42.099182 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110bb11-b7a8-4fb8-8352-e1af34c70074 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:42.099602 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110bb11-b7a8-4fb8-8352-e1af34c70074 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:42.099768 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110bb11-b7a8-4fb8-8352-e1af34c70074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:42.116530 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-a110bb11-b7a8-4fb8-8352-e1af34c70074 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:12:42.117695 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-a110bb11-b7a8-4fb8-8352-e1af34c70074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:12:42.180391 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 553/1112] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:12:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 20:12:42.203055 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f65c49c-505a-4a3a-8f41-fdd2de64a510 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:42.298303 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f65c49c-505a-4a3a-8f41-fdd2de64a510 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:42.330188 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70520686-face-4f2f-8bc0-565127708633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:42.331017 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70520686-face-4f2f-8bc0-565127708633 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:42.331293 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70520686-face-4f2f-8bc0-565127708633 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:42.331589 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70520686-face-4f2f-8bc0-565127708633 None admin] PATH_INFO: `/v3/roles/52c0c2910c294965839ef51e91b156a1` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:42.333042 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70520686-face-4f2f-8bc0-565127708633 None admin] RBAC: Authorizing `identity:get_role(role_id=52c0c2910c294965839ef51e91b156a1)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:42.334432 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70520686-face-4f2f-8bc0-565127708633 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:42.335828 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 560/1113] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 9 20:12:42 2022] GET /identity/v3/roles/52c0c2910c294965839ef51e91b156a1 => generated 223 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:42.341440 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a110bb11-b7a8-4fb8-8352-e1af34c70074 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:42.432787 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a110bb11-b7a8-4fb8-8352-e1af34c70074 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:42.464684 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ffc13e-586d-4333-812e-694131e1f1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:42.465508 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ffc13e-586d-4333-812e-694131e1f1c2 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:42.465786 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ffc13e-586d-4333-812e-694131e1f1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:42.466052 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ffc13e-586d-4333-812e-694131e1f1c2 None admin] PATH_INFO: `/v3/users/66d104beed1f40c08b7d0d551ba7850e` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:42.478795 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ffc13e-586d-4333-812e-694131e1f1c2 None admin] RBAC: Authorizing `identity:get_user(user_id=66d104beed1f40c08b7d0d551ba7850e)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:42.480254 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ffc13e-586d-4333-812e-694131e1f1c2 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:42.481842 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 554/1114] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 9 20:12:42 2022] GET /identity/v3/users/66d104beed1f40c08b7d0d551ba7850e => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:42.487412 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70520686-face-4f2f-8bc0-565127708633 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:42.582043 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70520686-face-4f2f-8bc0-565127708633 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:42.614113 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0044d6f8-1730-475a-acc5-9606b9f9baa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:42.614740 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044d6f8-1730-475a-acc5-9606b9f9baa5 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:42.615017 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044d6f8-1730-475a-acc5-9606b9f9baa5 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:42.615288 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044d6f8-1730-475a-acc5-9606b9f9baa5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:42.677492 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0044d6f8-1730-475a-acc5-9606b9f9baa5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:42.678908 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0044d6f8-1730-475a-acc5-9606b9f9baa5 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:42.769486 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 561/1115] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 9 20:12:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 20:12:42.775473 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ffc13e-586d-4333-812e-694131e1f1c2 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:42.866919 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ffc13e-586d-4333-812e-694131e1f1c2 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:42.902557 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139b3ffd-1392-449c-80bb-57d598bbfa26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:42.903523 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b3ffd-1392-449c-80bb-57d598bbfa26 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:42.903798 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b3ffd-1392-449c-80bb-57d598bbfa26 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:42.904064 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b3ffd-1392-449c-80bb-57d598bbfa26 None admin] PATH_INFO: `/v3/projects/fe9da5082ada4bdd8c3ba73b689f558c` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:42.905205 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139b3ffd-1392-449c-80bb-57d598bbfa26 None admin] RBAC: Authorizing `identity:get_project(project_id=fe9da5082ada4bdd8c3ba73b689f558c)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:42.906645 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139b3ffd-1392-449c-80bb-57d598bbfa26 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:42.908318 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 555/1116] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 9 20:12:42 2022] GET /identity/v3/projects/fe9da5082ada4bdd8c3ba73b689f558c => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:42.914434 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0044d6f8-1730-475a-acc5-9606b9f9baa5 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:43.005081 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0044d6f8-1730-475a-acc5-9606b9f9baa5 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:43.036834 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d62c2a0-9eff-412b-bcac-88fcede13c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:43.037399 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d62c2a0-9eff-412b-bcac-88fcede13c6d None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:43.037677 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d62c2a0-9eff-412b-bcac-88fcede13c6d None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:43.037948 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d62c2a0-9eff-412b-bcac-88fcede13c6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:43.038758 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d62c2a0-9eff-412b-bcac-88fcede13c6d None admin] RBAC: Adding query filter params (role.id=52c0c2910c294965839ef51e91b156a1, scope.project.id=fe9da5082ada4bdd8c3ba73b689f558c, user.id=66d104beed1f40c08b7d0d551ba7850e) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:43.039062 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d62c2a0-9eff-412b-bcac-88fcede13c6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:43.040513 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d62c2a0-9eff-412b-bcac-88fcede13c6d None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:43.045622 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 562/1117] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 9 20:12:42 2022] GET /identity/v3/role_assignments?user.id=66d104beed1f40c08b7d0d551ba7850e&scope.project.id=fe9da5082ada4bdd8c3ba73b689f558c&role.id=52c0c2910c294965839ef51e91b156a1 => generated 259 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:45.215494 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016cda6-648b-48e1-9b9f-af936383b7c7 None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:45.216055 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016cda6-648b-48e1-9b9f-af936383b7c7 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:45.216055 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016cda6-648b-48e1-9b9f-af936383b7c7 None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:45.217394 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 556/1118] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:12:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:12:45.222692 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26323337-24f9-4f7d-8ebd-6ea6271b2c1e None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:45.223093 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26323337-24f9-4f7d-8ebd-6ea6271b2c1e None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:45.223268 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26323337-24f9-4f7d-8ebd-6ea6271b2c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:45.239388 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-26323337-24f9-4f7d-8ebd-6ea6271b2c1e None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:12:45.240578 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-26323337-24f9-4f7d-8ebd-6ea6271b2c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:12:45.303307 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 563/1119] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:12:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 20:12:45.326280 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e016cda6-648b-48e1-9b9f-af936383b7c7 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:45.424146 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e016cda6-648b-48e1-9b9f-af936383b7c7 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:45.466793 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b135cc-545f-4974-9e18-d6d0a5584e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:45.467582 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b135cc-545f-4974-9e18-d6d0a5584e90 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:45.467855 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b135cc-545f-4974-9e18-d6d0a5584e90 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:45.471961 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b135cc-545f-4974-9e18-d6d0a5584e90 None admin] PATH_INFO: `/v3/roles/52c0c2910c294965839ef51e91b156a1` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:45.473426 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b135cc-545f-4974-9e18-d6d0a5584e90 None admin] RBAC: Authorizing `identity:get_role(role_id=52c0c2910c294965839ef51e91b156a1)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:45.474833 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b135cc-545f-4974-9e18-d6d0a5584e90 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:45.481874 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 557/1120] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 9 20:12:45 2022] GET /identity/v3/roles/52c0c2910c294965839ef51e91b156a1 => generated 223 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:45.488277 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26323337-24f9-4f7d-8ebd-6ea6271b2c1e None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:45.580318 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26323337-24f9-4f7d-8ebd-6ea6271b2c1e None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:45.612801 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9c077c-b0a9-4b22-b31f-d7dda55fd74b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:45.613651 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9c077c-b0a9-4b22-b31f-d7dda55fd74b None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:45.613931 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9c077c-b0a9-4b22-b31f-d7dda55fd74b None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:45.614202 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9c077c-b0a9-4b22-b31f-d7dda55fd74b None admin] PATH_INFO: `/v3/users/66d104beed1f40c08b7d0d551ba7850e` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:45.615375 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9c077c-b0a9-4b22-b31f-d7dda55fd74b None admin] RBAC: Authorizing `identity:get_user(user_id=66d104beed1f40c08b7d0d551ba7850e)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:45.616831 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9c077c-b0a9-4b22-b31f-d7dda55fd74b None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:45.618442 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 564/1121] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 9 20:12:45 2022] GET /identity/v3/users/66d104beed1f40c08b7d0d551ba7850e => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:45.624147 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b135cc-545f-4974-9e18-d6d0a5584e90 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:45.717087 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b135cc-545f-4974-9e18-d6d0a5584e90 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:45.748368 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de26b04a-993c-431b-a690-63733f519348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:45.749189 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de26b04a-993c-431b-a690-63733f519348 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:45.749460 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de26b04a-993c-431b-a690-63733f519348 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:45.749720 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de26b04a-993c-431b-a690-63733f519348 None admin] PATH_INFO: `/v3/projects/fe9da5082ada4bdd8c3ba73b689f558c` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:45.751432 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de26b04a-993c-431b-a690-63733f519348 None admin] RBAC: Authorizing `identity:get_project(project_id=fe9da5082ada4bdd8c3ba73b689f558c)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:45.752838 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de26b04a-993c-431b-a690-63733f519348 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:45.754484 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 558/1122] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 9 20:12:45 2022] GET /identity/v3/projects/fe9da5082ada4bdd8c3ba73b689f558c => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:45.760620 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9c077c-b0a9-4b22-b31f-d7dda55fd74b None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:45.854492 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9c077c-b0a9-4b22-b31f-d7dda55fd74b None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:45.886669 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e58754-f898-4534-a327-c830af7b4b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:45.887557 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e58754-f898-4534-a327-c830af7b4b5f None admin] REQUEST_METHOD: `PUT` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:45.887837 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e58754-f898-4534-a327-c830af7b4b5f None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:45.888108 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e58754-f898-4534-a327-c830af7b4b5f None admin] PATH_INFO: `/v3/projects/fe9da5082ada4bdd8c3ba73b689f558c/users/66d104beed1f40c08b7d0d551ba7850e/roles/52c0c2910c294965839ef51e91b156a1` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:45.890254 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e58754-f898-4534-a327-c830af7b4b5f None admin] RBAC: Authorizing `identity:create_grant(project_id=fe9da5082ada4bdd8c3ba73b689f558c, user_id=66d104beed1f40c08b7d0d551ba7850e, role_id=52c0c2910c294965839ef51e91b156a1)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:45.892316 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e58754-f898-4534-a327-c830af7b4b5f None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:45.904084 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 565/1123] 10.222.0.44 () {58 vars in 1439 bytes} [Mon May 9 20:12:45 2022] PUT /identity/v3/projects/fe9da5082ada4bdd8c3ba73b689f558c/users/66d104beed1f40c08b7d0d551ba7850e/roles/52c0c2910c294965839ef51e91b156a1 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:12:48.121421 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d0c77e-d9f2-4763-bc08-7d8b9ea071c0 None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:48.121955 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d0c77e-d9f2-4763-bc08-7d8b9ea071c0 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:48.121955 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d0c77e-d9f2-4763-bc08-7d8b9ea071c0 None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:48.123309 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 559/1124] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:12:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:12:48.129253 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2db569-c9cd-4c4f-aa0d-ad4522d68d02 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:48.129631 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2db569-c9cd-4c4f-aa0d-ad4522d68d02 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:48.129805 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2db569-c9cd-4c4f-aa0d-ad4522d68d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:48.146769 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-8e2db569-c9cd-4c4f-aa0d-ad4522d68d02 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:12:48.147987 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-8e2db569-c9cd-4c4f-aa0d-ad4522d68d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:12:48.209883 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 566/1125] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:12:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 20:12:48.233205 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d0c77e-d9f2-4763-bc08-7d8b9ea071c0 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:48.327437 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d0c77e-d9f2-4763-bc08-7d8b9ea071c0 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:48.357970 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb293414-8a3c-431b-950d-03ea613d7ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:48.358783 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb293414-8a3c-431b-950d-03ea613d7ef9 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:48.359056 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb293414-8a3c-431b-950d-03ea613d7ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:48.359959 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb293414-8a3c-431b-950d-03ea613d7ef9 None admin] PATH_INFO: `/v3/roles/52c0c2910c294965839ef51e91b156a1` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:48.361318 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb293414-8a3c-431b-950d-03ea613d7ef9 None admin] RBAC: Authorizing `identity:get_role(role_id=52c0c2910c294965839ef51e91b156a1)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:48.362664 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb293414-8a3c-431b-950d-03ea613d7ef9 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:48.364011 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 560/1126] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 9 20:12:48 2022] GET /identity/v3/roles/52c0c2910c294965839ef51e91b156a1 => generated 223 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:48.369666 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2db569-c9cd-4c4f-aa0d-ad4522d68d02 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:48.462545 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2db569-c9cd-4c4f-aa0d-ad4522d68d02 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:48.493950 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a9f4f-5792-496a-8a17-afa92399f204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:48.494793 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a9f4f-5792-496a-8a17-afa92399f204 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:48.495071 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a9f4f-5792-496a-8a17-afa92399f204 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:48.495340 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a9f4f-5792-496a-8a17-afa92399f204 None admin] PATH_INFO: `/v3/users/66d104beed1f40c08b7d0d551ba7850e` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:48.496538 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48a9f4f-5792-496a-8a17-afa92399f204 None admin] RBAC: Authorizing `identity:get_user(user_id=66d104beed1f40c08b7d0d551ba7850e)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:48.497953 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48a9f4f-5792-496a-8a17-afa92399f204 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:48.499602 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 567/1127] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 9 20:12:48 2022] GET /identity/v3/users/66d104beed1f40c08b7d0d551ba7850e => generated 286 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:48.506323 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb293414-8a3c-431b-950d-03ea613d7ef9 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:48.598746 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb293414-8a3c-431b-950d-03ea613d7ef9 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:48.631707 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32818c4-746f-4dd8-ae0b-3c30d9d6faf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:48.632331 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32818c4-746f-4dd8-ae0b-3c30d9d6faf3 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:48.632605 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32818c4-746f-4dd8-ae0b-3c30d9d6faf3 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:48.632872 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32818c4-746f-4dd8-ae0b-3c30d9d6faf3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:48.694366 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32818c4-746f-4dd8-ae0b-3c30d9d6faf3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:48.695819 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32818c4-746f-4dd8-ae0b-3c30d9d6faf3 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:48.785290 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 561/1128] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 9 20:12:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 20:12:48.791173 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a9f4f-5792-496a-8a17-afa92399f204 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:48.882520 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a9f4f-5792-496a-8a17-afa92399f204 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:48.913667 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad9eb4-7cad-4613-a685-26d79f673857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:48.914498 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad9eb4-7cad-4613-a685-26d79f673857 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:48.914769 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad9eb4-7cad-4613-a685-26d79f673857 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:48.915033 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad9eb4-7cad-4613-a685-26d79f673857 None admin] PATH_INFO: `/v3/projects/fe9da5082ada4bdd8c3ba73b689f558c` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:48.916204 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ad9eb4-7cad-4613-a685-26d79f673857 None admin] RBAC: Authorizing `identity:get_project(project_id=fe9da5082ada4bdd8c3ba73b689f558c)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:48.917606 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ad9eb4-7cad-4613-a685-26d79f673857 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:48.919252 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 568/1129] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 9 20:12:48 2022] GET /identity/v3/projects/fe9da5082ada4bdd8c3ba73b689f558c => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:48.925585 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32818c4-746f-4dd8-ae0b-3c30d9d6faf3 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:49.015929 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32818c4-746f-4dd8-ae0b-3c30d9d6faf3 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:49.047429 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c72c803-b584-462f-b8a7-86028a4fc85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:49.048110 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c72c803-b584-462f-b8a7-86028a4fc85a None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:49.048381 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c72c803-b584-462f-b8a7-86028a4fc85a None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:49.048642 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c72c803-b584-462f-b8a7-86028a4fc85a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:49.049445 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c72c803-b584-462f-b8a7-86028a4fc85a None admin] RBAC: Adding query filter params (role.id=52c0c2910c294965839ef51e91b156a1, scope.project.id=fe9da5082ada4bdd8c3ba73b689f558c, user.id=66d104beed1f40c08b7d0d551ba7850e) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:49.049744 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c72c803-b584-462f-b8a7-86028a4fc85a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:49.051139 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c72c803-b584-462f-b8a7-86028a4fc85a None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:49.056587 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 562/1130] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 9 20:12:48 2022] GET /identity/v3/role_assignments?user.id=66d104beed1f40c08b7d0d551ba7850e&scope.project.id=fe9da5082ada4bdd8c3ba73b689f558c&role.id=52c0c2910c294965839ef51e91b156a1 => generated 608 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:51.261014 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b035a-cf72-4796-b2ae-6946ba6f6873 None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:51.261562 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b035a-cf72-4796-b2ae-6946ba6f6873 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:51.261562 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b035a-cf72-4796-b2ae-6946ba6f6873 None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:51.262908 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 569/1131] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:12:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:12:51.268356 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ea133-d9ca-4adf-911a-3aea00700a4b None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:51.268754 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ea133-d9ca-4adf-911a-3aea00700a4b None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:51.268897 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ea133-d9ca-4adf-911a-3aea00700a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:51.285727 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-bd7ea133-d9ca-4adf-911a-3aea00700a4b None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:12:51.286896 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-bd7ea133-d9ca-4adf-911a-3aea00700a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:12:51.348755 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 563/1132] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:12:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 20:12:51.371756 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2b035a-cf72-4796-b2ae-6946ba6f6873 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:51.466921 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2b035a-cf72-4796-b2ae-6946ba6f6873 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:51.499883 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cbe9ae-5e0a-4372-b2cb-2da2c5fa0f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:51.500650 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cbe9ae-5e0a-4372-b2cb-2da2c5fa0f9a None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:51.500931 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cbe9ae-5e0a-4372-b2cb-2da2c5fa0f9a None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:51.501204 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cbe9ae-5e0a-4372-b2cb-2da2c5fa0f9a None admin] PATH_INFO: `/v3/domains/default` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:51.502357 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cbe9ae-5e0a-4372-b2cb-2da2c5fa0f9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:51.503802 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cbe9ae-5e0a-4372-b2cb-2da2c5fa0f9a None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:51.505401 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 570/1133] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:12:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:51.511521 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7ea133-d9ca-4adf-911a-3aea00700a4b None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:51.602837 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7ea133-d9ca-4adf-911a-3aea00700a4b None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:51.633741 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6220e1-d0db-4f3f-b42d-143ae754b307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:51.634372 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6220e1-d0db-4f3f-b42d-143ae754b307 None admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:51.634646 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6220e1-d0db-4f3f-b42d-143ae754b307 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:51.634909 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6220e1-d0db-4f3f-b42d-143ae754b307 None admin] PATH_INFO: `/v3/projects` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:51.635628 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6220e1-d0db-4f3f-b42d-143ae754b307 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:51.637036 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6220e1-d0db-4f3f-b42d-143ae754b307 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:51.662964 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 564/1134] 10.222.0.44 () {60 vars in 1141 bytes} [Mon May 9 20:12:51 2022] POST /identity/v3/projects => generated 311 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:12:53.897209 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb6fb4-bbc9-4001-b359-99799aaefa70 None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:53.897728 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb6fb4-bbc9-4001-b359-99799aaefa70 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:53.897728 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb6fb4-bbc9-4001-b359-99799aaefa70 None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:53.899025 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 571/1135] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:12:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:12:53.904466 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de352f-6f4b-4a62-81af-b724958ce892 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:53.904893 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de352f-6f4b-4a62-81af-b724958ce892 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:53.905021 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de352f-6f4b-4a62-81af-b724958ce892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:53.921703 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-41de352f-6f4b-4a62-81af-b724958ce892 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:12:53.922867 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-41de352f-6f4b-4a62-81af-b724958ce892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:12:53.984203 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 565/1136] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:12:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 20:12:54.008785 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fb6fb4-bbc9-4001-b359-99799aaefa70 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:54.102728 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fb6fb4-bbc9-4001-b359-99799aaefa70 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:54.135129 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95004a04-1956-405b-bc60-2eda661fff38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:54.135924 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95004a04-1956-405b-bc60-2eda661fff38 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:54.136204 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95004a04-1956-405b-bc60-2eda661fff38 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:54.136476 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95004a04-1956-405b-bc60-2eda661fff38 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:54.137623 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95004a04-1956-405b-bc60-2eda661fff38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:54.139067 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95004a04-1956-405b-bc60-2eda661fff38 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:54.141299 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 572/1137] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:12:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:54.147004 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41de352f-6f4b-4a62-81af-b724958ce892 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:54.236868 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41de352f-6f4b-4a62-81af-b724958ce892 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:54.269121 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9638ef72-2362-4234-9f70-ad2063260abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:54.269756 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9638ef72-2362-4234-9f70-ad2063260abf None admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:54.270031 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9638ef72-2362-4234-9f70-ad2063260abf None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:54.270298 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9638ef72-2362-4234-9f70-ad2063260abf None admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:54.270987 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9638ef72-2362-4234-9f70-ad2063260abf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:54.272433 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9638ef72-2362-4234-9f70-ad2063260abf None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:54.290906 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 566/1138] 10.222.0.44 () {60 vars in 1132 bytes} [Mon May 9 20:12:54 2022] POST /identity/v3/users => generated 286 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 20:12:56.533640 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd69501c-f8d0-4e6c-b6e1-84bcc6f47f5d None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:56.534170 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd69501c-f8d0-4e6c-b6e1-84bcc6f47f5d None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:56.534170 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd69501c-f8d0-4e6c-b6e1-84bcc6f47f5d None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:56.535554 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 573/1139] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:12:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:12:56.540890 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a93a32-ffe3-4bfd-ac16-23122eff6e4a None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:56.541310 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a93a32-ffe3-4bfd-ac16-23122eff6e4a None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:56.541418 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a93a32-ffe3-4bfd-ac16-23122eff6e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:56.558217 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-50a93a32-ffe3-4bfd-ac16-23122eff6e4a None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:12:56.559375 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-50a93a32-ffe3-4bfd-ac16-23122eff6e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:12:56.622241 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 567/1140] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:12:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 20:12:56.646127 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd69501c-f8d0-4e6c-b6e1-84bcc6f47f5d None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:56.741182 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd69501c-f8d0-4e6c-b6e1-84bcc6f47f5d None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:56.772678 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a503096c-4703-46d1-a2ae-8b302d0f415e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:56.773442 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a503096c-4703-46d1-a2ae-8b302d0f415e None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:56.773726 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a503096c-4703-46d1-a2ae-8b302d0f415e None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:56.773996 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a503096c-4703-46d1-a2ae-8b302d0f415e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:56.784121 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a503096c-4703-46d1-a2ae-8b302d0f415e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:12:56.791739 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-a503096c-4703-46d1-a2ae-8b302d0f415e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 20:12:56.791739 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:12:56.791739 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:12:56.791739 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:12:56.791739 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:12:56.791739 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:12:56.791739 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:12:56.791739 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:12:56.791739 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:12:56.791739 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:12:56.791739 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:12:56.791739 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:12:56.791739 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:12:56.791739 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:12:56.791739 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:12:56.791739 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:12:56.792888 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:12:56.792888 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:12:56.792888 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:12:56.792888 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:12:56.792888 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:12:56.792888 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:12:56.792888 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:12:56.792888 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:12:56.792888 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:12:56.792888 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:12:56.792888 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:12:56.792888 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:12:56.792888 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:12:56.792888 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:12:56.792888 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:12:56.792888 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:12:56.794141 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:12:56.794141 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:12:56.794141 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:12:56.794141 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:12:56.794141 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:12:56.794141 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:12:56.794141 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:12:56.794141 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:12:56.794141 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:12:56.794141 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:12:56.794141 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 20:12:56.794141 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:12:56.794141 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 574/1141] 10.222.0.44 () {56 vars in 1096 bytes} [Mon May 9 20:12:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:12:56.798835 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a93a32-ffe3-4bfd-ac16-23122eff6e4a None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:56.889251 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a93a32-ffe3-4bfd-ac16-23122eff6e4a None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:56.921165 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3be861-0308-4d07-8e64-0be832f690ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:56.921941 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3be861-0308-4d07-8e64-0be832f690ab None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:56.922218 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3be861-0308-4d07-8e64-0be832f690ab None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:56.922483 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3be861-0308-4d07-8e64-0be832f690ab None admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:56.923206 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3be861-0308-4d07-8e64-0be832f690ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:56.923535 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3be861-0308-4d07-8e64-0be832f690ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:56.924886 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3be861-0308-4d07-8e64-0be832f690ab None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:56.932330 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 568/1142] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 9 20:12:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:56.938535 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a503096c-4703-46d1-a2ae-8b302d0f415e None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:57.031668 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a503096c-4703-46d1-a2ae-8b302d0f415e None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:57.062674 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d00633e-4d34-454c-9c79-7b613d29d4ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:57.063458 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d00633e-4d34-454c-9c79-7b613d29d4ef None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:57.063737 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d00633e-4d34-454c-9c79-7b613d29d4ef None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:57.064004 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d00633e-4d34-454c-9c79-7b613d29d4ef None admin] PATH_INFO: `/v3/users/144f296cefd34ad5a85682b332fb73e1` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:57.077015 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d00633e-4d34-454c-9c79-7b613d29d4ef None admin] RBAC: Authorizing `identity:get_user(user_id=144f296cefd34ad5a85682b332fb73e1)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:57.079072 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d00633e-4d34-454c-9c79-7b613d29d4ef None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:57.080786 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 575/1143] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 9 20:12:56 2022] GET /identity/v3/users/144f296cefd34ad5a85682b332fb73e1 => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:57.086515 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3be861-0308-4d07-8e64-0be832f690ab None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:57.178880 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3be861-0308-4d07-8e64-0be832f690ab None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:57.210409 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb2f579-05c4-42da-8657-0b9216caf951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:57.211033 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb2f579-05c4-42da-8657-0b9216caf951 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:57.211310 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb2f579-05c4-42da-8657-0b9216caf951 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:57.211607 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb2f579-05c4-42da-8657-0b9216caf951 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:57.272319 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb2f579-05c4-42da-8657-0b9216caf951 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:57.273740 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb2f579-05c4-42da-8657-0b9216caf951 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:57.363791 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 569/1144] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 9 20:12:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 20:12:57.369588 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d00633e-4d34-454c-9c79-7b613d29d4ef None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:57.460790 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d00633e-4d34-454c-9c79-7b613d29d4ef None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:57.492616 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae2ec93-41c8-41ff-b8ff-123b1c7db885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:57.493443 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae2ec93-41c8-41ff-b8ff-123b1c7db885 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:57.493720 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae2ec93-41c8-41ff-b8ff-123b1c7db885 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:57.493987 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae2ec93-41c8-41ff-b8ff-123b1c7db885 None admin] PATH_INFO: `/v3/projects/792d42bfa60741dca23fa06df7e73ce3` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:57.495147 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae2ec93-41c8-41ff-b8ff-123b1c7db885 None admin] RBAC: Authorizing `identity:get_project(project_id=792d42bfa60741dca23fa06df7e73ce3)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:57.496608 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae2ec93-41c8-41ff-b8ff-123b1c7db885 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:57.498277 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 576/1145] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 9 20:12:57 2022] GET /identity/v3/projects/792d42bfa60741dca23fa06df7e73ce3 => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:57.504529 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb2f579-05c4-42da-8657-0b9216caf951 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:12:57.597159 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb2f579-05c4-42da-8657-0b9216caf951 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:12:57.627934 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50f381c-a24e-47b2-a58b-c23478ce331f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:12:57.628505 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f381c-a24e-47b2-a58b-c23478ce331f None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:57.628777 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f381c-a24e-47b2-a58b-c23478ce331f None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:57.629043 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f381c-a24e-47b2-a58b-c23478ce331f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:57.629848 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50f381c-a24e-47b2-a58b-c23478ce331f None admin] RBAC: Adding query filter params (role.id=274130b78e304bb88789c1b349263f3c, scope.project.id=792d42bfa60741dca23fa06df7e73ce3, user.id=144f296cefd34ad5a85682b332fb73e1) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:12:57.630149 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50f381c-a24e-47b2-a58b-c23478ce331f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:12:57.631924 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50f381c-a24e-47b2-a58b-c23478ce331f None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:12:57.636985 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 570/1146] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 9 20:12:57 2022] GET /identity/v3/role_assignments?user.id=144f296cefd34ad5a85682b332fb73e1&scope.project.id=792d42bfa60741dca23fa06df7e73ce3&role.id=274130b78e304bb88789c1b349263f3c => generated 259 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:12:59.819450 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89c29f-6334-4007-aeef-4b71f989523d None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:59.819998 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89c29f-6334-4007-aeef-4b71f989523d None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:59.819998 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89c29f-6334-4007-aeef-4b71f989523d None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:59.821354 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 577/1147] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:12:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:12:59.826409 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acb3def-aa18-43ed-8402-8af803b41161 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:12:59.826847 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acb3def-aa18-43ed-8402-8af803b41161 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:12:59.826962 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acb3def-aa18-43ed-8402-8af803b41161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:12:59.845193 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-6acb3def-aa18-43ed-8402-8af803b41161 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:12:59.846287 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-6acb3def-aa18-43ed-8402-8af803b41161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:12:59.907920 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 571/1148] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:12:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 20:12:59.929956 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df89c29f-6334-4007-aeef-4b71f989523d None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:13:00.023553 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df89c29f-6334-4007-aeef-4b71f989523d None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:13:00.054663 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab70d1-a5b7-4811-8964-98993f257663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:13:00.055439 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab70d1-a5b7-4811-8964-98993f257663 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:13:00.055724 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab70d1-a5b7-4811-8964-98993f257663 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:13:00.055998 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab70d1-a5b7-4811-8964-98993f257663 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:13:00.065893 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ab70d1-a5b7-4811-8964-98993f257663 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:13:00.073365 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-51ab70d1-a5b7-4811-8964-98993f257663 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 20:13:00.073365 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:13:00.073365 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:13:00.073365 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:13:00.073365 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:13:00.073365 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:13:00.073365 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:13:00.073365 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:13:00.073365 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:13:00.073365 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:13:00.073365 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:13:00.073365 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:13:00.073365 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:13:00.073365 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:13:00.073365 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:13:00.073365 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:13:00.074432 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:13:00.074432 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:13:00.074432 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:13:00.074432 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:13:00.074432 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:13:00.074432 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:13:00.074432 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:13:00.074432 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:13:00.074432 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:13:00.074432 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:13:00.074432 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:13:00.074432 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:13:00.074432 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:13:00.074432 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:13:00.074432 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:13:00.074432 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:13:00.075318 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:13:00.075318 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:13:00.075318 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:13:00.075318 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:13:00.075318 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:13:00.075318 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:13:00.075318 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:13:00.075318 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:13:00.075318 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:13:00.075318 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:13:00.075318 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 20:13:00.075318 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:13:00.075318 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 578/1149] 10.222.0.44 () {56 vars in 1096 bytes} [Mon May 9 20:12:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:13:00.081253 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acb3def-aa18-43ed-8402-8af803b41161 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:13:00.172371 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acb3def-aa18-43ed-8402-8af803b41161 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:13:00.204105 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc11be6f-4826-4022-8aa3-6f2cf5fdb7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:13:00.204742 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc11be6f-4826-4022-8aa3-6f2cf5fdb7a4 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:13:00.205015 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc11be6f-4826-4022-8aa3-6f2cf5fdb7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:13:00.205278 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc11be6f-4826-4022-8aa3-6f2cf5fdb7a4 None admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:13:00.206000 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc11be6f-4826-4022-8aa3-6f2cf5fdb7a4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:13:00.206294 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc11be6f-4826-4022-8aa3-6f2cf5fdb7a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:13:00.207665 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc11be6f-4826-4022-8aa3-6f2cf5fdb7a4 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:13:00.215100 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 572/1150] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 9 20:13:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:13:00.220934 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab70d1-a5b7-4811-8964-98993f257663 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:13:00.313714 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab70d1-a5b7-4811-8964-98993f257663 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:13:00.344657 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b2f68b-f38a-4dd8-868d-92d465942e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:13:00.345490 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b2f68b-f38a-4dd8-868d-92d465942e78 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:13:00.345769 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b2f68b-f38a-4dd8-868d-92d465942e78 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:13:00.346039 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b2f68b-f38a-4dd8-868d-92d465942e78 None admin] PATH_INFO: `/v3/users/144f296cefd34ad5a85682b332fb73e1` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:13:00.347188 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b2f68b-f38a-4dd8-868d-92d465942e78 None admin] RBAC: Authorizing `identity:get_user(user_id=144f296cefd34ad5a85682b332fb73e1)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:13:00.348636 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b2f68b-f38a-4dd8-868d-92d465942e78 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:13:00.350245 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 579/1151] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 9 20:13:00 2022] GET /identity/v3/users/144f296cefd34ad5a85682b332fb73e1 => generated 286 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:13:00.355836 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc11be6f-4826-4022-8aa3-6f2cf5fdb7a4 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:13:00.451684 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc11be6f-4826-4022-8aa3-6f2cf5fdb7a4 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:13:00.482384 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d41d8b-bc12-4adb-9fb6-c0789dc06a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:13:00.483218 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d41d8b-bc12-4adb-9fb6-c0789dc06a8a None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:13:00.483532 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d41d8b-bc12-4adb-9fb6-c0789dc06a8a None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:13:00.483799 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d41d8b-bc12-4adb-9fb6-c0789dc06a8a None admin] PATH_INFO: `/v3/projects/792d42bfa60741dca23fa06df7e73ce3` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:13:00.485661 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d41d8b-bc12-4adb-9fb6-c0789dc06a8a None admin] RBAC: Authorizing `identity:get_project(project_id=792d42bfa60741dca23fa06df7e73ce3)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:13:00.487070 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d41d8b-bc12-4adb-9fb6-c0789dc06a8a None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:13:00.488760 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 573/1152] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 9 20:13:00 2022] GET /identity/v3/projects/792d42bfa60741dca23fa06df7e73ce3 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:13:00.494834 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b2f68b-f38a-4dd8-868d-92d465942e78 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:13:00.590382 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b2f68b-f38a-4dd8-868d-92d465942e78 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:13:00.621682 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91010a2a-ab83-4ced-bf58-9a7232924331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:13:00.622535 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91010a2a-ab83-4ced-bf58-9a7232924331 None admin] REQUEST_METHOD: `PUT` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:13:00.622809 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91010a2a-ab83-4ced-bf58-9a7232924331 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:13:00.623074 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91010a2a-ab83-4ced-bf58-9a7232924331 None admin] PATH_INFO: `/v3/projects/792d42bfa60741dca23fa06df7e73ce3/users/144f296cefd34ad5a85682b332fb73e1/roles/274130b78e304bb88789c1b349263f3c` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:13:00.625782 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91010a2a-ab83-4ced-bf58-9a7232924331 None admin] RBAC: Authorizing `identity:create_grant(project_id=792d42bfa60741dca23fa06df7e73ce3, user_id=144f296cefd34ad5a85682b332fb73e1, role_id=274130b78e304bb88789c1b349263f3c)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:13:00.627199 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91010a2a-ab83-4ced-bf58-9a7232924331 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:13:00.639317 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 580/1153] 10.222.0.44 () {58 vars in 1439 bytes} [Mon May 9 20:13:00 2022] PUT /identity/v3/projects/792d42bfa60741dca23fa06df7e73ce3/users/144f296cefd34ad5a85682b332fb73e1/roles/274130b78e304bb88789c1b349263f3c => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:13:02.822823 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2545757-c58c-4452-a139-1dee82bdfc9b None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:13:02.823369 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2545757-c58c-4452-a139-1dee82bdfc9b None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:13:02.823369 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2545757-c58c-4452-a139-1dee82bdfc9b None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:13:02.824751 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 574/1154] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:13:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:13:02.830714 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fbfd23-b979-43e6-a51d-70de5994c5da None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:13:02.831120 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fbfd23-b979-43e6-a51d-70de5994c5da None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:13:02.831219 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fbfd23-b979-43e6-a51d-70de5994c5da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:13:02.847931 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-a9fbfd23-b979-43e6-a51d-70de5994c5da None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:13:02.849108 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-a9fbfd23-b979-43e6-a51d-70de5994c5da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:13:02.910958 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 581/1155] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:13:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 20:13:02.933742 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2545757-c58c-4452-a139-1dee82bdfc9b None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:13:03.028048 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2545757-c58c-4452-a139-1dee82bdfc9b None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:13:03.058449 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ff0864-c6b4-4b96-87a2-ba1b10d89e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:13:03.059202 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff0864-c6b4-4b96-87a2-ba1b10d89e4a None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:13:03.059503 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff0864-c6b4-4b96-87a2-ba1b10d89e4a None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:13:03.059771 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff0864-c6b4-4b96-87a2-ba1b10d89e4a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:13:03.069590 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ff0864-c6b4-4b96-87a2-ba1b10d89e4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:13:03.076934 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-54ff0864-c6b4-4b96-87a2-ba1b10d89e4a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 20:13:03.076934 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:13:03.076934 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:13:03.076934 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:13:03.076934 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:13:03.076934 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:13:03.076934 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:13:03.076934 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:13:03.076934 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:13:03.076934 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:13:03.076934 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:13:03.076934 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:13:03.076934 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:13:03.076934 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:13:03.076934 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:13:03.076934 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:13:03.078423 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:13:03.078423 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:13:03.078423 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:13:03.078423 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:13:03.078423 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:13:03.078423 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:13:03.078423 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:13:03.078423 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:13:03.078423 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:13:03.078423 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:13:03.078423 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:13:03.078423 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:13:03.078423 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:13:03.078423 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:13:03.078423 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:13:03.078423 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:13:03.079388 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:13:03.079388 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:13:03.079388 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:13:03.079388 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:13:03.079388 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:13:03.079388 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:13:03.079388 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:13:03.079388 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:13:03.079388 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:13:03.079388 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:13:03.079388 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 20:13:03.079388 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:13:03.079388 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 575/1156] 10.222.0.44 () {56 vars in 1096 bytes} [Mon May 9 20:13:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:13:03.083998 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fbfd23-b979-43e6-a51d-70de5994c5da None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:13:03.175319 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fbfd23-b979-43e6-a51d-70de5994c5da None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:13:03.206149 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2be358-e6d6-4bd1-9cb4-abf3414ea24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:13:03.206792 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2be358-e6d6-4bd1-9cb4-abf3414ea24f None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:13:03.207069 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2be358-e6d6-4bd1-9cb4-abf3414ea24f None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:13:03.207349 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2be358-e6d6-4bd1-9cb4-abf3414ea24f None admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:13:03.208114 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2be358-e6d6-4bd1-9cb4-abf3414ea24f None admin] RBAC: Adding query filter params (name=admin) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:13:03.208416 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2be358-e6d6-4bd1-9cb4-abf3414ea24f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:13:03.209763 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2be358-e6d6-4bd1-9cb4-abf3414ea24f None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:13:03.217287 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 582/1157] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 9 20:13:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:13:03.223500 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ff0864-c6b4-4b96-87a2-ba1b10d89e4a None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:13:03.314952 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ff0864-c6b4-4b96-87a2-ba1b10d89e4a None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:13:03.346270 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b9359-284d-45c1-ad57-d76b673bd3dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:13:03.347044 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b9359-284d-45c1-ad57-d76b673bd3dd None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:13:03.347315 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b9359-284d-45c1-ad57-d76b673bd3dd None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:13:03.347606 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b9359-284d-45c1-ad57-d76b673bd3dd None admin] PATH_INFO: `/v3/users/144f296cefd34ad5a85682b332fb73e1` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:13:03.348751 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838b9359-284d-45c1-ad57-d76b673bd3dd None admin] RBAC: Authorizing `identity:get_user(user_id=144f296cefd34ad5a85682b332fb73e1)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:13:03.350164 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838b9359-284d-45c1-ad57-d76b673bd3dd None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:13:03.351772 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 576/1158] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 9 20:13:03 2022] GET /identity/v3/users/144f296cefd34ad5a85682b332fb73e1 => generated 286 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:13:03.357335 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2be358-e6d6-4bd1-9cb4-abf3414ea24f None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:13:03.449726 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2be358-e6d6-4bd1-9cb4-abf3414ea24f None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:13:03.481862 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdf91a0-eee4-4e13-975d-55cf414a9024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:13:03.482487 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf91a0-eee4-4e13-975d-55cf414a9024 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:13:03.482767 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf91a0-eee4-4e13-975d-55cf414a9024 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:13:03.483039 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf91a0-eee4-4e13-975d-55cf414a9024 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:13:03.546553 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdf91a0-eee4-4e13-975d-55cf414a9024 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:13:03.548020 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdf91a0-eee4-4e13-975d-55cf414a9024 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:13:03.638957 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 583/1159] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 9 20:13:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 20:13:03.645349 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b9359-284d-45c1-ad57-d76b673bd3dd None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:13:03.739405 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b9359-284d-45c1-ad57-d76b673bd3dd None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:13:03.771493 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0849d5ea-6be8-4e76-bf3b-d26007cacd54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:13:03.772320 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0849d5ea-6be8-4e76-bf3b-d26007cacd54 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:13:03.772594 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0849d5ea-6be8-4e76-bf3b-d26007cacd54 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:13:03.772860 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0849d5ea-6be8-4e76-bf3b-d26007cacd54 None admin] PATH_INFO: `/v3/projects/792d42bfa60741dca23fa06df7e73ce3` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:13:03.773996 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0849d5ea-6be8-4e76-bf3b-d26007cacd54 None admin] RBAC: Authorizing `identity:get_project(project_id=792d42bfa60741dca23fa06df7e73ce3)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:13:03.775436 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0849d5ea-6be8-4e76-bf3b-d26007cacd54 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:13:03.777085 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 577/1160] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 9 20:13:03 2022] GET /identity/v3/projects/792d42bfa60741dca23fa06df7e73ce3 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:13:03.783067 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdf91a0-eee4-4e13-975d-55cf414a9024 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:13:03.872706 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdf91a0-eee4-4e13-975d-55cf414a9024 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:13:03.904808 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6a923d-d772-454f-bd3f-eecbdeb44153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:13:03.905373 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a923d-d772-454f-bd3f-eecbdeb44153 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:13:03.905647 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a923d-d772-454f-bd3f-eecbdeb44153 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:13:03.906504 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a923d-d772-454f-bd3f-eecbdeb44153 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:13:03.907444 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6a923d-d772-454f-bd3f-eecbdeb44153 None admin] RBAC: Adding query filter params (role.id=274130b78e304bb88789c1b349263f3c, scope.project.id=792d42bfa60741dca23fa06df7e73ce3, user.id=144f296cefd34ad5a85682b332fb73e1) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:13:03.907753 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6a923d-d772-454f-bd3f-eecbdeb44153 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:13:03.909159 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6a923d-d772-454f-bd3f-eecbdeb44153 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:13:03.914596 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 584/1161] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 9 20:13:03 2022] GET /identity/v3/role_assignments?user.id=144f296cefd34ad5a85682b332fb73e1&scope.project.id=792d42bfa60741dca23fa06df7e73ce3&role.id=274130b78e304bb88789c1b349263f3c => generated 608 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:13:06.128381 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cffed09-d7a2-41e6-b47a-8a7ea2848707 None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:13:06.128913 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cffed09-d7a2-41e6-b47a-8a7ea2848707 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:13:06.128913 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cffed09-d7a2-41e6-b47a-8a7ea2848707 None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:13:06.130233 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 578/1162] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:13:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:13:06.135838 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee8a47-72f8-4857-a720-668e6b6f724c None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:13:06.136268 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee8a47-72f8-4857-a720-668e6b6f724c None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:13:06.136387 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee8a47-72f8-4857-a720-668e6b6f724c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:13:06.152603 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-eeee8a47-72f8-4857-a720-668e6b6f724c None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:13:06.153776 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-eeee8a47-72f8-4857-a720-668e6b6f724c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:13:06.216666 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 585/1163] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:13:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 20:13:06.239372 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cffed09-d7a2-41e6-b47a-8a7ea2848707 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:13:06.334892 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cffed09-d7a2-41e6-b47a-8a7ea2848707 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:13:06.366127 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff77b4-4424-4fca-b2e1-076ae415a843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:13:06.366778 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff77b4-4424-4fca-b2e1-076ae415a843 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:13:06.367021 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff77b4-4424-4fca-b2e1-076ae415a843 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:13:06.367292 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff77b4-4424-4fca-b2e1-076ae415a843 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:13:06.428622 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ff77b4-4424-4fca-b2e1-076ae415a843 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:13:06.429995 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ff77b4-4424-4fca-b2e1-076ae415a843 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:13:06.525422 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 579/1164] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 9 20:13:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 20:13:06.532013 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee8a47-72f8-4857-a720-668e6b6f724c None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:13:06.622557 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee8a47-72f8-4857-a720-668e6b6f724c None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:13:06.654057 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376549c2-757d-412d-9aeb-4f5c8f75908a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:13:06.654830 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376549c2-757d-412d-9aeb-4f5c8f75908a None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:13:06.655108 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376549c2-757d-412d-9aeb-4f5c8f75908a None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:13:06.655382 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376549c2-757d-412d-9aeb-4f5c8f75908a None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:13:06.662303 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376549c2-757d-412d-9aeb-4f5c8f75908a None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:13:06.663759 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376549c2-757d-412d-9aeb-4f5c8f75908a None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:13:06.677301 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-376549c2-757d-412d-9aeb-4f5c8f75908a None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 09 20:13:06.677301 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:13:06.677301 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 09 20:13:06.677301 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 09 20:13:06.677301 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 20:13:06.677301 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 20:13:06.677301 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 20:13:06.677301 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 20:13:06.677301 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 09 20:13:06.677301 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:13:06.677301 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 20:13:06.677301 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:13:06.677301 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:13:06.677301 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:13:06.677301 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:13:06.677301 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:13:06.677301 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:13:06.678470 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:13:06.678470 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:13:06.678470 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:13:06.678470 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:13:06.678470 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:13:06.678470 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:13:06.678470 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 20:13:06.678470 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 20:13:06.678470 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 20:13:06.678470 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 20:13:06.678470 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:13:06.678470 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:13:06.678470 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:13:06.678470 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:13:06.678470 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:13:06.678470 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:13:06.679808 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:13:06.679808 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:13:06.679808 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:13:06.679808 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:13:06.679808 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:13:06.679808 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:13:06.679808 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:13:06.679808 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:13:06.679808 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:13:06.679808 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:13:06.679808 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 09 20:13:06.679808 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 20:13:06.679808 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 09 20:13:06.679808 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:13:06.679808 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 586/1165] 10.222.0.44 () {56 vars in 1117 bytes} [Mon May 9 20:13:06 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:13:06.684375 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff77b4-4424-4fca-b2e1-076ae415a843 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:13:06.778242 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff77b4-4424-4fca-b2e1-076ae415a843 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:13:06.809561 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10be7aa-760c-40f9-b5d3-f342e8927a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:13:06.810203 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10be7aa-760c-40f9-b5d3-f342e8927a88 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:13:06.810482 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10be7aa-760c-40f9-b5d3-f342e8927a88 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:13:06.810753 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10be7aa-760c-40f9-b5d3-f342e8927a88 None admin] PATH_INFO: `/v3/domains` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:13:06.811506 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10be7aa-760c-40f9-b5d3-f342e8927a88 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:13:06.811812 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10be7aa-760c-40f9-b5d3-f342e8927a88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:13:06.813743 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10be7aa-760c-40f9-b5d3-f342e8927a88 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:13:06.820471 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 580/1166] 10.222.0.44 () {56 vars in 1115 bytes} [Mon May 9 20:13:06 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:13:09.010191 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201cb571-456a-45bb-8c5c-d539db593cc4 None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:13:09.010773 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201cb571-456a-45bb-8c5c-d539db593cc4 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:13:09.010773 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201cb571-456a-45bb-8c5c-d539db593cc4 None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:13:09.012111 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 587/1167] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:13:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:13:09.017431 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb8545-422c-45cc-969f-c0e1762f15b5 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:13:09.017873 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb8545-422c-45cc-969f-c0e1762f15b5 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:13:09.017975 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb8545-422c-45cc-969f-c0e1762f15b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:13:09.034607 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-f3eb8545-422c-45cc-969f-c0e1762f15b5 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:13:09.035812 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-f3eb8545-422c-45cc-969f-c0e1762f15b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:13:09.097865 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 581/1168] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:13:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 20:13:09.120993 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201cb571-456a-45bb-8c5c-d539db593cc4 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:13:09.215734 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201cb571-456a-45bb-8c5c-d539db593cc4 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:13:09.246509 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e31ca0b-a454-4231-947a-1929b22770c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:13:09.247144 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e31ca0b-a454-4231-947a-1929b22770c9 None admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:13:09.247475 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e31ca0b-a454-4231-947a-1929b22770c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:13:09.247724 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e31ca0b-a454-4231-947a-1929b22770c9 None admin] PATH_INFO: `/v3/domains` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:13:09.248452 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e31ca0b-a454-4231-947a-1929b22770c9 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:13:09.250549 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e31ca0b-a454-4231-947a-1929b22770c9 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:13:09.264696 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 588/1169] 10.222.0.44 () {60 vars in 1138 bytes} [Mon May 9 20:13:09 2022] POST /identity/v3/domains => generated 267 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:13:11.495902 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f4a3ca-6a82-403c-ade4-9e3bc457b0d7 None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:13:11.496435 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f4a3ca-6a82-403c-ade4-9e3bc457b0d7 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:13:11.496435 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f4a3ca-6a82-403c-ade4-9e3bc457b0d7 None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:13:11.497788 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 582/1170] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:13:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:13:11.503717 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04eea8f-0372-4306-afb9-cca7c07c6bbf None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:13:11.504137 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04eea8f-0372-4306-afb9-cca7c07c6bbf None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:13:11.504244 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04eea8f-0372-4306-afb9-cca7c07c6bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:13:11.521154 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-f04eea8f-0372-4306-afb9-cca7c07c6bbf None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:13:11.522300 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-f04eea8f-0372-4306-afb9-cca7c07c6bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:13:11.584212 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 589/1171] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:13:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 20:13:11.612094 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f4a3ca-6a82-403c-ade4-9e3bc457b0d7 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:13:11.705198 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f4a3ca-6a82-403c-ade4-9e3bc457b0d7 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:13:11.736798 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df8c506-a087-4f6f-9c46-3f926a5793cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:13:11.737617 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8c506-a087-4f6f-9c46-3f926a5793cb None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:13:11.737887 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8c506-a087-4f6f-9c46-3f926a5793cb None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:13:11.738148 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8c506-a087-4f6f-9c46-3f926a5793cb None admin] PATH_INFO: `/v3/domains/0b2373a479be4e6f93e2abaac1e5181c` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:13:11.747691 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df8c506-a087-4f6f-9c46-3f926a5793cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=0b2373a479be4e6f93e2abaac1e5181c)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:13:11.749063 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df8c506-a087-4f6f-9c46-3f926a5793cb None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:13:11.750825 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 583/1172] 10.222.0.44 () {56 vars in 1183 bytes} [Mon May 9 20:13:11 2022] GET /identity/v3/domains/0b2373a479be4e6f93e2abaac1e5181c => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:13:11.756890 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04eea8f-0372-4306-afb9-cca7c07c6bbf None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:13:11.847941 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04eea8f-0372-4306-afb9-cca7c07c6bbf None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:13:11.878740 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5c0213-d652-40f8-b3f3-d4cec4156150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:13:11.879377 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c0213-d652-40f8-b3f3-d4cec4156150 None admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:13:11.879685 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c0213-d652-40f8-b3f3-d4cec4156150 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:13:11.879957 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c0213-d652-40f8-b3f3-d4cec4156150 None admin] PATH_INFO: `/v3/projects` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:13:11.880644 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5c0213-d652-40f8-b3f3-d4cec4156150 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:13:11.882342 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5c0213-d652-40f8-b3f3-d4cec4156150 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:13:11.907175 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 590/1173] 10.222.0.44 () {60 vars in 1141 bytes} [Mon May 9 20:13:11 2022] POST /identity/v3/projects => generated 361 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:13:14.127715 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e1acc3-37c1-4ac1-846e-cd41d12c8de3 None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:13:14.128269 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e1acc3-37c1-4ac1-846e-cd41d12c8de3 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:13:14.128269 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e1acc3-37c1-4ac1-846e-cd41d12c8de3 None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:13:14.129584 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 584/1174] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:13:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:13:14.135379 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044af2f1-ff24-41d8-8013-95fa385e62a2 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:13:14.135815 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044af2f1-ff24-41d8-8013-95fa385e62a2 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:13:14.135954 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044af2f1-ff24-41d8-8013-95fa385e62a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:13:14.153324 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-044af2f1-ff24-41d8-8013-95fa385e62a2 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:13:14.154481 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-044af2f1-ff24-41d8-8013-95fa385e62a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:13:14.216548 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 591/1175] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:13:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 20:13:14.241149 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e1acc3-37c1-4ac1-846e-cd41d12c8de3 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:13:14.336596 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e1acc3-37c1-4ac1-846e-cd41d12c8de3 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:13:14.368852 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7edd8d-9e58-4534-93f7-995ecb47c972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:13:14.369686 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7edd8d-9e58-4534-93f7-995ecb47c972 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:13:14.369961 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7edd8d-9e58-4534-93f7-995ecb47c972 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:13:14.370222 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7edd8d-9e58-4534-93f7-995ecb47c972 None admin] PATH_INFO: `/v3/domains/0b2373a479be4e6f93e2abaac1e5181c` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:13:14.371360 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7edd8d-9e58-4534-93f7-995ecb47c972 None admin] RBAC: Authorizing `identity:get_domain(domain_id=0b2373a479be4e6f93e2abaac1e5181c)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:13:14.372834 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7edd8d-9e58-4534-93f7-995ecb47c972 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:13:14.374509 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 585/1176] 10.222.0.44 () {56 vars in 1183 bytes} [Mon May 9 20:13:14 2022] GET /identity/v3/domains/0b2373a479be4e6f93e2abaac1e5181c => generated 267 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:13:14.380305 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044af2f1-ff24-41d8-8013-95fa385e62a2 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:13:14.471734 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044af2f1-ff24-41d8-8013-95fa385e62a2 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:13:14.502891 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e97786-bf68-4e01-af2f-68f7dc7c57c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:13:14.503562 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e97786-bf68-4e01-af2f-68f7dc7c57c0 None admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:13:14.503844 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e97786-bf68-4e01-af2f-68f7dc7c57c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:13:14.504114 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e97786-bf68-4e01-af2f-68f7dc7c57c0 None admin] PATH_INFO: `/v3/users` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:13:14.504800 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e97786-bf68-4e01-af2f-68f7dc7c57c0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:13:14.506465 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e97786-bf68-4e01-af2f-68f7dc7c57c0 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:13:14.526095 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 592/1177] 10.222.0.44 () {60 vars in 1132 bytes} [Mon May 9 20:13:14 2022] POST /identity/v3/users => generated 311 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:13:16.792875 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e322efa-9213-4dec-9256-2681647cf564 None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:13:16.793424 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e322efa-9213-4dec-9256-2681647cf564 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:13:16.793424 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e322efa-9213-4dec-9256-2681647cf564 None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:13:16.794757 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 586/1178] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:13:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:13:16.800593 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491bd8a-e8de-4aff-9817-a12f34fc9d31 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:13:16.800994 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491bd8a-e8de-4aff-9817-a12f34fc9d31 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:13:16.801136 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491bd8a-e8de-4aff-9817-a12f34fc9d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:13:16.818235 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-4491bd8a-e8de-4aff-9817-a12f34fc9d31 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:13:16.819450 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-4491bd8a-e8de-4aff-9817-a12f34fc9d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:13:16.882328 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 593/1179] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:13:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 20:13:16.905912 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e322efa-9213-4dec-9256-2681647cf564 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:13:16.999474 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e322efa-9213-4dec-9256-2681647cf564 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:13:17.031550 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9313aad4-79b3-4d02-8dab-70352355ca8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:13:17.032312 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9313aad4-79b3-4d02-8dab-70352355ca8b None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:13:17.032590 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9313aad4-79b3-4d02-8dab-70352355ca8b None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:13:17.032860 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9313aad4-79b3-4d02-8dab-70352355ca8b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:13:17.042386 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9313aad4-79b3-4d02-8dab-70352355ca8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:13:17.049960 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-9313aad4-79b3-4d02-8dab-70352355ca8b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 20:13:17.049960 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:13:17.049960 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:13:17.049960 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:13:17.049960 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:13:17.049960 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:13:17.049960 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:13:17.049960 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:13:17.049960 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:13:17.049960 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:13:17.049960 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:13:17.049960 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:13:17.049960 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:13:17.049960 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:13:17.049960 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:13:17.049960 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:13:17.051147 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:13:17.051147 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:13:17.051147 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:13:17.051147 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:13:17.051147 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:13:17.051147 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:13:17.051147 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:13:17.051147 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:13:17.051147 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:13:17.051147 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:13:17.051147 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:13:17.051147 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:13:17.051147 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:13:17.051147 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:13:17.051147 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:13:17.051147 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:13:17.052300 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:13:17.052300 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:13:17.052300 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:13:17.052300 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:13:17.052300 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:13:17.052300 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:13:17.052300 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:13:17.052300 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:13:17.052300 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:13:17.052300 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:13:17.052300 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 20:13:17.052300 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:13:17.052300 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 587/1180] 10.222.0.44 () {56 vars in 1096 bytes} [Mon May 9 20:13:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:13:17.057008 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4491bd8a-e8de-4aff-9817-a12f34fc9d31 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:13:17.147450 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4491bd8a-e8de-4aff-9817-a12f34fc9d31 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:13:17.178661 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a995c30-1f1c-4ebd-b58f-3bb2d7cfee7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:13:17.179294 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a995c30-1f1c-4ebd-b58f-3bb2d7cfee7b None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:13:17.179603 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a995c30-1f1c-4ebd-b58f-3bb2d7cfee7b None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:13:17.179871 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a995c30-1f1c-4ebd-b58f-3bb2d7cfee7b None admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:13:17.180595 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a995c30-1f1c-4ebd-b58f-3bb2d7cfee7b None admin] RBAC: Adding query filter params (name=admin) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:13:17.180890 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a995c30-1f1c-4ebd-b58f-3bb2d7cfee7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:13:17.182222 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a995c30-1f1c-4ebd-b58f-3bb2d7cfee7b None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:13:17.190181 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 594/1181] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 9 20:13:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:13:17.195890 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9313aad4-79b3-4d02-8dab-70352355ca8b None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:13:17.286777 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9313aad4-79b3-4d02-8dab-70352355ca8b None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:13:17.317469 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c8fe69-2ce3-4909-b53e-d4524e8215be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:13:17.318295 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c8fe69-2ce3-4909-b53e-d4524e8215be None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:13:17.318571 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c8fe69-2ce3-4909-b53e-d4524e8215be None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:13:17.318835 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c8fe69-2ce3-4909-b53e-d4524e8215be None admin] PATH_INFO: `/v3/users/ab4293a1b74a40dc800e4a5b6194ba0e` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:13:17.331067 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c8fe69-2ce3-4909-b53e-d4524e8215be None admin] RBAC: Authorizing `identity:get_user(user_id=ab4293a1b74a40dc800e4a5b6194ba0e)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:13:17.332525 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c8fe69-2ce3-4909-b53e-d4524e8215be None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:13:17.334117 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 588/1182] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 9 20:13:17 2022] GET /identity/v3/users/ab4293a1b74a40dc800e4a5b6194ba0e => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:13:17.339730 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a995c30-1f1c-4ebd-b58f-3bb2d7cfee7b None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:13:17.432875 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a995c30-1f1c-4ebd-b58f-3bb2d7cfee7b None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:13:17.464240 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f298cc6-243c-4378-8cc7-b3f06ff20d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:13:17.464870 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f298cc6-243c-4378-8cc7-b3f06ff20d8c None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:13:17.465151 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f298cc6-243c-4378-8cc7-b3f06ff20d8c None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:13:17.465431 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f298cc6-243c-4378-8cc7-b3f06ff20d8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:13:17.527922 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f298cc6-243c-4378-8cc7-b3f06ff20d8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:13:17.529354 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f298cc6-243c-4378-8cc7-b3f06ff20d8c None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:13:17.627940 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 595/1183] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 9 20:13:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 20:13:17.634093 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c8fe69-2ce3-4909-b53e-d4524e8215be None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:13:17.725554 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c8fe69-2ce3-4909-b53e-d4524e8215be None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:13:17.757086 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab14ad-8de7-4184-897d-1e78fcf26bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:13:17.757917 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab14ad-8de7-4184-897d-1e78fcf26bea None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:13:17.758194 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab14ad-8de7-4184-897d-1e78fcf26bea None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:13:17.758485 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab14ad-8de7-4184-897d-1e78fcf26bea None admin] PATH_INFO: `/v3/projects/5bd772fe75df419f9f40d3b8281ad3b2` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:13:17.759662 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcab14ad-8de7-4184-897d-1e78fcf26bea None admin] RBAC: Authorizing `identity:get_project(project_id=5bd772fe75df419f9f40d3b8281ad3b2)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:13:17.761076 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcab14ad-8de7-4184-897d-1e78fcf26bea None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:13:17.762735 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 589/1184] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 9 20:13:17 2022] GET /identity/v3/projects/5bd772fe75df419f9f40d3b8281ad3b2 => generated 361 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:13:17.769202 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f298cc6-243c-4378-8cc7-b3f06ff20d8c None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:13:17.859685 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f298cc6-243c-4378-8cc7-b3f06ff20d8c None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:13:17.891029 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2af0c4-4017-49ff-aac4-f8b5e8a59d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:13:17.891675 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2af0c4-4017-49ff-aac4-f8b5e8a59d12 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:13:17.891950 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2af0c4-4017-49ff-aac4-f8b5e8a59d12 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:13:17.892218 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2af0c4-4017-49ff-aac4-f8b5e8a59d12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:13:17.893022 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2af0c4-4017-49ff-aac4-f8b5e8a59d12 None admin] RBAC: Adding query filter params (role.id=274130b78e304bb88789c1b349263f3c, scope.project.id=5bd772fe75df419f9f40d3b8281ad3b2, user.id=ab4293a1b74a40dc800e4a5b6194ba0e) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:13:17.893322 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2af0c4-4017-49ff-aac4-f8b5e8a59d12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:13:17.894725 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2af0c4-4017-49ff-aac4-f8b5e8a59d12 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:13:17.899842 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 596/1185] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 9 20:13:17 2022] GET /identity/v3/role_assignments?user.id=ab4293a1b74a40dc800e4a5b6194ba0e&scope.project.id=5bd772fe75df419f9f40d3b8281ad3b2&role.id=274130b78e304bb88789c1b349263f3c => generated 259 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:13:20.074989 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab888c-2ede-4e75-aa95-4374fe2e941e None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:13:20.075564 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab888c-2ede-4e75-aa95-4374fe2e941e None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:13:20.075564 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab888c-2ede-4e75-aa95-4374fe2e941e None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:13:20.076894 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 590/1186] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:13:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:13:20.082617 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55f60c-a59c-4662-8054-90368a75ffc1 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:13:20.083049 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55f60c-a59c-4662-8054-90368a75ffc1 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:13:20.083147 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55f60c-a59c-4662-8054-90368a75ffc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:13:20.099620 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-bd55f60c-a59c-4662-8054-90368a75ffc1 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:13:20.100768 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-bd55f60c-a59c-4662-8054-90368a75ffc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:13:20.161710 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 597/1187] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:13:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 20:13:20.183745 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab888c-2ede-4e75-aa95-4374fe2e941e None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:13:20.279168 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab888c-2ede-4e75-aa95-4374fe2e941e None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:13:20.310710 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e8d0c4-c3db-41f4-83ac-dc9efc4616cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:13:20.312046 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e8d0c4-c3db-41f4-83ac-dc9efc4616cd None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:13:20.312370 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e8d0c4-c3db-41f4-83ac-dc9efc4616cd None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:13:20.312643 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e8d0c4-c3db-41f4-83ac-dc9efc4616cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:13:20.322036 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e8d0c4-c3db-41f4-83ac-dc9efc4616cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:13:20.329825 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-66e8d0c4-c3db-41f4-83ac-dc9efc4616cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 20:13:20.329825 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:13:20.329825 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:13:20.329825 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:13:20.329825 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:13:20.329825 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:13:20.329825 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:13:20.329825 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:13:20.329825 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:13:20.329825 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:13:20.329825 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:13:20.329825 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:13:20.329825 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:13:20.329825 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:13:20.329825 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:13:20.329825 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:13:20.330919 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:13:20.330919 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:13:20.330919 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:13:20.330919 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:13:20.330919 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:13:20.330919 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:13:20.330919 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:13:20.330919 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:13:20.330919 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:13:20.330919 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:13:20.330919 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:13:20.330919 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:13:20.330919 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:13:20.330919 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:13:20.330919 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:13:20.330919 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:13:20.331847 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:13:20.331847 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:13:20.331847 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:13:20.331847 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:13:20.331847 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:13:20.331847 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:13:20.331847 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:13:20.331847 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:13:20.331847 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:13:20.331847 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:13:20.331847 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 20:13:20.331847 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:13:20.331847 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 591/1188] 10.222.0.44 () {56 vars in 1096 bytes} [Mon May 9 20:13:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:13:20.336830 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd55f60c-a59c-4662-8054-90368a75ffc1 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:13:20.432818 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd55f60c-a59c-4662-8054-90368a75ffc1 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:13:20.464056 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58790ea8-b86b-415b-bb45-6bb0eede4261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:13:20.464690 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58790ea8-b86b-415b-bb45-6bb0eede4261 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:13:20.464965 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58790ea8-b86b-415b-bb45-6bb0eede4261 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:13:20.465231 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58790ea8-b86b-415b-bb45-6bb0eede4261 None admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:13:20.465962 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58790ea8-b86b-415b-bb45-6bb0eede4261 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:13:20.466263 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58790ea8-b86b-415b-bb45-6bb0eede4261 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:13:20.467639 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58790ea8-b86b-415b-bb45-6bb0eede4261 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:13:20.475756 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 598/1189] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 9 20:13:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:13:20.481745 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e8d0c4-c3db-41f4-83ac-dc9efc4616cd None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:13:20.578814 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e8d0c4-c3db-41f4-83ac-dc9efc4616cd None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:13:20.610303 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c063f99e-c0b3-41c8-9bc7-5e6870ec4253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:13:20.611081 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c063f99e-c0b3-41c8-9bc7-5e6870ec4253 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:13:20.611361 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c063f99e-c0b3-41c8-9bc7-5e6870ec4253 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:13:20.611664 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c063f99e-c0b3-41c8-9bc7-5e6870ec4253 None admin] PATH_INFO: `/v3/users/ab4293a1b74a40dc800e4a5b6194ba0e` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:13:20.612832 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c063f99e-c0b3-41c8-9bc7-5e6870ec4253 None admin] RBAC: Authorizing `identity:get_user(user_id=ab4293a1b74a40dc800e4a5b6194ba0e)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:13:20.614263 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c063f99e-c0b3-41c8-9bc7-5e6870ec4253 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:13:20.615901 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 592/1190] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 9 20:13:20 2022] GET /identity/v3/users/ab4293a1b74a40dc800e4a5b6194ba0e => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:13:20.621701 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58790ea8-b86b-415b-bb45-6bb0eede4261 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:13:20.713918 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58790ea8-b86b-415b-bb45-6bb0eede4261 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:13:20.744732 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f7315-a70a-44fe-ac3d-91886ead0fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:13:20.745560 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f7315-a70a-44fe-ac3d-91886ead0fbb None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:13:20.745835 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f7315-a70a-44fe-ac3d-91886ead0fbb None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:13:20.746103 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f7315-a70a-44fe-ac3d-91886ead0fbb None admin] PATH_INFO: `/v3/projects/5bd772fe75df419f9f40d3b8281ad3b2` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:13:20.747235 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f7315-a70a-44fe-ac3d-91886ead0fbb None admin] RBAC: Authorizing `identity:get_project(project_id=5bd772fe75df419f9f40d3b8281ad3b2)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:13:20.748667 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f7315-a70a-44fe-ac3d-91886ead0fbb None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:13:20.750905 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 599/1191] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 9 20:13:20 2022] GET /identity/v3/projects/5bd772fe75df419f9f40d3b8281ad3b2 => generated 361 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:13:20.756917 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c063f99e-c0b3-41c8-9bc7-5e6870ec4253 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:13:20.848559 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c063f99e-c0b3-41c8-9bc7-5e6870ec4253 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:13:20.880695 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0ebe31-520d-4ab5-a9ab-e9ab8265557e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:13:20.881742 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0ebe31-520d-4ab5-a9ab-e9ab8265557e None admin] REQUEST_METHOD: `PUT` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:13:20.882018 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0ebe31-520d-4ab5-a9ab-e9ab8265557e None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:13:20.882288 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0ebe31-520d-4ab5-a9ab-e9ab8265557e None admin] PATH_INFO: `/v3/projects/5bd772fe75df419f9f40d3b8281ad3b2/users/ab4293a1b74a40dc800e4a5b6194ba0e/roles/274130b78e304bb88789c1b349263f3c` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:13:20.884241 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0ebe31-520d-4ab5-a9ab-e9ab8265557e None admin] RBAC: Authorizing `identity:create_grant(project_id=5bd772fe75df419f9f40d3b8281ad3b2, user_id=ab4293a1b74a40dc800e4a5b6194ba0e, role_id=274130b78e304bb88789c1b349263f3c)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:13:20.885662 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0ebe31-520d-4ab5-a9ab-e9ab8265557e None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:13:20.898284 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 593/1192] 10.222.0.44 () {58 vars in 1439 bytes} [Mon May 9 20:13:20 2022] PUT /identity/v3/projects/5bd772fe75df419f9f40d3b8281ad3b2/users/ab4293a1b74a40dc800e4a5b6194ba0e/roles/274130b78e304bb88789c1b349263f3c => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:13:23.131729 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff7995-2d53-4a06-b05b-4b2e349dd953 None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:13:23.132262 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff7995-2d53-4a06-b05b-4b2e349dd953 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:13:23.132262 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff7995-2d53-4a06-b05b-4b2e349dd953 None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:13:23.133746 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 600/1193] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:13:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:13:23.139291 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4cc9e-edfe-4640-a7b7-7d0973d876be None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:13:23.140441 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4cc9e-edfe-4640-a7b7-7d0973d876be None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:13:23.140441 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4cc9e-edfe-4640-a7b7-7d0973d876be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:13:23.157633 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-22a4cc9e-edfe-4640-a7b7-7d0973d876be None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:13:23.158813 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-22a4cc9e-edfe-4640-a7b7-7d0973d876be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:13:23.221214 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 594/1194] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:13:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 20:13:23.244627 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ff7995-2d53-4a06-b05b-4b2e349dd953 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:13:23.340387 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ff7995-2d53-4a06-b05b-4b2e349dd953 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:13:23.371931 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6925778f-460a-4633-8735-3351e528fa37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:13:23.372696 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6925778f-460a-4633-8735-3351e528fa37 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:13:23.372971 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6925778f-460a-4633-8735-3351e528fa37 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:13:23.373244 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6925778f-460a-4633-8735-3351e528fa37 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:13:23.383655 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6925778f-460a-4633-8735-3351e528fa37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:13:23.391620 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-6925778f-460a-4633-8735-3351e528fa37 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 20:13:23.391620 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:13:23.391620 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:13:23.391620 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:13:23.391620 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:13:23.391620 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:13:23.391620 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:13:23.391620 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:13:23.391620 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:13:23.391620 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:13:23.391620 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:13:23.391620 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:13:23.391620 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:13:23.391620 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:13:23.391620 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:13:23.391620 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:13:23.392704 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:13:23.392704 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:13:23.392704 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:13:23.392704 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:13:23.392704 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:13:23.392704 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:13:23.392704 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:13:23.392704 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:13:23.392704 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:13:23.392704 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:13:23.392704 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:13:23.392704 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:13:23.392704 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:13:23.392704 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:13:23.392704 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:13:23.392704 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:13:23.393872 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:13:23.393872 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:13:23.393872 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:13:23.393872 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:13:23.393872 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:13:23.393872 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:13:23.393872 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:13:23.393872 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:13:23.393872 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:13:23.393872 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:13:23.393872 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 20:13:23.393872 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:13:23.393872 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 601/1195] 10.222.0.44 () {56 vars in 1096 bytes} [Mon May 9 20:13:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:13:23.398926 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4cc9e-edfe-4640-a7b7-7d0973d876be None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:13:23.489907 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4cc9e-edfe-4640-a7b7-7d0973d876be None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:13:23.522013 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151cc8f6-76a0-4d0d-8dcf-d1ba71e519b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:13:23.522654 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151cc8f6-76a0-4d0d-8dcf-d1ba71e519b3 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:13:23.522933 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151cc8f6-76a0-4d0d-8dcf-d1ba71e519b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:13:23.523203 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151cc8f6-76a0-4d0d-8dcf-d1ba71e519b3 None admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:13:23.523975 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151cc8f6-76a0-4d0d-8dcf-d1ba71e519b3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:13:23.524276 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151cc8f6-76a0-4d0d-8dcf-d1ba71e519b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:13:23.525641 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151cc8f6-76a0-4d0d-8dcf-d1ba71e519b3 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:13:23.533751 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 595/1196] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 9 20:13:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:13:23.539554 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6925778f-460a-4633-8735-3351e528fa37 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:13:23.633050 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6925778f-460a-4633-8735-3351e528fa37 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:13:23.669329 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13987200-3155-4959-8df9-83a49e2151e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:13:23.670116 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13987200-3155-4959-8df9-83a49e2151e2 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:13:23.670389 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13987200-3155-4959-8df9-83a49e2151e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:13:23.670657 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13987200-3155-4959-8df9-83a49e2151e2 None admin] PATH_INFO: `/v3/users/ab4293a1b74a40dc800e4a5b6194ba0e` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:13:23.671965 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13987200-3155-4959-8df9-83a49e2151e2 None admin] RBAC: Authorizing `identity:get_user(user_id=ab4293a1b74a40dc800e4a5b6194ba0e)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:13:23.673384 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13987200-3155-4959-8df9-83a49e2151e2 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:13:23.675007 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 602/1197] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 9 20:13:23 2022] GET /identity/v3/users/ab4293a1b74a40dc800e4a5b6194ba0e => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:13:23.680785 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151cc8f6-76a0-4d0d-8dcf-d1ba71e519b3 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:13:23.773231 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151cc8f6-76a0-4d0d-8dcf-d1ba71e519b3 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:13:23.803812 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1efdb0-7d9d-4eca-9f35-27de62c5d258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:13:23.804430 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1efdb0-7d9d-4eca-9f35-27de62c5d258 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:13:23.804705 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1efdb0-7d9d-4eca-9f35-27de62c5d258 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:13:23.804971 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1efdb0-7d9d-4eca-9f35-27de62c5d258 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:13:23.866877 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1efdb0-7d9d-4eca-9f35-27de62c5d258 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:13:23.868327 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1efdb0-7d9d-4eca-9f35-27de62c5d258 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:13:23.959346 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 596/1198] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 9 20:13:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 20:13:23.965250 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13987200-3155-4959-8df9-83a49e2151e2 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:13:24.057746 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13987200-3155-4959-8df9-83a49e2151e2 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:13:24.089420 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fd7b47-2763-4e1d-81ee-1371ce47fb9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:13:24.090255 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd7b47-2763-4e1d-81ee-1371ce47fb9e None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:13:24.090532 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd7b47-2763-4e1d-81ee-1371ce47fb9e None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:13:24.090800 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd7b47-2763-4e1d-81ee-1371ce47fb9e None admin] PATH_INFO: `/v3/projects/5bd772fe75df419f9f40d3b8281ad3b2` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:13:24.091985 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fd7b47-2763-4e1d-81ee-1371ce47fb9e None admin] RBAC: Authorizing `identity:get_project(project_id=5bd772fe75df419f9f40d3b8281ad3b2)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:13:24.093787 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fd7b47-2763-4e1d-81ee-1371ce47fb9e None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:13:24.095473 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 603/1199] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 9 20:13:23 2022] GET /identity/v3/projects/5bd772fe75df419f9f40d3b8281ad3b2 => generated 361 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:13:24.101326 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1efdb0-7d9d-4eca-9f35-27de62c5d258 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:13:24.192764 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1efdb0-7d9d-4eca-9f35-27de62c5d258 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:13:24.224748 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba0f2bc-0312-4b43-b905-3961cfea0c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:13:24.225315 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0f2bc-0312-4b43-b905-3961cfea0c4d None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:13:24.225591 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0f2bc-0312-4b43-b905-3961cfea0c4d None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:13:24.225861 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0f2bc-0312-4b43-b905-3961cfea0c4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:13:24.226674 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba0f2bc-0312-4b43-b905-3961cfea0c4d None admin] RBAC: Adding query filter params (role.id=274130b78e304bb88789c1b349263f3c, scope.project.id=5bd772fe75df419f9f40d3b8281ad3b2, user.id=ab4293a1b74a40dc800e4a5b6194ba0e) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:13:24.226978 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba0f2bc-0312-4b43-b905-3961cfea0c4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:13:24.228428 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba0f2bc-0312-4b43-b905-3961cfea0c4d None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:13:24.233957 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 597/1200] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 9 20:13:24 2022] GET /identity/v3/role_assignments?user.id=ab4293a1b74a40dc800e4a5b6194ba0e&scope.project.id=5bd772fe75df419f9f40d3b8281ad3b2&role.id=274130b78e304bb88789c1b349263f3c => generated 608 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:14:25.266659 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421c223-65db-4971-8804-8aaa82fc359b None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:25.267252 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421c223-65db-4971-8804-8aaa82fc359b None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:25.267252 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421c223-65db-4971-8804-8aaa82fc359b None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:25.268981 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 604/1201] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:14:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:14:25.274634 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b503fd-fe7d-423b-96aa-9d51c255da6e None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:25.275173 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b503fd-fe7d-423b-96aa-9d51c255da6e None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:25.275304 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b503fd-fe7d-423b-96aa-9d51c255da6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:25.299734 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-61b503fd-fe7d-423b-96aa-9d51c255da6e None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:14:25.301193 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-61b503fd-fe7d-423b-96aa-9d51c255da6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:14:25.394796 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 598/1202] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:14:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 20:14:25.421347 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2421c223-65db-4971-8804-8aaa82fc359b None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:14:25.557698 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2421c223-65db-4971-8804-8aaa82fc359b None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:14:25.597851 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3b9c7c-f0bc-41e0-a4a9-07fc10bdc86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:14:25.598795 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b9c7c-f0bc-41e0-a4a9-07fc10bdc86c None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:25.599089 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b9c7c-f0bc-41e0-a4a9-07fc10bdc86c None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:25.599367 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b9c7c-f0bc-41e0-a4a9-07fc10bdc86c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:25.612312 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3b9c7c-f0bc-41e0-a4a9-07fc10bdc86c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:14:25.614218 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3b9c7c-f0bc-41e0-a4a9-07fc10bdc86c None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:14:25.636274 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-3b3b9c7c-f0bc-41e0-a4a9-07fc10bdc86c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:14:25.636274 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:14:25.636274 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:14:25.636274 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:14:25.636274 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:14:25.636274 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:14:25.636274 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:14:25.636274 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:14:25.636274 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:14:25.636274 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:14:25.636274 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:14:25.636274 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:14:25.636274 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 20:14:25.636274 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 20:14:25.636274 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 20:14:25.637623 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 20:14:25.637623 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:14:25.637623 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:14:25.637623 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:14:25.637623 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:14:25.637623 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:14:25.637623 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:14:25.637623 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:14:25.637623 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:14:25.637623 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:14:25.637623 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:14:25.637623 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:14:25.637623 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:14:25.637623 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:14:25.637623 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:14:25.637623 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:14:25.637623 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:14:25.638591 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 20:14:25.638591 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 20:14:25.638591 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:14:25.638591 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:14:25.640347 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 605/1203] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:14:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:14:25.646482 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b503fd-fe7d-423b-96aa-9d51c255da6e None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:14:25.762877 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b503fd-fe7d-423b-96aa-9d51c255da6e None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:14:25.808215 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8055a9-6b74-4617-b97a-5b898d34e474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:14:25.808807 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8055a9-6b74-4617-b97a-5b898d34e474 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:25.809077 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8055a9-6b74-4617-b97a-5b898d34e474 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:25.809344 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8055a9-6b74-4617-b97a-5b898d34e474 None admin] PATH_INFO: `/v3/domains` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:25.810667 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8055a9-6b74-4617-b97a-5b898d34e474 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:14:25.810972 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8055a9-6b74-4617-b97a-5b898d34e474 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:14:25.812633 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8055a9-6b74-4617-b97a-5b898d34e474 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:14:25.828503 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 599/1204] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 9 20:14:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:14:25.834470 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3b9c7c-f0bc-41e0-a4a9-07fc10bdc86c None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:14:25.956101 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3b9c7c-f0bc-41e0-a4a9-07fc10bdc86c None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:14:26.004280 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f529d-4b08-41c7-bce2-079bec4c48bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:14:26.004946 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f529d-4b08-41c7-bce2-079bec4c48bc None admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:26.005223 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f529d-4b08-41c7-bce2-079bec4c48bc None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:26.005494 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f529d-4b08-41c7-bce2-079bec4c48bc None admin] PATH_INFO: `/v3/users` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:26.006230 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046f529d-4b08-41c7-bce2-079bec4c48bc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:14:26.007953 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046f529d-4b08-41c7-bce2-079bec4c48bc None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:14:26.039440 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 606/1205] 10.222.0.44 () {60 vars in 1132 bytes} [Mon May 9 20:14:25 2022] POST /identity/v3/users => generated 251 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:14:28.486058 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f95777-4603-4ae8-a359-0cac3a5faec3 None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:28.486643 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f95777-4603-4ae8-a359-0cac3a5faec3 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:28.486643 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f95777-4603-4ae8-a359-0cac3a5faec3 None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:28.488077 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 600/1206] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:14:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:14:28.493748 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56f686-374d-43a5-b8ea-3b4af1ea4054 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:28.494237 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56f686-374d-43a5-b8ea-3b4af1ea4054 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:28.494325 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56f686-374d-43a5-b8ea-3b4af1ea4054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:28.512227 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-af56f686-374d-43a5-b8ea-3b4af1ea4054 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:14:28.513620 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-af56f686-374d-43a5-b8ea-3b4af1ea4054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:14:28.587739 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 607/1207] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:14:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 20:14:28.613116 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f95777-4603-4ae8-a359-0cac3a5faec3 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:14:28.720388 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f95777-4603-4ae8-a359-0cac3a5faec3 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:14:28.757138 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be3f234-8d97-4f21-b41d-d4d5ec2ab3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:14:28.757902 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be3f234-8d97-4f21-b41d-d4d5ec2ab3b0 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:28.758179 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be3f234-8d97-4f21-b41d-d4d5ec2ab3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:28.758448 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be3f234-8d97-4f21-b41d-d4d5ec2ab3b0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:28.770013 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be3f234-8d97-4f21-b41d-d4d5ec2ab3b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:14:28.778337 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-1be3f234-8d97-4f21-b41d-d4d5ec2ab3b0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 20:14:28.778337 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:14:28.778337 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:14:28.778337 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:14:28.778337 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:14:28.778337 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:14:28.778337 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:14:28.778337 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:14:28.778337 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:14:28.778337 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:14:28.778337 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:14:28.778337 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:14:28.778337 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:14:28.778337 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:14:28.778337 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:14:28.778337 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:14:28.779494 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:14:28.779494 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:14:28.779494 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:14:28.779494 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:14:28.779494 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:14:28.779494 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:14:28.779494 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:14:28.779494 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:14:28.779494 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:14:28.779494 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:14:28.779494 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:14:28.779494 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:14:28.779494 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:14:28.779494 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:14:28.779494 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:14:28.779494 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:14:28.780544 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:14:28.780544 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:14:28.780544 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:14:28.780544 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:14:28.780544 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:14:28.780544 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:14:28.780544 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:14:28.780544 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:14:28.780544 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:14:28.780544 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:14:28.780544 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 20:14:28.780544 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:14:28.780544 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 601/1208] 10.222.0.44 () {56 vars in 1102 bytes} [Mon May 9 20:14:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:14:28.785724 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af56f686-374d-43a5-b8ea-3b4af1ea4054 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:14:28.897954 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af56f686-374d-43a5-b8ea-3b4af1ea4054 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:14:28.936355 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14323cb9-5f00-420a-8ce1-77742f8ec6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:14:28.937174 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14323cb9-5f00-420a-8ce1-77742f8ec6e7 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:28.937469 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14323cb9-5f00-420a-8ce1-77742f8ec6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:28.937805 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14323cb9-5f00-420a-8ce1-77742f8ec6e7 None admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:28.938841 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14323cb9-5f00-420a-8ce1-77742f8ec6e7 None admin] RBAC: Adding query filter params (name=service) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:14:28.939152 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14323cb9-5f00-420a-8ce1-77742f8ec6e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:14:28.940898 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14323cb9-5f00-420a-8ce1-77742f8ec6e7 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:14:28.950178 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 608/1209] 10.222.0.44 () {56 vars in 1103 bytes} [Mon May 9 20:14:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:14:28.955871 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be3f234-8d97-4f21-b41d-d4d5ec2ab3b0 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:14:29.067803 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be3f234-8d97-4f21-b41d-d4d5ec2ab3b0 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:14:29.102790 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387ef8a7-1b0f-434d-b5de-bfa2ef74509c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:14:29.103762 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ef8a7-1b0f-434d-b5de-bfa2ef74509c None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:29.104101 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ef8a7-1b0f-434d-b5de-bfa2ef74509c None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:29.104308 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ef8a7-1b0f-434d-b5de-bfa2ef74509c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:29.117029 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387ef8a7-1b0f-434d-b5de-bfa2ef74509c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:14:29.118790 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387ef8a7-1b0f-434d-b5de-bfa2ef74509c None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:14:29.138003 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-387ef8a7-1b0f-434d-b5de-bfa2ef74509c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:14:29.138003 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:14:29.138003 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:14:29.138003 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:14:29.138003 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:14:29.138003 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:14:29.138003 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:14:29.138003 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:14:29.138003 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:14:29.138003 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:14:29.138003 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:14:29.138003 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:14:29.138003 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 20:14:29.138003 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 20:14:29.138003 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 20:14:29.139512 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 20:14:29.139512 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:14:29.139512 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:14:29.139512 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:14:29.139512 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:14:29.139512 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:14:29.139512 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:14:29.139512 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:14:29.139512 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:14:29.139512 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:14:29.139512 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:14:29.139512 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:14:29.139512 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:14:29.139512 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:14:29.139512 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:14:29.139512 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:14:29.139512 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:14:29.140433 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 20:14:29.140433 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 20:14:29.140433 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:14:29.140433 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:14:29.140433 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 602/1210] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:14:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 20:14:29.145828 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14323cb9-5f00-420a-8ce1-77742f8ec6e7 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:14:29.273564 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14323cb9-5f00-420a-8ce1-77742f8ec6e7 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:14:29.321879 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ee538-4a2e-4afa-b127-e14caa9895ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:14:29.322095 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ee538-4a2e-4afa-b127-e14caa9895ba None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:29.322346 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ee538-4a2e-4afa-b127-e14caa9895ba None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:29.322622 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ee538-4a2e-4afa-b127-e14caa9895ba None admin] PATH_INFO: `/v3/domains` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:29.323456 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6ee538-4a2e-4afa-b127-e14caa9895ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:14:29.323708 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6ee538-4a2e-4afa-b127-e14caa9895ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:14:29.326215 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6ee538-4a2e-4afa-b127-e14caa9895ba None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:14:29.342122 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 609/1211] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 9 20:14:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:14:29.351442 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387ef8a7-1b0f-434d-b5de-bfa2ef74509c None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:14:29.462948 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387ef8a7-1b0f-434d-b5de-bfa2ef74509c None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:14:29.500038 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdea9a43-2c2a-4487-b712-9537d0054056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:14:29.500841 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdea9a43-2c2a-4487-b712-9537d0054056 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:29.501115 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdea9a43-2c2a-4487-b712-9537d0054056 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:29.501384 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdea9a43-2c2a-4487-b712-9537d0054056 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:29.510117 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdea9a43-2c2a-4487-b712-9537d0054056 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:14:29.511657 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdea9a43-2c2a-4487-b712-9537d0054056 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:14:29.528516 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-cdea9a43-2c2a-4487-b712-9537d0054056 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 09 20:14:29.528516 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:14:29.528516 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:14:29.528516 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:14:29.528516 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:14:29.528516 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:14:29.528516 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:14:29.528516 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:14:29.528516 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:14:29.528516 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:14:29.528516 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:14:29.528516 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:14:29.528516 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 20:14:29.528516 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 20:14:29.528516 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 20:14:29.528516 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 20:14:29.529581 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:14:29.529581 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:14:29.529581 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 20:14:29.529581 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 20:14:29.529581 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 20:14:29.529581 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 20:14:29.529581 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:14:29.529581 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:14:29.529581 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:14:29.529581 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:14:29.529581 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:14:29.529581 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:14:29.529581 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:14:29.529581 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:14:29.529581 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:14:29.529581 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:14:29.529581 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:14:29.529581 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:14:29.530548 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:14:29.530548 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:14:29.530548 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 20:14:29.530548 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 20:14:29.530548 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 20:14:29.530548 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 20:14:29.530548 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 20:14:29.530548 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 20:14:29.530548 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 09 20:14:29.530548 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:14:29.530548 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 603/1212] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:14:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:14:29.535809 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ee538-4a2e-4afa-b127-e14caa9895ba None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:14:29.652204 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ee538-4a2e-4afa-b127-e14caa9895ba None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:14:29.689355 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e6316e-1598-492b-b358-965941809fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:14:29.690128 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e6316e-1598-492b-b358-965941809fc6 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:29.690495 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e6316e-1598-492b-b358-965941809fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:29.690682 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e6316e-1598-492b-b358-965941809fc6 None admin] PATH_INFO: `/v3/users` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:29.691665 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e6316e-1598-492b-b358-965941809fc6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:14:29.691980 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e6316e-1598-492b-b358-965941809fc6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:14:29.693476 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e6316e-1598-492b-b358-965941809fc6 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:14:29.712932 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 610/1213] 10.222.0.44 () {56 vars in 1143 bytes} [Mon May 9 20:14:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:14:29.719894 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdea9a43-2c2a-4487-b712-9537d0054056 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:14:29.833299 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdea9a43-2c2a-4487-b712-9537d0054056 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:14:29.872822 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d63f67-702a-4ba4-b975-63e47f71133b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:14:29.873476 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d63f67-702a-4ba4-b975-63e47f71133b None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:29.873772 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d63f67-702a-4ba4-b975-63e47f71133b None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:29.874046 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d63f67-702a-4ba4-b975-63e47f71133b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:29.944701 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d63f67-702a-4ba4-b975-63e47f71133b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:14:29.946240 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d63f67-702a-4ba4-b975-63e47f71133b None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:14:30.054272 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 604/1214] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 9 20:14:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 20:14:30.055479 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e6316e-1598-492b-b358-965941809fc6 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:14:30.163610 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e6316e-1598-492b-b358-965941809fc6 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:14:30.201057 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105e64fd-b0db-4639-9a77-d83f5657cd2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:14:30.201858 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e64fd-b0db-4639-9a77-d83f5657cd2a None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:30.202138 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e64fd-b0db-4639-9a77-d83f5657cd2a None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:30.202406 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e64fd-b0db-4639-9a77-d83f5657cd2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:30.213176 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105e64fd-b0db-4639-9a77-d83f5657cd2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:14:30.214716 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105e64fd-b0db-4639-9a77-d83f5657cd2a None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:14:30.235126 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-105e64fd-b0db-4639-9a77-d83f5657cd2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:14:30.235126 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:14:30.235126 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:14:30.235126 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:14:30.235126 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:14:30.235126 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:14:30.235126 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:14:30.235126 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:14:30.235126 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:14:30.235126 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:14:30.235126 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:14:30.235126 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:14:30.235126 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 20:14:30.235126 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 20:14:30.235126 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 20:14:30.236146 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 20:14:30.236146 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:14:30.236146 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:14:30.236146 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:14:30.236146 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:14:30.236146 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:14:30.236146 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:14:30.236146 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:14:30.236146 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:14:30.236146 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:14:30.236146 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:14:30.236146 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:14:30.236146 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:14:30.236146 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:14:30.236146 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:14:30.236146 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:14:30.236146 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:14:30.237053 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 20:14:30.237053 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 20:14:30.237053 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:14:30.237053 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:14:30.239729 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 611/1215] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:14:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 20:14:30.242088 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d63f67-702a-4ba4-b975-63e47f71133b None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:14:30.353230 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d63f67-702a-4ba4-b975-63e47f71133b None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:14:30.392789 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f42fcb-f686-45a7-bb17-c8916603ca53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:14:30.393836 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f42fcb-f686-45a7-bb17-c8916603ca53 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:30.394328 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f42fcb-f686-45a7-bb17-c8916603ca53 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:30.394547 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f42fcb-f686-45a7-bb17-c8916603ca53 None admin] PATH_INFO: `/v3/domains` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:30.395606 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f42fcb-f686-45a7-bb17-c8916603ca53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:14:30.395941 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f42fcb-f686-45a7-bb17-c8916603ca53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:14:30.397761 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f42fcb-f686-45a7-bb17-c8916603ca53 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:14:30.413157 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 605/1216] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 9 20:14:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:14:30.420429 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105e64fd-b0db-4639-9a77-d83f5657cd2a None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:14:30.528958 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105e64fd-b0db-4639-9a77-d83f5657cd2a None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:14:30.571440 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5528996-3de2-46d9-8373-4fa321d75539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:14:30.572274 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5528996-3de2-46d9-8373-4fa321d75539 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:30.572532 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5528996-3de2-46d9-8373-4fa321d75539 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:30.572803 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5528996-3de2-46d9-8373-4fa321d75539 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:30.580856 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5528996-3de2-46d9-8373-4fa321d75539 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:14:30.582310 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5528996-3de2-46d9-8373-4fa321d75539 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:14:30.597022 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-e5528996-3de2-46d9-8373-4fa321d75539 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 20:14:30.597022 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:14:30.597022 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:14:30.597022 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:14:30.597022 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:14:30.597022 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:14:30.597022 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:14:30.597022 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:14:30.597022 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:14:30.597022 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:14:30.597022 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:14:30.597022 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:14:30.597022 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 20:14:30.597022 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 20:14:30.597022 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 20:14:30.598346 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 20:14:30.598346 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:14:30.598346 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:14:30.598346 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:14:30.598346 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:14:30.598346 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:14:30.598346 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:14:30.598346 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:14:30.598346 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:14:30.598346 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:14:30.598346 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:14:30.598346 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:14:30.598346 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:14:30.598346 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:14:30.598346 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:14:30.598346 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:14:30.598346 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:14:30.599868 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 20:14:30.599868 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 20:14:30.599868 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 20:14:30.599868 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 20:14:30.599868 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 20:14:30.599868 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 20:14:30.599868 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 20:14:30.599868 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:14:30.603050 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 612/1217] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 9 20:14:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:14:30.604757 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f42fcb-f686-45a7-bb17-c8916603ca53 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:14:30.722064 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f42fcb-f686-45a7-bb17-c8916603ca53 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:14:30.759148 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3887552-d1fe-4a69-987e-f2f1b697705f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:14:30.759842 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3887552-d1fe-4a69-987e-f2f1b697705f None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:30.760133 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3887552-d1fe-4a69-987e-f2f1b697705f None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:30.760412 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3887552-d1fe-4a69-987e-f2f1b697705f None admin] PATH_INFO: `/v3/projects` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:30.761190 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3887552-d1fe-4a69-987e-f2f1b697705f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:14:30.761483 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3887552-d1fe-4a69-987e-f2f1b697705f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:14:30.764326 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3887552-d1fe-4a69-987e-f2f1b697705f None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:14:30.776212 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 606/1218] 10.222.0.44 () {56 vars in 1148 bytes} [Mon May 9 20:14:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:14:30.782957 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5528996-3de2-46d9-8373-4fa321d75539 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:14:30.896035 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5528996-3de2-46d9-8373-4fa321d75539 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:14:30.936527 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0415bda3-f580-4e71-add9-8c6384e16dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:14:30.937183 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0415bda3-f580-4e71-add9-8c6384e16dc3 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:30.937466 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0415bda3-f580-4e71-add9-8c6384e16dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:30.937740 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0415bda3-f580-4e71-add9-8c6384e16dc3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:30.938612 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0415bda3-f580-4e71-add9-8c6384e16dc3 None admin] RBAC: Adding query filter params (role.id=1ec9314b191d4bd59d71fe4d635de747, scope.project.id=563db7f5a25f480e8e6568b92ec3f195, user.id=285198b50b50431f96f9225d106417a4) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:14:30.938884 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0415bda3-f580-4e71-add9-8c6384e16dc3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:14:30.940344 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0415bda3-f580-4e71-add9-8c6384e16dc3 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:14:30.946292 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 613/1219] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 9 20:14:30 2022] GET /identity/v3/role_assignments?user.id=285198b50b50431f96f9225d106417a4&scope.project.id=563db7f5a25f480e8e6568b92ec3f195&role.id=1ec9314b191d4bd59d71fe4d635de747 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:14:33.390430 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a353c4-533c-4399-b2c5-5ad319b3a67b None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:33.390974 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a353c4-533c-4399-b2c5-5ad319b3a67b None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:33.391053 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a353c4-533c-4399-b2c5-5ad319b3a67b None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:33.392427 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 607/1220] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:14:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:14:33.399561 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005fcd8-4973-41b7-b55a-aa4f532196fb None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:33.400083 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005fcd8-4973-41b7-b55a-aa4f532196fb None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:33.400083 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005fcd8-4973-41b7-b55a-aa4f532196fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:33.419420 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-a005fcd8-4973-41b7-b55a-aa4f532196fb None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:14:33.421251 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-a005fcd8-4973-41b7-b55a-aa4f532196fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:14:33.502638 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 614/1221] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:14:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 20:14:33.529172 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a353c4-533c-4399-b2c5-5ad319b3a67b None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:14:33.636653 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a353c4-533c-4399-b2c5-5ad319b3a67b None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:14:33.671338 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344aced1-c49d-4e13-91ce-88e6a9364c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:14:33.672093 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344aced1-c49d-4e13-91ce-88e6a9364c2c None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:33.672356 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344aced1-c49d-4e13-91ce-88e6a9364c2c None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:33.672624 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344aced1-c49d-4e13-91ce-88e6a9364c2c None admin] PATH_INFO: `/v3/roles/service` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:33.682301 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344aced1-c49d-4e13-91ce-88e6a9364c2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:14:33.691066 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-344aced1-c49d-4e13-91ce-88e6a9364c2c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 20:14:33.691066 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:14:33.691066 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:14:33.691066 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:14:33.691066 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:14:33.691066 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:14:33.691066 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:14:33.691066 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:14:33.691066 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:14:33.691066 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:14:33.691066 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:14:33.691066 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:14:33.691066 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:14:33.691066 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:14:33.691066 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:14:33.691066 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:14:33.692265 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:14:33.692265 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:14:33.692265 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:14:33.692265 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:14:33.692265 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:14:33.692265 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:14:33.692265 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:14:33.692265 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:14:33.692265 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:14:33.692265 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:14:33.692265 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:14:33.692265 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:14:33.692265 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:14:33.692265 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:14:33.692265 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:14:33.692265 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:14:33.693146 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:14:33.693146 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:14:33.693146 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:14:33.693146 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:14:33.693146 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:14:33.693146 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:14:33.693146 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:14:33.693146 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:14:33.693146 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:14:33.693146 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:14:33.693146 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 20:14:33.693146 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:14:33.693146 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 608/1222] 10.222.0.44 () {56 vars in 1102 bytes} [Mon May 9 20:14:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 20:14:33.703320 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a005fcd8-4973-41b7-b55a-aa4f532196fb None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:14:33.802187 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a005fcd8-4973-41b7-b55a-aa4f532196fb None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:14:33.837941 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd45210c-eabb-4a3d-9853-1e8cf3e4042b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:14:33.839450 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd45210c-eabb-4a3d-9853-1e8cf3e4042b None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:33.840156 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd45210c-eabb-4a3d-9853-1e8cf3e4042b None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:33.841147 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd45210c-eabb-4a3d-9853-1e8cf3e4042b None admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:33.842373 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd45210c-eabb-4a3d-9853-1e8cf3e4042b None admin] RBAC: Adding query filter params (name=service) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:14:33.843034 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd45210c-eabb-4a3d-9853-1e8cf3e4042b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:14:33.845059 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd45210c-eabb-4a3d-9853-1e8cf3e4042b None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:14:33.857310 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 615/1223] 10.222.0.44 () {56 vars in 1103 bytes} [Mon May 9 20:14:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:14:33.863294 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344aced1-c49d-4e13-91ce-88e6a9364c2c None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:14:33.970395 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344aced1-c49d-4e13-91ce-88e6a9364c2c None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:14:34.009898 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5057ab-d6f1-455e-be1d-cecc937de61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:14:34.010678 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5057ab-d6f1-455e-be1d-cecc937de61a None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:34.010959 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5057ab-d6f1-455e-be1d-cecc937de61a None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:34.011226 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5057ab-d6f1-455e-be1d-cecc937de61a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:34.023538 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5057ab-d6f1-455e-be1d-cecc937de61a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:14:34.025136 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5057ab-d6f1-455e-be1d-cecc937de61a None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:14:34.042679 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-7a5057ab-d6f1-455e-be1d-cecc937de61a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:14:34.042679 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:14:34.042679 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:14:34.042679 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:14:34.042679 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:14:34.042679 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:14:34.042679 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:14:34.042679 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:14:34.042679 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:14:34.042679 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:14:34.042679 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:14:34.042679 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:14:34.042679 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 20:14:34.042679 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 20:14:34.042679 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 20:14:34.044519 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 20:14:34.044519 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:14:34.044519 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:14:34.044519 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:14:34.044519 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:14:34.044519 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:14:34.044519 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:14:34.044519 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:14:34.044519 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:14:34.044519 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:14:34.044519 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:14:34.044519 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:14:34.044519 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:14:34.044519 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:14:34.044519 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:14:34.044519 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:14:34.044519 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:14:34.045489 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 20:14:34.045489 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 20:14:34.045489 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:14:34.045489 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:14:34.049798 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 609/1224] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:14:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:14:34.050926 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd45210c-eabb-4a3d-9853-1e8cf3e4042b None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:14:34.152199 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd45210c-eabb-4a3d-9853-1e8cf3e4042b None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:14:34.191425 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f89c967-3676-42d0-9eac-36f0582526f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:14:34.191425 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f89c967-3676-42d0-9eac-36f0582526f1 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:34.191425 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f89c967-3676-42d0-9eac-36f0582526f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:34.191425 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f89c967-3676-42d0-9eac-36f0582526f1 None admin] PATH_INFO: `/v3/domains` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:34.191956 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f89c967-3676-42d0-9eac-36f0582526f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:14:34.191956 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f89c967-3676-42d0-9eac-36f0582526f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:14:34.192434 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f89c967-3676-42d0-9eac-36f0582526f1 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:14:34.205082 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 616/1225] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 9 20:14:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:14:34.210597 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5057ab-d6f1-455e-be1d-cecc937de61a None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:14:34.318330 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5057ab-d6f1-455e-be1d-cecc937de61a None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:14:34.355064 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ae7c8-66d7-4b82-9712-2b68095940e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:14:34.355883 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ae7c8-66d7-4b82-9712-2b68095940e3 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:34.356273 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ae7c8-66d7-4b82-9712-2b68095940e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:34.356696 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ae7c8-66d7-4b82-9712-2b68095940e3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:34.364931 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26ae7c8-66d7-4b82-9712-2b68095940e3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:14:34.366505 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26ae7c8-66d7-4b82-9712-2b68095940e3 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:14:34.381260 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-e26ae7c8-66d7-4b82-9712-2b68095940e3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 09 20:14:34.381260 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:14:34.381260 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:14:34.381260 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:14:34.381260 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:14:34.381260 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:14:34.381260 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:14:34.381260 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:14:34.381260 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:14:34.381260 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:14:34.381260 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:14:34.381260 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:14:34.381260 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 20:14:34.381260 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 20:14:34.381260 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 20:14:34.381260 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 20:14:34.382608 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:14:34.382608 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:14:34.382608 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 20:14:34.382608 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 20:14:34.382608 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 20:14:34.382608 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 20:14:34.382608 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:14:34.382608 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:14:34.382608 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:14:34.382608 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:14:34.382608 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:14:34.382608 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:14:34.382608 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:14:34.382608 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:14:34.382608 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:14:34.382608 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:14:34.382608 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:14:34.382608 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:14:34.383881 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:14:34.383881 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:14:34.383881 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 20:14:34.383881 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 20:14:34.383881 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 20:14:34.383881 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 20:14:34.383881 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 20:14:34.383881 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 20:14:34.383881 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 09 20:14:34.383881 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:14:34.383881 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 610/1226] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:14:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:14:34.389201 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f89c967-3676-42d0-9eac-36f0582526f1 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:14:34.500742 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f89c967-3676-42d0-9eac-36f0582526f1 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:14:34.540673 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941dd240-8d12-423f-9026-889b28d89870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:14:34.541367 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941dd240-8d12-423f-9026-889b28d89870 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:34.541652 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941dd240-8d12-423f-9026-889b28d89870 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:34.541932 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941dd240-8d12-423f-9026-889b28d89870 None admin] PATH_INFO: `/v3/users` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:34.542778 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941dd240-8d12-423f-9026-889b28d89870 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:14:34.543086 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941dd240-8d12-423f-9026-889b28d89870 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:14:34.544641 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941dd240-8d12-423f-9026-889b28d89870 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:14:34.564770 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 617/1227] 10.222.0.44 () {56 vars in 1143 bytes} [Mon May 9 20:14:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:14:34.571055 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ae7c8-66d7-4b82-9712-2b68095940e3 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:14:34.678319 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ae7c8-66d7-4b82-9712-2b68095940e3 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:14:34.716334 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d793ff56-4382-49ea-8c5d-89fe7a67a79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:14:34.717219 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d793ff56-4382-49ea-8c5d-89fe7a67a79d None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:34.717434 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d793ff56-4382-49ea-8c5d-89fe7a67a79d None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:34.717699 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d793ff56-4382-49ea-8c5d-89fe7a67a79d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:34.733588 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d793ff56-4382-49ea-8c5d-89fe7a67a79d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:14:34.735802 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d793ff56-4382-49ea-8c5d-89fe7a67a79d None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:14:34.757322 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-d793ff56-4382-49ea-8c5d-89fe7a67a79d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:14:34.757322 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:14:34.757322 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:14:34.757322 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:14:34.757322 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:14:34.757322 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:14:34.757322 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:14:34.757322 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:14:34.757322 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:14:34.757322 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:14:34.757322 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:14:34.757322 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:14:34.757322 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 20:14:34.757322 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 20:14:34.757322 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 20:14:34.758500 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 20:14:34.758500 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:14:34.758500 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:14:34.758500 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:14:34.758500 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:14:34.758500 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:14:34.758500 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:14:34.758500 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:14:34.758500 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:14:34.758500 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:14:34.758500 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:14:34.758500 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:14:34.758500 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:14:34.758500 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:14:34.758500 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:14:34.758500 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:14:34.758500 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:14:34.764289 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 20:14:34.764289 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 20:14:34.764289 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:14:34.764289 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:14:34.764289 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 611/1228] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:14:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:14:34.764700 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941dd240-8d12-423f-9026-889b28d89870 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:14:34.873717 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941dd240-8d12-423f-9026-889b28d89870 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:14:34.907329 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cbe4bc-2de8-421a-a631-60d731c8f290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:14:34.908008 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cbe4bc-2de8-421a-a631-60d731c8f290 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:34.908284 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cbe4bc-2de8-421a-a631-60d731c8f290 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:34.908547 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cbe4bc-2de8-421a-a631-60d731c8f290 None admin] PATH_INFO: `/v3/domains` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:34.909254 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cbe4bc-2de8-421a-a631-60d731c8f290 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:14:34.909551 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cbe4bc-2de8-421a-a631-60d731c8f290 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:14:34.910898 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cbe4bc-2de8-421a-a631-60d731c8f290 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:14:34.923685 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 618/1229] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 9 20:14:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:14:34.929785 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d793ff56-4382-49ea-8c5d-89fe7a67a79d None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:14:35.053502 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d793ff56-4382-49ea-8c5d-89fe7a67a79d None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:14:35.089428 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd06a2f-1f87-4456-81b5-1a36fa7417f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:14:35.090200 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd06a2f-1f87-4456-81b5-1a36fa7417f7 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:35.090565 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd06a2f-1f87-4456-81b5-1a36fa7417f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:35.090828 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd06a2f-1f87-4456-81b5-1a36fa7417f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:35.099510 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd06a2f-1f87-4456-81b5-1a36fa7417f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:14:35.101006 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd06a2f-1f87-4456-81b5-1a36fa7417f7 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:14:35.122705 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-9bd06a2f-1f87-4456-81b5-1a36fa7417f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 20:14:35.122705 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:14:35.122705 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:14:35.122705 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:14:35.122705 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:14:35.122705 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:14:35.122705 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:14:35.122705 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:14:35.122705 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:14:35.122705 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:14:35.122705 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:14:35.122705 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:14:35.122705 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 20:14:35.122705 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 20:14:35.122705 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 20:14:35.129397 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 20:14:35.129397 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:14:35.129397 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:14:35.129397 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:14:35.129397 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:14:35.129397 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:14:35.129397 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:14:35.129397 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:14:35.129397 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:14:35.129397 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:14:35.129397 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:14:35.129397 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:14:35.129397 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:14:35.129397 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:14:35.129397 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:14:35.129397 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:14:35.129397 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:14:35.130567 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 20:14:35.130567 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 20:14:35.130567 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 20:14:35.130567 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 20:14:35.130567 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 20:14:35.130567 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 20:14:35.130567 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 20:14:35.130567 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:14:35.130567 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 612/1230] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 9 20:14:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 20:14:35.131166 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cbe4bc-2de8-421a-a631-60d731c8f290 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:14:35.240499 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cbe4bc-2de8-421a-a631-60d731c8f290 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:14:35.275787 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a994d83-e964-4167-bf30-47cb60a5cd41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:14:35.276608 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a994d83-e964-4167-bf30-47cb60a5cd41 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:35.276892 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a994d83-e964-4167-bf30-47cb60a5cd41 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:35.277161 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a994d83-e964-4167-bf30-47cb60a5cd41 None admin] PATH_INFO: `/v3/projects` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:35.278648 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a994d83-e964-4167-bf30-47cb60a5cd41 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:14:35.279008 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a994d83-e964-4167-bf30-47cb60a5cd41 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:14:35.280653 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a994d83-e964-4167-bf30-47cb60a5cd41 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:14:35.300204 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 619/1231] 10.222.0.44 () {56 vars in 1148 bytes} [Mon May 9 20:14:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:14:35.301372 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd06a2f-1f87-4456-81b5-1a36fa7417f7 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:14:35.407903 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd06a2f-1f87-4456-81b5-1a36fa7417f7 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:14:35.441719 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb586079-7ddc-4681-82ae-286c0d33be66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:14:35.442588 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb586079-7ddc-4681-82ae-286c0d33be66 None admin] REQUEST_METHOD: `PUT` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:35.442859 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb586079-7ddc-4681-82ae-286c0d33be66 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:35.443125 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb586079-7ddc-4681-82ae-286c0d33be66 None admin] PATH_INFO: `/v3/projects/563db7f5a25f480e8e6568b92ec3f195/users/285198b50b50431f96f9225d106417a4/roles/1ec9314b191d4bd59d71fe4d635de747` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:35.457379 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb586079-7ddc-4681-82ae-286c0d33be66 None admin] RBAC: Authorizing `identity:create_grant(project_id=563db7f5a25f480e8e6568b92ec3f195, user_id=285198b50b50431f96f9225d106417a4, role_id=1ec9314b191d4bd59d71fe4d635de747)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:14:35.458837 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb586079-7ddc-4681-82ae-286c0d33be66 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:14:35.472321 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 613/1232] 10.222.0.44 () {58 vars in 1439 bytes} [Mon May 9 20:14:35 2022] PUT /identity/v3/projects/563db7f5a25f480e8e6568b92ec3f195/users/285198b50b50431f96f9225d106417a4/roles/1ec9314b191d4bd59d71fe4d635de747 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:14:37.995020 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d30b4-6d95-4b83-be4d-661a74ec30e8 None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:37.995569 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d30b4-6d95-4b83-be4d-661a74ec30e8 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:37.995685 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d30b4-6d95-4b83-be4d-661a74ec30e8 None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:37.997319 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 620/1233] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:14:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:14:38.003367 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1757ad73-b152-480f-a477-2632d3dd54fb None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:38.003864 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1757ad73-b152-480f-a477-2632d3dd54fb None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:38.003973 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1757ad73-b152-480f-a477-2632d3dd54fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:38.030089 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-1757ad73-b152-480f-a477-2632d3dd54fb None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:14:38.030089 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-1757ad73-b152-480f-a477-2632d3dd54fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:14:38.099226 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 614/1234] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:14:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 20:14:38.122808 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174d30b4-6d95-4b83-be4d-661a74ec30e8 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:14:38.226488 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174d30b4-6d95-4b83-be4d-661a74ec30e8 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:14:38.267796 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6da5f06-8dfe-436d-b1a1-4fae1c0f2b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:14:38.268637 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da5f06-8dfe-436d-b1a1-4fae1c0f2b63 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:38.270881 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da5f06-8dfe-436d-b1a1-4fae1c0f2b63 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:38.271182 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da5f06-8dfe-436d-b1a1-4fae1c0f2b63 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:38.284323 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6da5f06-8dfe-436d-b1a1-4fae1c0f2b63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:14:38.292833 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-e6da5f06-8dfe-436d-b1a1-4fae1c0f2b63 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 20:14:38.292833 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:14:38.292833 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:14:38.292833 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:14:38.292833 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:14:38.292833 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:14:38.292833 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:14:38.292833 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:14:38.292833 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:14:38.292833 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:14:38.292833 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:14:38.292833 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:14:38.292833 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:14:38.292833 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:14:38.292833 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:14:38.292833 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:14:38.294782 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:14:38.294782 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:14:38.294782 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:14:38.294782 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:14:38.294782 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:14:38.294782 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:14:38.294782 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:14:38.294782 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:14:38.294782 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:14:38.294782 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:14:38.294782 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:14:38.294782 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:14:38.294782 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:14:38.294782 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:14:38.294782 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:14:38.294782 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:14:38.295962 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:14:38.295962 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:14:38.295962 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:14:38.295962 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:14:38.295962 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:14:38.295962 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:14:38.295962 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:14:38.295962 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:14:38.295962 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:14:38.295962 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:14:38.295962 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 20:14:38.295962 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:14:38.295962 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 621/1235] 10.222.0.44 () {56 vars in 1102 bytes} [Mon May 9 20:14:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 20:14:38.301787 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1757ad73-b152-480f-a477-2632d3dd54fb None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:14:38.408481 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1757ad73-b152-480f-a477-2632d3dd54fb None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:14:38.443941 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c78bfc-b056-499c-8e3e-b6fc30fc7b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:14:38.444595 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c78bfc-b056-499c-8e3e-b6fc30fc7b84 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:38.444872 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c78bfc-b056-499c-8e3e-b6fc30fc7b84 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:38.445138 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c78bfc-b056-499c-8e3e-b6fc30fc7b84 None admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:38.445877 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c78bfc-b056-499c-8e3e-b6fc30fc7b84 None admin] RBAC: Adding query filter params (name=service) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:14:38.446177 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c78bfc-b056-499c-8e3e-b6fc30fc7b84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:14:38.447565 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c78bfc-b056-499c-8e3e-b6fc30fc7b84 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:14:38.457014 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 615/1236] 10.222.0.44 () {56 vars in 1103 bytes} [Mon May 9 20:14:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:14:38.463033 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6da5f06-8dfe-436d-b1a1-4fae1c0f2b63 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:14:38.577850 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6da5f06-8dfe-436d-b1a1-4fae1c0f2b63 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:14:38.614393 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98849b7-14ac-4dc7-b37f-31a7d7ba2911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:14:38.615277 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98849b7-14ac-4dc7-b37f-31a7d7ba2911 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:38.615715 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98849b7-14ac-4dc7-b37f-31a7d7ba2911 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:38.615994 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98849b7-14ac-4dc7-b37f-31a7d7ba2911 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:38.628420 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98849b7-14ac-4dc7-b37f-31a7d7ba2911 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:14:38.630402 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98849b7-14ac-4dc7-b37f-31a7d7ba2911 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:14:38.650792 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-f98849b7-14ac-4dc7-b37f-31a7d7ba2911 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:14:38.650792 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:14:38.650792 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:14:38.650792 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:14:38.650792 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:14:38.650792 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:14:38.650792 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:14:38.650792 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:14:38.650792 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:14:38.650792 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:14:38.650792 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:14:38.650792 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:14:38.650792 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 20:14:38.650792 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 20:14:38.650792 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 20:14:38.652141 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 20:14:38.652141 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:14:38.652141 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:14:38.652141 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:14:38.652141 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:14:38.652141 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:14:38.652141 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:14:38.652141 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:14:38.652141 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:14:38.652141 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:14:38.652141 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:14:38.652141 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:14:38.652141 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:14:38.652141 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:14:38.652141 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:14:38.652141 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:14:38.652141 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:14:38.654746 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 20:14:38.654746 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 20:14:38.654746 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:14:38.654746 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:14:38.654746 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 622/1237] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:14:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 20:14:38.659609 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c78bfc-b056-499c-8e3e-b6fc30fc7b84 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:14:38.770277 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c78bfc-b056-499c-8e3e-b6fc30fc7b84 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:14:38.808484 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cddfed-3b6d-4177-8327-8ba97b39b5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:14:38.809308 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cddfed-3b6d-4177-8327-8ba97b39b5db None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:38.809629 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cddfed-3b6d-4177-8327-8ba97b39b5db None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:38.809889 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cddfed-3b6d-4177-8327-8ba97b39b5db None admin] PATH_INFO: `/v3/domains` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:38.810602 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cddfed-3b6d-4177-8327-8ba97b39b5db None admin] RBAC: Adding query filter params (name=Default) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:14:38.810900 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cddfed-3b6d-4177-8327-8ba97b39b5db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:14:38.812458 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cddfed-3b6d-4177-8327-8ba97b39b5db None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:14:38.827567 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 616/1238] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 9 20:14:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:14:38.833759 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98849b7-14ac-4dc7-b37f-31a7d7ba2911 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:14:38.947383 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98849b7-14ac-4dc7-b37f-31a7d7ba2911 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:14:38.987607 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1907f9c-6778-4c67-9770-6a8db73e3bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:14:38.988562 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1907f9c-6778-4c67-9770-6a8db73e3bd9 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:38.988980 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1907f9c-6778-4c67-9770-6a8db73e3bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:38.989357 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1907f9c-6778-4c67-9770-6a8db73e3bd9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:38.999019 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1907f9c-6778-4c67-9770-6a8db73e3bd9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:14:39.000975 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1907f9c-6778-4c67-9770-6a8db73e3bd9 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:14:39.020238 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-c1907f9c-6778-4c67-9770-6a8db73e3bd9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 09 20:14:39.020238 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:14:39.020238 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:14:39.020238 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:14:39.020238 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:14:39.020238 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:14:39.020238 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:14:39.020238 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:14:39.020238 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:14:39.020238 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:14:39.020238 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:14:39.020238 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:14:39.020238 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 20:14:39.020238 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 20:14:39.020238 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 20:14:39.020238 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 20:14:39.021449 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:14:39.021449 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:14:39.021449 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 20:14:39.021449 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 20:14:39.021449 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 20:14:39.021449 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 20:14:39.021449 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:14:39.021449 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:14:39.021449 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:14:39.021449 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:14:39.021449 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:14:39.021449 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:14:39.021449 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:14:39.021449 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:14:39.021449 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:14:39.021449 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:14:39.021449 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:14:39.021449 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:14:39.022451 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:14:39.022451 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:14:39.022451 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 20:14:39.022451 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 20:14:39.022451 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 20:14:39.022451 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 20:14:39.022451 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 20:14:39.022451 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 20:14:39.022451 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 09 20:14:39.022451 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:14:39.022451 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 623/1239] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:14:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:14:39.029718 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cddfed-3b6d-4177-8327-8ba97b39b5db None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:14:39.144326 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cddfed-3b6d-4177-8327-8ba97b39b5db None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:14:39.180163 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a2c66c-ac9d-480f-bacc-f84ffabf7ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:14:39.180821 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2c66c-ac9d-480f-bacc-f84ffabf7ea4 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:39.181101 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2c66c-ac9d-480f-bacc-f84ffabf7ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:39.181364 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2c66c-ac9d-480f-bacc-f84ffabf7ea4 None admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:39.182187 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a2c66c-ac9d-480f-bacc-f84ffabf7ea4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:14:39.182487 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a2c66c-ac9d-480f-bacc-f84ffabf7ea4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:14:39.183953 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a2c66c-ac9d-480f-bacc-f84ffabf7ea4 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:14:39.201305 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 617/1240] 10.222.0.44 () {56 vars in 1143 bytes} [Mon May 9 20:14:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:14:39.207664 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1907f9c-6778-4c67-9770-6a8db73e3bd9 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:14:39.314945 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1907f9c-6778-4c67-9770-6a8db73e3bd9 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:14:39.353271 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebb8551-14e5-42f8-92f5-5f847bb5bf50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:14:39.353973 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb8551-14e5-42f8-92f5-5f847bb5bf50 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:39.354253 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb8551-14e5-42f8-92f5-5f847bb5bf50 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:39.354519 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb8551-14e5-42f8-92f5-5f847bb5bf50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:39.422445 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebb8551-14e5-42f8-92f5-5f847bb5bf50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:14:39.424289 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebb8551-14e5-42f8-92f5-5f847bb5bf50 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:14:39.535387 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 624/1241] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 9 20:14:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 09 20:14:39.541476 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a2c66c-ac9d-480f-bacc-f84ffabf7ea4 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:14:39.652251 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a2c66c-ac9d-480f-bacc-f84ffabf7ea4 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:14:39.691599 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a844d22-c451-457b-b3f4-5c63e6103b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:14:39.692331 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a844d22-c451-457b-b3f4-5c63e6103b4f None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:39.692719 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a844d22-c451-457b-b3f4-5c63e6103b4f None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:39.692992 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a844d22-c451-457b-b3f4-5c63e6103b4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:39.704772 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a844d22-c451-457b-b3f4-5c63e6103b4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:14:39.706403 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a844d22-c451-457b-b3f4-5c63e6103b4f None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:14:39.726200 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-7a844d22-c451-457b-b3f4-5c63e6103b4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:14:39.726200 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:14:39.726200 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:14:39.726200 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:14:39.726200 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:14:39.726200 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:14:39.726200 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:14:39.726200 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:14:39.726200 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:14:39.726200 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:14:39.726200 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:14:39.726200 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:14:39.726200 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 20:14:39.726200 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 20:14:39.726200 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 20:14:39.727372 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 20:14:39.727372 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:14:39.727372 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:14:39.727372 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:14:39.727372 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:14:39.727372 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:14:39.727372 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:14:39.727372 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:14:39.727372 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:14:39.727372 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:14:39.727372 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:14:39.727372 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:14:39.727372 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:14:39.727372 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:14:39.727372 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:14:39.727372 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:14:39.727372 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:14:39.728868 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 20:14:39.728868 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 20:14:39.728868 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:14:39.728868 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:14:39.728868 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 618/1242] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:14:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:14:39.733883 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebb8551-14e5-42f8-92f5-5f847bb5bf50 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:14:39.843868 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebb8551-14e5-42f8-92f5-5f847bb5bf50 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:14:39.886416 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f4c15a-7abe-4ebe-b175-1ee86bc87d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:14:39.887456 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f4c15a-7abe-4ebe-b175-1ee86bc87d81 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:39.887854 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f4c15a-7abe-4ebe-b175-1ee86bc87d81 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:39.888225 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f4c15a-7abe-4ebe-b175-1ee86bc87d81 None admin] PATH_INFO: `/v3/domains` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:39.889102 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f4c15a-7abe-4ebe-b175-1ee86bc87d81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:14:39.889529 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f4c15a-7abe-4ebe-b175-1ee86bc87d81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:14:39.891139 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f4c15a-7abe-4ebe-b175-1ee86bc87d81 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:14:39.905271 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 625/1243] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 9 20:14:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:14:39.911311 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a844d22-c451-457b-b3f4-5c63e6103b4f None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:14:40.016475 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a844d22-c451-457b-b3f4-5c63e6103b4f None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:14:40.052970 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdd0db7-9b5c-4eaa-89a4-7d28340f96ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:14:40.053781 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd0db7-9b5c-4eaa-89a4-7d28340f96ee None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:40.054097 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd0db7-9b5c-4eaa-89a4-7d28340f96ee None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:40.054352 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd0db7-9b5c-4eaa-89a4-7d28340f96ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:40.062530 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdd0db7-9b5c-4eaa-89a4-7d28340f96ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:14:40.064158 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdd0db7-9b5c-4eaa-89a4-7d28340f96ee None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:14:40.078201 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-dcdd0db7-9b5c-4eaa-89a4-7d28340f96ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 20:14:40.078201 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:14:40.078201 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:14:40.078201 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:14:40.078201 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:14:40.078201 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:14:40.078201 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:14:40.078201 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:14:40.078201 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:14:40.078201 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:14:40.078201 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:14:40.078201 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:14:40.078201 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 20:14:40.078201 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 20:14:40.078201 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 20:14:40.079360 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 20:14:40.079360 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:14:40.079360 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:14:40.079360 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:14:40.079360 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:14:40.079360 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:14:40.079360 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:14:40.079360 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:14:40.079360 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:14:40.079360 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:14:40.079360 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:14:40.079360 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:14:40.079360 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:14:40.079360 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:14:40.079360 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:14:40.079360 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:14:40.079360 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:14:40.080463 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 20:14:40.080463 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 20:14:40.080463 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 20:14:40.080463 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 20:14:40.080463 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 20:14:40.080463 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 20:14:40.080463 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 20:14:40.080463 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:14:40.080463 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 619/1244] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 9 20:14:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:14:40.085318 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f4c15a-7abe-4ebe-b175-1ee86bc87d81 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:14:40.192409 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f4c15a-7abe-4ebe-b175-1ee86bc87d81 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:14:40.225027 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030e9099-3bf5-40f5-bec4-771554dd8b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:14:40.225757 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e9099-3bf5-40f5-bec4-771554dd8b06 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:40.226086 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e9099-3bf5-40f5-bec4-771554dd8b06 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:40.226406 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e9099-3bf5-40f5-bec4-771554dd8b06 None admin] PATH_INFO: `/v3/projects` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:40.227224 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030e9099-3bf5-40f5-bec4-771554dd8b06 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:14:40.227600 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030e9099-3bf5-40f5-bec4-771554dd8b06 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:14:40.229215 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030e9099-3bf5-40f5-bec4-771554dd8b06 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:14:40.242500 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 626/1245] 10.222.0.44 () {56 vars in 1148 bytes} [Mon May 9 20:14:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:14:40.249384 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdd0db7-9b5c-4eaa-89a4-7d28340f96ee None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:14:40.361269 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdd0db7-9b5c-4eaa-89a4-7d28340f96ee None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:14:40.398800 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74179f5-adee-4121-b023-d4efaefa0cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:14:40.399699 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74179f5-adee-4121-b023-d4efaefa0cc3 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:40.400100 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74179f5-adee-4121-b023-d4efaefa0cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:40.400382 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74179f5-adee-4121-b023-d4efaefa0cc3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:40.401343 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74179f5-adee-4121-b023-d4efaefa0cc3 None admin] RBAC: Adding query filter params (role.id=1ec9314b191d4bd59d71fe4d635de747, scope.project.id=563db7f5a25f480e8e6568b92ec3f195, user.id=285198b50b50431f96f9225d106417a4) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:14:40.401692 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74179f5-adee-4121-b023-d4efaefa0cc3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:14:40.403544 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74179f5-adee-4121-b023-d4efaefa0cc3 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:14:40.409942 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 620/1246] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 9 20:14:40 2022] GET /identity/v3/role_assignments?user.id=285198b50b50431f96f9225d106417a4&scope.project.id=563db7f5a25f480e8e6568b92ec3f195&role.id=1ec9314b191d4bd59d71fe4d635de747 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:14:42.944800 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aed138-071d-4b86-b14a-7a16106a1ecc None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:42.945334 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aed138-071d-4b86-b14a-7a16106a1ecc None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:42.945462 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aed138-071d-4b86-b14a-7a16106a1ecc None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:42.946951 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 627/1247] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:14:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 20:14:42.953888 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cad322-20d5-4e6d-be22-bdd4c93234aa None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:42.954362 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cad322-20d5-4e6d-be22-bdd4c93234aa None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:42.954535 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cad322-20d5-4e6d-be22-bdd4c93234aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:42.973056 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-e6cad322-20d5-4e6d-be22-bdd4c93234aa None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:14:42.974233 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-e6cad322-20d5-4e6d-be22-bdd4c93234aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:14:43.046500 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 621/1248] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:14:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 20:14:43.071963 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aed138-071d-4b86-b14a-7a16106a1ecc None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:14:43.191671 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aed138-071d-4b86-b14a-7a16106a1ecc None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:14:43.226019 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77d1a55-9268-44b6-aae9-5329bd8aa8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:14:43.226798 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d1a55-9268-44b6-aae9-5329bd8aa8bd None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:43.227114 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d1a55-9268-44b6-aae9-5329bd8aa8bd None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:43.227380 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d1a55-9268-44b6-aae9-5329bd8aa8bd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:43.237528 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77d1a55-9268-44b6-aae9-5329bd8aa8bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:14:43.244996 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-d77d1a55-9268-44b6-aae9-5329bd8aa8bd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 20:14:43.244996 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:14:43.244996 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:14:43.244996 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:14:43.244996 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:14:43.244996 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:14:43.244996 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:14:43.244996 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:14:43.244996 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:14:43.244996 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:14:43.244996 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:14:43.244996 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:14:43.244996 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:14:43.244996 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:14:43.244996 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:14:43.244996 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:14:43.251126 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:14:43.251126 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:14:43.251126 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:14:43.251126 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:14:43.251126 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:14:43.251126 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:14:43.251126 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:14:43.251126 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:14:43.251126 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:14:43.251126 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:14:43.251126 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:14:43.251126 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:14:43.251126 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:14:43.251126 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:14:43.251126 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:14:43.251126 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:14:43.252296 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:14:43.252296 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:14:43.252296 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:14:43.252296 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:14:43.252296 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:14:43.252296 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:14:43.252296 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:14:43.252296 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:14:43.252296 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:14:43.252296 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:14:43.252296 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 20:14:43.252296 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:14:43.252296 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 628/1249] 10.222.0.44 () {56 vars in 1096 bytes} [Mon May 9 20:14:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:14:43.253347 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cad322-20d5-4e6d-be22-bdd4c93234aa None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:14:43.356007 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cad322-20d5-4e6d-be22-bdd4c93234aa None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:14:43.397574 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a59659-a98e-4c00-b3ac-9c7dfbc7cbe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:14:43.398326 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a59659-a98e-4c00-b3ac-9c7dfbc7cbe3 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:43.398723 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a59659-a98e-4c00-b3ac-9c7dfbc7cbe3 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:43.398865 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a59659-a98e-4c00-b3ac-9c7dfbc7cbe3 None admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:43.399632 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a59659-a98e-4c00-b3ac-9c7dfbc7cbe3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:14:43.399930 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a59659-a98e-4c00-b3ac-9c7dfbc7cbe3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:14:43.401292 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a59659-a98e-4c00-b3ac-9c7dfbc7cbe3 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:14:43.411090 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 622/1250] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 9 20:14:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:14:43.416861 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77d1a55-9268-44b6-aae9-5329bd8aa8bd None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:14:43.530814 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77d1a55-9268-44b6-aae9-5329bd8aa8bd None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:14:43.568722 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b8de34-1d71-4d76-b872-8fe676e18eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:14:43.569626 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b8de34-1d71-4d76-b872-8fe676e18eb8 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:43.569940 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b8de34-1d71-4d76-b872-8fe676e18eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:43.570268 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b8de34-1d71-4d76-b872-8fe676e18eb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:43.584277 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b8de34-1d71-4d76-b872-8fe676e18eb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:14:43.585852 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b8de34-1d71-4d76-b872-8fe676e18eb8 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:14:43.605751 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-30b8de34-1d71-4d76-b872-8fe676e18eb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:14:43.605751 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:14:43.605751 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:14:43.605751 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:14:43.605751 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:14:43.605751 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:14:43.605751 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:14:43.605751 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:14:43.605751 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:14:43.605751 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:14:43.605751 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:14:43.605751 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:14:43.605751 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 20:14:43.605751 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 20:14:43.605751 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 20:14:43.607023 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 20:14:43.607023 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:14:43.607023 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:14:43.607023 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:14:43.607023 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:14:43.607023 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:14:43.607023 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:14:43.607023 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:14:43.607023 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:14:43.607023 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:14:43.607023 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:14:43.607023 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:14:43.607023 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:14:43.607023 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:14:43.607023 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:14:43.607023 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:14:43.607023 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:14:43.608262 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 20:14:43.608262 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 20:14:43.608262 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:14:43.608262 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:14:43.608262 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 629/1251] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:14:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:14:43.614199 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a59659-a98e-4c00-b3ac-9c7dfbc7cbe3 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:14:43.718093 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a59659-a98e-4c00-b3ac-9c7dfbc7cbe3 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:14:43.752193 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae00c58-4434-4edf-a44e-356275354992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:14:43.752866 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae00c58-4434-4edf-a44e-356275354992 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:43.753148 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae00c58-4434-4edf-a44e-356275354992 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:43.753421 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae00c58-4434-4edf-a44e-356275354992 None admin] PATH_INFO: `/v3/domains` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:43.754141 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae00c58-4434-4edf-a44e-356275354992 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:14:43.754473 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae00c58-4434-4edf-a44e-356275354992 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:14:43.755980 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae00c58-4434-4edf-a44e-356275354992 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:14:43.771406 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 623/1252] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 9 20:14:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:14:43.777364 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b8de34-1d71-4d76-b872-8fe676e18eb8 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:14:43.891971 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b8de34-1d71-4d76-b872-8fe676e18eb8 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:14:43.927592 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714918b5-98ca-4fb1-86b4-871bfc2bc749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:14:43.928630 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714918b5-98ca-4fb1-86b4-871bfc2bc749 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:43.928952 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714918b5-98ca-4fb1-86b4-871bfc2bc749 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:43.929225 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714918b5-98ca-4fb1-86b4-871bfc2bc749 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:43.937527 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714918b5-98ca-4fb1-86b4-871bfc2bc749 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:14:43.939098 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714918b5-98ca-4fb1-86b4-871bfc2bc749 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:14:43.954715 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-714918b5-98ca-4fb1-86b4-871bfc2bc749 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 09 20:14:43.954715 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:14:43.954715 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:14:43.954715 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:14:43.954715 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:14:43.954715 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:14:43.954715 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:14:43.954715 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:14:43.954715 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:14:43.954715 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:14:43.954715 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:14:43.954715 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:14:43.954715 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 20:14:43.954715 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 20:14:43.954715 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 20:14:43.954715 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 20:14:43.956368 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:14:43.956368 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:14:43.956368 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 20:14:43.956368 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 20:14:43.956368 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 20:14:43.956368 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 20:14:43.956368 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:14:43.956368 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:14:43.956368 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:14:43.956368 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:14:43.956368 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:14:43.956368 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:14:43.956368 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:14:43.956368 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:14:43.956368 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:14:43.956368 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:14:43.956368 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:14:43.956368 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:14:43.957603 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:14:43.957603 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:14:43.957603 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 20:14:43.957603 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 20:14:43.957603 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 20:14:43.957603 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 20:14:43.957603 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 20:14:43.957603 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 20:14:43.957603 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 09 20:14:43.957603 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:14:43.957603 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 630/1253] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:14:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:14:43.962278 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae00c58-4434-4edf-a44e-356275354992 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:14:44.066589 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae00c58-4434-4edf-a44e-356275354992 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:14:44.102687 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b6cb56-b69d-4c47-a9f6-85ced8a3bd9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:14:44.103378 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b6cb56-b69d-4c47-a9f6-85ced8a3bd9d None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:44.103754 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b6cb56-b69d-4c47-a9f6-85ced8a3bd9d None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:44.104024 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b6cb56-b69d-4c47-a9f6-85ced8a3bd9d None admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:44.104982 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b6cb56-b69d-4c47-a9f6-85ced8a3bd9d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:14:44.105366 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b6cb56-b69d-4c47-a9f6-85ced8a3bd9d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:14:44.106922 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b6cb56-b69d-4c47-a9f6-85ced8a3bd9d None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:14:44.125324 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 624/1254] 10.222.0.44 () {56 vars in 1143 bytes} [Mon May 9 20:14:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:14:44.131502 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714918b5-98ca-4fb1-86b4-871bfc2bc749 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:14:44.239178 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714918b5-98ca-4fb1-86b4-871bfc2bc749 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:14:44.276329 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a236ede7-1904-4c3a-83aa-efb3cbff577c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:14:44.277022 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a236ede7-1904-4c3a-83aa-efb3cbff577c None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:44.277318 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a236ede7-1904-4c3a-83aa-efb3cbff577c None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:44.278237 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a236ede7-1904-4c3a-83aa-efb3cbff577c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:44.349418 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a236ede7-1904-4c3a-83aa-efb3cbff577c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:14:44.350900 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a236ede7-1904-4c3a-83aa-efb3cbff577c None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:14:44.454051 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 631/1255] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 9 20:14:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 20:14:44.459901 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b6cb56-b69d-4c47-a9f6-85ced8a3bd9d None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:14:44.561616 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b6cb56-b69d-4c47-a9f6-85ced8a3bd9d None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:14:44.597989 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb595e2-479b-49a3-8f6f-99d37954c0f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:14:44.598786 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb595e2-479b-49a3-8f6f-99d37954c0f6 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:44.599064 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb595e2-479b-49a3-8f6f-99d37954c0f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:44.599334 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb595e2-479b-49a3-8f6f-99d37954c0f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:44.611041 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb595e2-479b-49a3-8f6f-99d37954c0f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:14:44.612574 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb595e2-479b-49a3-8f6f-99d37954c0f6 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:14:44.630358 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-bcb595e2-479b-49a3-8f6f-99d37954c0f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:14:44.630358 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:14:44.630358 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:14:44.630358 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:14:44.630358 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:14:44.630358 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:14:44.630358 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:14:44.630358 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:14:44.630358 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:14:44.630358 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:14:44.630358 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:14:44.630358 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:14:44.630358 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 20:14:44.630358 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 20:14:44.630358 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 20:14:44.631543 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 20:14:44.631543 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:14:44.631543 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:14:44.631543 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:14:44.631543 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:14:44.631543 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:14:44.631543 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:14:44.631543 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:14:44.631543 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:14:44.631543 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:14:44.631543 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:14:44.631543 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:14:44.631543 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:14:44.631543 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:14:44.631543 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:14:44.631543 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:14:44.631543 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:14:44.632459 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 20:14:44.632459 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 20:14:44.632459 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:14:44.632459 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:14:44.632459 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 625/1256] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:14:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:14:44.638435 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a236ede7-1904-4c3a-83aa-efb3cbff577c None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:14:44.733766 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a236ede7-1904-4c3a-83aa-efb3cbff577c None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:14:44.767409 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e4173b-5831-41de-a26b-a5884bafdf8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:14:44.768084 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e4173b-5831-41de-a26b-a5884bafdf8f None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:44.768366 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e4173b-5831-41de-a26b-a5884bafdf8f None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:44.768639 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e4173b-5831-41de-a26b-a5884bafdf8f None admin] PATH_INFO: `/v3/domains` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:44.769357 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e4173b-5831-41de-a26b-a5884bafdf8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:14:44.769662 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e4173b-5831-41de-a26b-a5884bafdf8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:14:44.771041 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e4173b-5831-41de-a26b-a5884bafdf8f None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:14:44.782392 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 632/1257] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 9 20:14:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:14:44.788108 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb595e2-479b-49a3-8f6f-99d37954c0f6 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:14:44.902051 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb595e2-479b-49a3-8f6f-99d37954c0f6 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:14:44.935788 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afbe1b9-35d9-4073-8aac-3b05bebc58ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:14:44.936568 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afbe1b9-35d9-4073-8aac-3b05bebc58ac None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:44.936847 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afbe1b9-35d9-4073-8aac-3b05bebc58ac None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:44.937115 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afbe1b9-35d9-4073-8aac-3b05bebc58ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:44.943420 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afbe1b9-35d9-4073-8aac-3b05bebc58ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:14:44.944855 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afbe1b9-35d9-4073-8aac-3b05bebc58ac None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:14:44.958219 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-4afbe1b9-35d9-4073-8aac-3b05bebc58ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 20:14:44.958219 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:14:44.958219 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:14:44.958219 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:14:44.958219 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:14:44.958219 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:14:44.958219 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:14:44.958219 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:14:44.958219 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:14:44.958219 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:14:44.958219 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:14:44.958219 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:14:44.958219 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 20:14:44.958219 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 20:14:44.958219 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 20:14:44.959250 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 20:14:44.959250 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:14:44.959250 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:14:44.959250 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:14:44.959250 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:14:44.959250 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:14:44.959250 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:14:44.959250 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:14:44.959250 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:14:44.959250 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:14:44.959250 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:14:44.959250 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:14:44.959250 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:14:44.959250 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:14:44.959250 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:14:44.959250 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:14:44.959250 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:14:44.960408 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 20:14:44.960408 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 20:14:44.960408 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 20:14:44.960408 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 20:14:44.960408 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 20:14:44.960408 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 20:14:44.960408 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 20:14:44.960408 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:14:44.960408 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 626/1258] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 9 20:14:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:14:44.967732 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e4173b-5831-41de-a26b-a5884bafdf8f None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:14:45.063232 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e4173b-5831-41de-a26b-a5884bafdf8f None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:14:45.098248 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b27de4-758d-400c-88eb-f52912b43262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:14:45.098896 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b27de4-758d-400c-88eb-f52912b43262 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:45.099261 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b27de4-758d-400c-88eb-f52912b43262 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:45.099762 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b27de4-758d-400c-88eb-f52912b43262 None admin] PATH_INFO: `/v3/projects` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:45.101044 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b27de4-758d-400c-88eb-f52912b43262 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:14:45.101525 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b27de4-758d-400c-88eb-f52912b43262 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:14:45.103747 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b27de4-758d-400c-88eb-f52912b43262 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:14:45.116861 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 633/1259] 10.222.0.44 () {56 vars in 1148 bytes} [Mon May 9 20:14:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:14:45.123498 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afbe1b9-35d9-4073-8aac-3b05bebc58ac None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:14:45.217254 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afbe1b9-35d9-4073-8aac-3b05bebc58ac None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:14:45.248079 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24996533-3650-4ab5-a327-b5bbb96d92d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:14:45.248698 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24996533-3650-4ab5-a327-b5bbb96d92d6 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:45.248971 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24996533-3650-4ab5-a327-b5bbb96d92d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:45.249234 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24996533-3650-4ab5-a327-b5bbb96d92d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:45.250038 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24996533-3650-4ab5-a327-b5bbb96d92d6 None admin] RBAC: Adding query filter params (role.id=274130b78e304bb88789c1b349263f3c, scope.project.id=563db7f5a25f480e8e6568b92ec3f195, user.id=285198b50b50431f96f9225d106417a4) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:14:45.250338 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24996533-3650-4ab5-a327-b5bbb96d92d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:14:45.251773 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24996533-3650-4ab5-a327-b5bbb96d92d6 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:14:45.256849 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 627/1260] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 9 20:14:45 2022] GET /identity/v3/role_assignments?user.id=285198b50b50431f96f9225d106417a4&scope.project.id=563db7f5a25f480e8e6568b92ec3f195&role.id=274130b78e304bb88789c1b349263f3c => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:14:47.523884 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd60458a-66f3-4fcb-9e88-183069b72b38 None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:47.524470 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd60458a-66f3-4fcb-9e88-183069b72b38 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:47.524470 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd60458a-66f3-4fcb-9e88-183069b72b38 None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:47.525806 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 634/1261] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:14:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:14:47.531215 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e1471-8281-4165-9c34-27cbca02c553 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:47.531714 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e1471-8281-4165-9c34-27cbca02c553 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:47.531817 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e1471-8281-4165-9c34-27cbca02c553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:47.549246 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-ea2e1471-8281-4165-9c34-27cbca02c553 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:14:47.550448 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-ea2e1471-8281-4165-9c34-27cbca02c553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:14:47.619430 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 628/1262] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:14:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 20:14:47.641800 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd60458a-66f3-4fcb-9e88-183069b72b38 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:14:47.740392 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd60458a-66f3-4fcb-9e88-183069b72b38 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:14:47.773441 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a21fba-9c69-4d5f-8aa8-0a159a2402cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:14:47.774270 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a21fba-9c69-4d5f-8aa8-0a159a2402cc None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:47.774495 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a21fba-9c69-4d5f-8aa8-0a159a2402cc None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:47.774768 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a21fba-9c69-4d5f-8aa8-0a159a2402cc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:47.784441 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a21fba-9c69-4d5f-8aa8-0a159a2402cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:14:47.791914 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-51a21fba-9c69-4d5f-8aa8-0a159a2402cc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 20:14:47.791914 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:14:47.791914 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:14:47.791914 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:14:47.791914 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:14:47.791914 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:14:47.791914 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:14:47.791914 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:14:47.791914 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:14:47.791914 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:14:47.791914 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:14:47.791914 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:14:47.791914 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:14:47.791914 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:14:47.791914 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:14:47.791914 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:14:47.792985 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:14:47.792985 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:14:47.792985 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:14:47.792985 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:14:47.792985 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:14:47.792985 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:14:47.792985 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:14:47.792985 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:14:47.792985 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:14:47.792985 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:14:47.792985 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:14:47.792985 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:14:47.792985 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:14:47.792985 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:14:47.792985 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:14:47.792985 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:14:47.793881 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:14:47.793881 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:14:47.793881 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:14:47.793881 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:14:47.793881 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:14:47.793881 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:14:47.793881 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:14:47.793881 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:14:47.793881 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:14:47.793881 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:14:47.793881 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 20:14:47.793881 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:14:47.793881 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 635/1263] 10.222.0.44 () {56 vars in 1096 bytes} [Mon May 9 20:14:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:14:47.799219 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2e1471-8281-4165-9c34-27cbca02c553 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:14:47.906311 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2e1471-8281-4165-9c34-27cbca02c553 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:14:47.937656 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4f368d-b2cd-41ac-8cf8-41ea541577f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:14:47.938302 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4f368d-b2cd-41ac-8cf8-41ea541577f0 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:47.938577 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4f368d-b2cd-41ac-8cf8-41ea541577f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:47.938841 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4f368d-b2cd-41ac-8cf8-41ea541577f0 None admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:47.939594 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4f368d-b2cd-41ac-8cf8-41ea541577f0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:14:47.939892 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4f368d-b2cd-41ac-8cf8-41ea541577f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:14:47.941240 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4f368d-b2cd-41ac-8cf8-41ea541577f0 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:14:47.948725 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 629/1264] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 9 20:14:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:14:47.955017 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a21fba-9c69-4d5f-8aa8-0a159a2402cc None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:14:48.052817 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a21fba-9c69-4d5f-8aa8-0a159a2402cc None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:14:48.084007 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a7f9e-f689-4dc6-a454-8e729fec2b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:14:48.084775 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a7f9e-f689-4dc6-a454-8e729fec2b69 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:48.085059 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a7f9e-f689-4dc6-a454-8e729fec2b69 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:48.085327 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a7f9e-f689-4dc6-a454-8e729fec2b69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:48.096237 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923a7f9e-f689-4dc6-a454-8e729fec2b69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:14:48.097704 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923a7f9e-f689-4dc6-a454-8e729fec2b69 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:14:48.113870 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-923a7f9e-f689-4dc6-a454-8e729fec2b69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:14:48.113870 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:14:48.113870 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:14:48.113870 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:14:48.113870 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:14:48.113870 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:14:48.113870 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:14:48.113870 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:14:48.113870 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:14:48.113870 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:14:48.113870 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:14:48.113870 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:14:48.113870 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 20:14:48.113870 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 20:14:48.113870 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 20:14:48.114918 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 20:14:48.114918 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:14:48.114918 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:14:48.114918 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:14:48.114918 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:14:48.114918 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:14:48.114918 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:14:48.114918 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:14:48.114918 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:14:48.114918 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:14:48.114918 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:14:48.114918 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:14:48.114918 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:14:48.114918 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:14:48.114918 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:14:48.114918 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:14:48.114918 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:14:48.116083 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 20:14:48.116083 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 20:14:48.116083 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:14:48.116083 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:14:48.116083 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 636/1265] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:14:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:14:48.120782 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4f368d-b2cd-41ac-8cf8-41ea541577f0 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:14:48.213573 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4f368d-b2cd-41ac-8cf8-41ea541577f0 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:14:48.245139 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c52a108-9588-43f7-9850-11183b6286de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:14:48.245781 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52a108-9588-43f7-9850-11183b6286de None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:48.246062 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52a108-9588-43f7-9850-11183b6286de None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:48.246359 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52a108-9588-43f7-9850-11183b6286de None admin] PATH_INFO: `/v3/domains` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:48.247305 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c52a108-9588-43f7-9850-11183b6286de None admin] RBAC: Adding query filter params (name=Default) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:14:48.247640 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c52a108-9588-43f7-9850-11183b6286de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:14:48.249003 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c52a108-9588-43f7-9850-11183b6286de None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:14:48.260638 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 630/1266] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 9 20:14:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:14:48.266866 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a7f9e-f689-4dc6-a454-8e729fec2b69 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:14:48.360251 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a7f9e-f689-4dc6-a454-8e729fec2b69 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:14:48.392084 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a35b2cb-a2fe-44a4-8304-923a13998e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:14:48.392854 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a35b2cb-a2fe-44a4-8304-923a13998e16 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:48.393130 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a35b2cb-a2fe-44a4-8304-923a13998e16 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:48.393396 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a35b2cb-a2fe-44a4-8304-923a13998e16 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:48.400501 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a35b2cb-a2fe-44a4-8304-923a13998e16 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:14:48.401925 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a35b2cb-a2fe-44a4-8304-923a13998e16 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:14:48.416291 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-6a35b2cb-a2fe-44a4-8304-923a13998e16 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 09 20:14:48.416291 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:14:48.416291 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:14:48.416291 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:14:48.416291 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:14:48.416291 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:14:48.416291 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:14:48.416291 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:14:48.416291 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:14:48.416291 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:14:48.416291 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:14:48.416291 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:14:48.416291 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 20:14:48.416291 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 20:14:48.416291 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 20:14:48.416291 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 20:14:48.417364 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:14:48.417364 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:14:48.417364 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 20:14:48.417364 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 20:14:48.417364 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 20:14:48.417364 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 20:14:48.417364 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:14:48.417364 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:14:48.417364 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:14:48.417364 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:14:48.417364 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:14:48.417364 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:14:48.417364 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:14:48.417364 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:14:48.417364 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:14:48.417364 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:14:48.417364 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:14:48.417364 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:14:48.423079 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:14:48.423079 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:14:48.423079 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 20:14:48.423079 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 20:14:48.423079 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 20:14:48.423079 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 20:14:48.423079 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 20:14:48.423079 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 20:14:48.423079 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 09 20:14:48.423079 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:14:48.423079 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 637/1267] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:14:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 20:14:48.423841 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c52a108-9588-43f7-9850-11183b6286de None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:14:48.515175 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c52a108-9588-43f7-9850-11183b6286de None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:14:48.546426 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b637a5cb-1f39-408b-9c45-41eb0ecdeed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:14:48.547071 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b637a5cb-1f39-408b-9c45-41eb0ecdeed2 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:48.547348 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b637a5cb-1f39-408b-9c45-41eb0ecdeed2 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:48.547644 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b637a5cb-1f39-408b-9c45-41eb0ecdeed2 None admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:48.548458 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b637a5cb-1f39-408b-9c45-41eb0ecdeed2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:14:48.548758 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b637a5cb-1f39-408b-9c45-41eb0ecdeed2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:14:48.550190 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b637a5cb-1f39-408b-9c45-41eb0ecdeed2 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:14:48.566346 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 631/1268] 10.222.0.44 () {56 vars in 1143 bytes} [Mon May 9 20:14:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:14:48.571802 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a35b2cb-a2fe-44a4-8304-923a13998e16 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:14:48.665619 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a35b2cb-a2fe-44a4-8304-923a13998e16 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:14:48.696129 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a54d15-aa5e-4f50-a264-86662bdf5c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:14:48.696888 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a54d15-aa5e-4f50-a264-86662bdf5c0d None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:48.697163 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a54d15-aa5e-4f50-a264-86662bdf5c0d None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:48.697429 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a54d15-aa5e-4f50-a264-86662bdf5c0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:48.707778 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a54d15-aa5e-4f50-a264-86662bdf5c0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:14:48.709194 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a54d15-aa5e-4f50-a264-86662bdf5c0d None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:14:48.725402 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-88a54d15-aa5e-4f50-a264-86662bdf5c0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:14:48.725402 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:14:48.725402 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:14:48.725402 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:14:48.725402 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:14:48.725402 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:14:48.725402 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:14:48.725402 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:14:48.725402 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:14:48.725402 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:14:48.725402 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:14:48.725402 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:14:48.725402 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 20:14:48.725402 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 20:14:48.725402 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 20:14:48.726432 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 20:14:48.726432 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:14:48.726432 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:14:48.726432 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:14:48.726432 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:14:48.726432 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:14:48.726432 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:14:48.726432 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:14:48.726432 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:14:48.726432 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:14:48.726432 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:14:48.726432 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:14:48.726432 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:14:48.726432 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:14:48.726432 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:14:48.726432 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:14:48.726432 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:14:48.727362 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 20:14:48.727362 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 20:14:48.727362 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:14:48.727362 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:14:48.727362 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 638/1269] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:14:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:14:48.732737 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b637a5cb-1f39-408b-9c45-41eb0ecdeed2 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:14:48.829279 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b637a5cb-1f39-408b-9c45-41eb0ecdeed2 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:14:48.867707 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b2e8d5-27b3-4f93-b11e-62b60647d46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:14:48.868359 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2e8d5-27b3-4f93-b11e-62b60647d46c None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:48.868638 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2e8d5-27b3-4f93-b11e-62b60647d46c None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:48.868909 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2e8d5-27b3-4f93-b11e-62b60647d46c None admin] PATH_INFO: `/v3/domains` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:48.869618 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b2e8d5-27b3-4f93-b11e-62b60647d46c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:14:48.869920 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b2e8d5-27b3-4f93-b11e-62b60647d46c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:14:48.871293 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b2e8d5-27b3-4f93-b11e-62b60647d46c None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:14:48.882275 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 632/1270] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 9 20:14:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:14:48.888418 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a54d15-aa5e-4f50-a264-86662bdf5c0d None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:14:48.981527 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a54d15-aa5e-4f50-a264-86662bdf5c0d None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:14:49.012788 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aa757e-fcea-4f25-aefc-a7cd7426836e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:14:49.013552 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aa757e-fcea-4f25-aefc-a7cd7426836e None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:49.013834 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aa757e-fcea-4f25-aefc-a7cd7426836e None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:49.014106 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aa757e-fcea-4f25-aefc-a7cd7426836e None admin] PATH_INFO: `/v3/projects/service` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:49.020423 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aa757e-fcea-4f25-aefc-a7cd7426836e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:14:49.021847 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aa757e-fcea-4f25-aefc-a7cd7426836e None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:14:49.036018 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-18aa757e-fcea-4f25-aefc-a7cd7426836e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 20:14:49.036018 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:14:49.036018 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:14:49.036018 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:14:49.036018 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:14:49.036018 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:14:49.036018 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:14:49.036018 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:14:49.036018 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:14:49.036018 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:14:49.036018 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:14:49.036018 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:14:49.036018 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 20:14:49.036018 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 20:14:49.036018 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 20:14:49.037060 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 20:14:49.037060 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:14:49.037060 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:14:49.037060 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:14:49.037060 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:14:49.037060 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:14:49.037060 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:14:49.037060 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:14:49.037060 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:14:49.037060 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:14:49.037060 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:14:49.037060 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:14:49.037060 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:14:49.037060 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:14:49.037060 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:14:49.037060 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:14:49.037060 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:14:49.038155 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 20:14:49.038155 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 20:14:49.038155 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 20:14:49.038155 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 20:14:49.038155 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 20:14:49.038155 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 20:14:49.038155 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 20:14:49.038155 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:14:49.038155 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 639/1271] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 9 20:14:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:14:49.042964 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b2e8d5-27b3-4f93-b11e-62b60647d46c None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:14:49.134707 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b2e8d5-27b3-4f93-b11e-62b60647d46c None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:14:49.167597 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb58eb86-380e-44bb-be56-a5a05628f9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:14:49.168382 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb58eb86-380e-44bb-be56-a5a05628f9f3 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:49.168724 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb58eb86-380e-44bb-be56-a5a05628f9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:49.168973 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb58eb86-380e-44bb-be56-a5a05628f9f3 None admin] PATH_INFO: `/v3/projects` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:49.169739 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb58eb86-380e-44bb-be56-a5a05628f9f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:14:49.170068 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb58eb86-380e-44bb-be56-a5a05628f9f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:14:49.171668 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb58eb86-380e-44bb-be56-a5a05628f9f3 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:14:49.183374 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 633/1272] 10.222.0.44 () {56 vars in 1148 bytes} [Mon May 9 20:14:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:14:49.189731 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aa757e-fcea-4f25-aefc-a7cd7426836e None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:14:49.283450 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aa757e-fcea-4f25-aefc-a7cd7426836e None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:14:49.314683 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d5056b-821b-41db-b2ca-fc59d2806758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:14:49.315576 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5056b-821b-41db-b2ca-fc59d2806758 None admin] REQUEST_METHOD: `PUT` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:49.315856 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5056b-821b-41db-b2ca-fc59d2806758 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:49.316124 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5056b-821b-41db-b2ca-fc59d2806758 None admin] PATH_INFO: `/v3/projects/563db7f5a25f480e8e6568b92ec3f195/users/285198b50b50431f96f9225d106417a4/roles/274130b78e304bb88789c1b349263f3c` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:49.318040 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d5056b-821b-41db-b2ca-fc59d2806758 None admin] RBAC: Authorizing `identity:create_grant(project_id=563db7f5a25f480e8e6568b92ec3f195, user_id=285198b50b50431f96f9225d106417a4, role_id=274130b78e304bb88789c1b349263f3c)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:14:49.319476 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d5056b-821b-41db-b2ca-fc59d2806758 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:14:49.331826 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 640/1273] 10.222.0.44 () {58 vars in 1439 bytes} [Mon May 9 20:14:49 2022] PUT /identity/v3/projects/563db7f5a25f480e8e6568b92ec3f195/users/285198b50b50431f96f9225d106417a4/roles/274130b78e304bb88789c1b349263f3c => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:14:51.533581 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b5619-1597-47b5-8909-3de18945d63c None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:51.534118 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b5619-1597-47b5-8909-3de18945d63c None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:51.534118 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b5619-1597-47b5-8909-3de18945d63c None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:51.535497 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 634/1274] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:14:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:14:51.540599 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd64c48-70af-4ad0-8799-0850cd9639cc None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:51.541001 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd64c48-70af-4ad0-8799-0850cd9639cc None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:51.541242 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd64c48-70af-4ad0-8799-0850cd9639cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:51.560595 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-3dd64c48-70af-4ad0-8799-0850cd9639cc None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:14:51.561887 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-3dd64c48-70af-4ad0-8799-0850cd9639cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:14:51.625134 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 641/1275] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:14:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 20:14:51.648060 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971b5619-1597-47b5-8909-3de18945d63c None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:14:51.742316 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971b5619-1597-47b5-8909-3de18945d63c None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:14:51.774309 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350712e4-34e5-4536-b232-0d87790cef64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:14:51.775071 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350712e4-34e5-4536-b232-0d87790cef64 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:51.775351 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350712e4-34e5-4536-b232-0d87790cef64 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:51.775654 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350712e4-34e5-4536-b232-0d87790cef64 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:51.785803 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350712e4-34e5-4536-b232-0d87790cef64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 20:14:51.793199 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-350712e4-34e5-4536-b232-0d87790cef64 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 20:14:51.793199 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:14:51.793199 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:14:51.793199 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:14:51.793199 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:14:51.793199 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:14:51.793199 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:14:51.793199 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:14:51.793199 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:14:51.793199 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:14:51.793199 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:14:51.793199 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:14:51.793199 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 20:14:51.793199 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 20:14:51.793199 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 20:14:51.793199 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 20:14:51.794395 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 20:14:51.794395 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 20:14:51.794395 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 20:14:51.794395 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 20:14:51.794395 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:14:51.794395 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:14:51.794395 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:14:51.794395 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:14:51.794395 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:14:51.794395 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:14:51.794395 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:14:51.794395 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:14:51.794395 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:14:51.794395 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:14:51.794395 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:14:51.794395 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:14:51.795302 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:14:51.795302 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:14:51.795302 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:14:51.795302 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:14:51.795302 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 20:14:51.795302 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 20:14:51.795302 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 20:14:51.795302 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 20:14:51.795302 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 20:14:51.795302 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 20:14:51.795302 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 20:14:51.795302 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:14:51.795302 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 635/1276] 10.222.0.44 () {56 vars in 1096 bytes} [Mon May 9 20:14:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:14:51.800425 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd64c48-70af-4ad0-8799-0850cd9639cc None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:14:51.912664 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd64c48-70af-4ad0-8799-0850cd9639cc None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:14:51.944096 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95f206e-f8e2-4a28-816d-2fb8c088eb55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:14:51.944740 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f206e-f8e2-4a28-816d-2fb8c088eb55 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:51.945015 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f206e-f8e2-4a28-816d-2fb8c088eb55 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:51.945280 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f206e-f8e2-4a28-816d-2fb8c088eb55 None admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:51.946006 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95f206e-f8e2-4a28-816d-2fb8c088eb55 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:14:51.946302 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95f206e-f8e2-4a28-816d-2fb8c088eb55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:14:51.947679 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95f206e-f8e2-4a28-816d-2fb8c088eb55 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:14:51.955821 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 642/1277] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 9 20:14:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:14:51.961437 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350712e4-34e5-4536-b232-0d87790cef64 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:14:52.054590 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350712e4-34e5-4536-b232-0d87790cef64 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:14:52.084985 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1738b55-c58a-465b-ae03-d8c2e3ad3401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:14:52.085749 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1738b55-c58a-465b-ae03-d8c2e3ad3401 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:52.086027 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1738b55-c58a-465b-ae03-d8c2e3ad3401 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:52.086294 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1738b55-c58a-465b-ae03-d8c2e3ad3401 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:52.096530 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1738b55-c58a-465b-ae03-d8c2e3ad3401 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:14:52.098041 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1738b55-c58a-465b-ae03-d8c2e3ad3401 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:14:52.115048 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-f1738b55-c58a-465b-ae03-d8c2e3ad3401 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:14:52.115048 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:14:52.115048 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:14:52.115048 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:14:52.115048 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:14:52.115048 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:14:52.115048 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:14:52.115048 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:14:52.115048 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:14:52.115048 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:14:52.115048 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:14:52.115048 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:14:52.115048 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 20:14:52.115048 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 20:14:52.115048 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 20:14:52.116108 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 20:14:52.116108 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:14:52.116108 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:14:52.116108 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:14:52.116108 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:14:52.116108 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:14:52.116108 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:14:52.116108 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:14:52.116108 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:14:52.116108 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:14:52.116108 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:14:52.116108 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:14:52.116108 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:14:52.116108 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:14:52.116108 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:14:52.116108 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:14:52.116108 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:14:52.117051 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 20:14:52.117051 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 20:14:52.117051 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:14:52.117051 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:14:52.117051 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 636/1278] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:14:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:14:52.122193 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95f206e-f8e2-4a28-816d-2fb8c088eb55 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:14:52.216682 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95f206e-f8e2-4a28-816d-2fb8c088eb55 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:14:52.247529 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fed573-12b1-4b0f-9ad5-af93bf25ed92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:14:52.248169 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fed573-12b1-4b0f-9ad5-af93bf25ed92 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:52.248450 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fed573-12b1-4b0f-9ad5-af93bf25ed92 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:52.248723 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fed573-12b1-4b0f-9ad5-af93bf25ed92 None admin] PATH_INFO: `/v3/domains` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:52.249432 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fed573-12b1-4b0f-9ad5-af93bf25ed92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:14:52.249738 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fed573-12b1-4b0f-9ad5-af93bf25ed92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:14:52.251115 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fed573-12b1-4b0f-9ad5-af93bf25ed92 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:14:52.262716 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 643/1279] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 9 20:14:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:14:52.268209 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1738b55-c58a-465b-ae03-d8c2e3ad3401 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:14:52.360705 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1738b55-c58a-465b-ae03-d8c2e3ad3401 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:14:52.391378 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642471a3-889e-4d7b-bbcc-aca506422526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:14:52.392180 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642471a3-889e-4d7b-bbcc-aca506422526 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:52.392456 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642471a3-889e-4d7b-bbcc-aca506422526 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:52.392724 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642471a3-889e-4d7b-bbcc-aca506422526 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:52.399705 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642471a3-889e-4d7b-bbcc-aca506422526 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:14:52.401126 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642471a3-889e-4d7b-bbcc-aca506422526 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:14:52.415158 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-642471a3-889e-4d7b-bbcc-aca506422526 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 09 20:14:52.415158 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:14:52.415158 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:14:52.415158 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:14:52.415158 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:14:52.415158 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:14:52.415158 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:14:52.415158 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:14:52.415158 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:14:52.415158 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:14:52.415158 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:14:52.415158 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:14:52.415158 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 20:14:52.415158 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 20:14:52.415158 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 20:14:52.415158 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 20:14:52.416241 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:14:52.416241 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:14:52.416241 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 20:14:52.416241 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 20:14:52.416241 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 20:14:52.416241 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 20:14:52.416241 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:14:52.416241 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:14:52.416241 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:14:52.416241 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:14:52.416241 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:14:52.416241 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:14:52.416241 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:14:52.416241 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:14:52.416241 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:14:52.416241 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:14:52.416241 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:14:52.416241 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:14:52.417368 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:14:52.417368 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:14:52.417368 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 20:14:52.417368 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 20:14:52.417368 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 20:14:52.417368 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 20:14:52.417368 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 20:14:52.417368 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 20:14:52.417368 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 09 20:14:52.417368 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:14:52.417368 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 637/1280] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:14:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:14:52.422049 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fed573-12b1-4b0f-9ad5-af93bf25ed92 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:14:52.514742 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fed573-12b1-4b0f-9ad5-af93bf25ed92 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:14:52.548588 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe43d209-7a7c-4512-a68e-12238604f163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:14:52.549292 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe43d209-7a7c-4512-a68e-12238604f163 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:52.549612 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe43d209-7a7c-4512-a68e-12238604f163 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:52.549914 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe43d209-7a7c-4512-a68e-12238604f163 None admin] PATH_INFO: `/v3/users` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:52.550845 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe43d209-7a7c-4512-a68e-12238604f163 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:14:52.551195 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe43d209-7a7c-4512-a68e-12238604f163 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:14:52.552734 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe43d209-7a7c-4512-a68e-12238604f163 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:14:52.569413 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 644/1281] 10.222.0.44 () {56 vars in 1143 bytes} [Mon May 9 20:14:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:14:52.575653 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642471a3-889e-4d7b-bbcc-aca506422526 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:14:52.668714 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642471a3-889e-4d7b-bbcc-aca506422526 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:14:52.700124 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f203006a-6b53-4baa-a7a9-280deb7ac728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:14:52.700838 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f203006a-6b53-4baa-a7a9-280deb7ac728 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:52.701117 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f203006a-6b53-4baa-a7a9-280deb7ac728 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:52.701386 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f203006a-6b53-4baa-a7a9-280deb7ac728 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:52.764106 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f203006a-6b53-4baa-a7a9-280deb7ac728 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:14:52.765561 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f203006a-6b53-4baa-a7a9-280deb7ac728 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:14:52.859006 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 638/1282] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 9 20:14:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 20:14:52.864787 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe43d209-7a7c-4512-a68e-12238604f163 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:14:52.956011 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe43d209-7a7c-4512-a68e-12238604f163 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:14:52.987459 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbf8b10-2153-4e80-bf69-8e5e42e12677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:14:52.988227 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf8b10-2153-4e80-bf69-8e5e42e12677 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:52.988506 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf8b10-2153-4e80-bf69-8e5e42e12677 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:52.988779 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf8b10-2153-4e80-bf69-8e5e42e12677 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:52.998261 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbf8b10-2153-4e80-bf69-8e5e42e12677 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:14:52.999710 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbf8b10-2153-4e80-bf69-8e5e42e12677 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:14:53.016658 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-cdbf8b10-2153-4e80-bf69-8e5e42e12677 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:14:53.016658 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:14:53.016658 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:14:53.016658 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:14:53.016658 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:14:53.016658 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:14:53.016658 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:14:53.016658 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:14:53.016658 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:14:53.016658 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:14:53.016658 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:14:53.016658 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:14:53.016658 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 20:14:53.016658 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 20:14:53.016658 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 20:14:53.017685 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 20:14:53.017685 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:14:53.017685 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:14:53.017685 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:14:53.017685 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:14:53.017685 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:14:53.017685 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:14:53.017685 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:14:53.017685 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:14:53.017685 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:14:53.017685 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:14:53.017685 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:14:53.017685 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:14:53.017685 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:14:53.017685 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:14:53.017685 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:14:53.017685 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:14:53.018695 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 20:14:53.018695 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 20:14:53.018695 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 20:14:53.018695 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:14:53.018695 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 645/1283] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:14:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:14:53.023328 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f203006a-6b53-4baa-a7a9-280deb7ac728 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:14:53.113691 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f203006a-6b53-4baa-a7a9-280deb7ac728 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:14:53.144732 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978dd967-ecf4-48ca-8668-e2b3c5686fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:14:53.145360 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978dd967-ecf4-48ca-8668-e2b3c5686fbe None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:53.145630 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978dd967-ecf4-48ca-8668-e2b3c5686fbe None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:53.145894 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978dd967-ecf4-48ca-8668-e2b3c5686fbe None admin] PATH_INFO: `/v3/domains` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:53.146591 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978dd967-ecf4-48ca-8668-e2b3c5686fbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:14:53.146888 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978dd967-ecf4-48ca-8668-e2b3c5686fbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:14:53.148274 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978dd967-ecf4-48ca-8668-e2b3c5686fbe None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:14:53.158679 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 639/1284] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 9 20:14:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:14:53.164213 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbf8b10-2153-4e80-bf69-8e5e42e12677 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:14:53.258551 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbf8b10-2153-4e80-bf69-8e5e42e12677 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:14:53.291083 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43eaa86-1624-4509-97b1-c6232cf4b2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:14:53.291866 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43eaa86-1624-4509-97b1-c6232cf4b2ae None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:53.292140 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43eaa86-1624-4509-97b1-c6232cf4b2ae None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:53.292404 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43eaa86-1624-4509-97b1-c6232cf4b2ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:53.299173 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43eaa86-1624-4509-97b1-c6232cf4b2ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:14:53.300628 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43eaa86-1624-4509-97b1-c6232cf4b2ae None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:14:53.313595 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application [None req-e43eaa86-1624-4509-97b1-c6232cf4b2ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 20:14:53.313595 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:14:53.313595 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:14:53.313595 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:14:53.313595 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:14:53.313595 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:14:53.313595 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:14:53.313595 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:14:53.313595 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:14:53.313595 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:14:53.313595 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:14:53.313595 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:14:53.313595 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 20:14:53.313595 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 20:14:53.313595 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 20:14:53.314539 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 20:14:53.314539 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:14:53.314539 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:14:53.314539 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:14:53.314539 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:14:53.314539 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:14:53.314539 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:14:53.314539 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:14:53.314539 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application with Lock( May 09 20:14:53.314539 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:14:53.314539 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._enter() May 09 20:14:53.314539 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:14:53.314539 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:14:53.314539 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:14:53.314539 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.creator() May 09 20:14:53.314539 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:14:53.314539 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application created_value = creator( May 09 20:14:53.315471 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 20:14:53.315471 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 20:14:53.315471 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 20:14:53.315471 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 20:14:53.315471 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 20:14:53.315471 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 20:14:53.315471 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 20:14:53.315471 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: ERROR keystone.server.flask.application May 09 20:14:53.315471 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 646/1285] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 9 20:14:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:14:53.320468 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978dd967-ecf4-48ca-8668-e2b3c5686fbe None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:14:53.414248 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978dd967-ecf4-48ca-8668-e2b3c5686fbe None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:14:53.444983 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a5f2d7-e86c-49f4-9c5f-11b705ad1760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:14:53.445611 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a5f2d7-e86c-49f4-9c5f-11b705ad1760 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:53.445887 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a5f2d7-e86c-49f4-9c5f-11b705ad1760 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:53.446154 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a5f2d7-e86c-49f4-9c5f-11b705ad1760 None admin] PATH_INFO: `/v3/projects` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:53.446919 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a5f2d7-e86c-49f4-9c5f-11b705ad1760 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:14:53.447219 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a5f2d7-e86c-49f4-9c5f-11b705ad1760 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:14:53.448674 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a5f2d7-e86c-49f4-9c5f-11b705ad1760 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:14:53.459826 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 640/1286] 10.222.0.44 () {56 vars in 1148 bytes} [Mon May 9 20:14:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:14:53.466183 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43eaa86-1624-4509-97b1-c6232cf4b2ae None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:14:53.558350 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43eaa86-1624-4509-97b1-c6232cf4b2ae None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:14:53.589639 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc0fe22-d8d6-49a0-8462-af7eda1d9d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:14:53.591110 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc0fe22-d8d6-49a0-8462-af7eda1d9d72 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:53.591381 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc0fe22-d8d6-49a0-8462-af7eda1d9d72 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:53.591672 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc0fe22-d8d6-49a0-8462-af7eda1d9d72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:53.592486 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc0fe22-d8d6-49a0-8462-af7eda1d9d72 None admin] RBAC: Adding query filter params (role.id=274130b78e304bb88789c1b349263f3c, scope.project.id=563db7f5a25f480e8e6568b92ec3f195, user.id=285198b50b50431f96f9225d106417a4) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:14:53.592788 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc0fe22-d8d6-49a0-8462-af7eda1d9d72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:14:53.594195 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc0fe22-d8d6-49a0-8462-af7eda1d9d72 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:14:53.599727 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 647/1287] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 9 20:14:53 2022] GET /identity/v3/role_assignments?user.id=285198b50b50431f96f9225d106417a4&scope.project.id=563db7f5a25f480e8e6568b92ec3f195&role.id=274130b78e304bb88789c1b349263f3c => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:14:55.806322 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45086fd-da51-44ca-ae96-3fbedcce593b None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:55.806864 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45086fd-da51-44ca-ae96-3fbedcce593b None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:55.806864 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45086fd-da51-44ca-ae96-3fbedcce593b None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:55.808237 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 641/1288] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:14:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:14:55.813918 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79acd4-6361-46ab-8d13-2850628d83e7 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:55.814337 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79acd4-6361-46ab-8d13-2850628d83e7 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:55.814466 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79acd4-6361-46ab-8d13-2850628d83e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:55.832433 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-cb79acd4-6361-46ab-8d13-2850628d83e7 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:14:55.833596 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-cb79acd4-6361-46ab-8d13-2850628d83e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:14:55.906622 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 648/1289] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:14:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 20:14:55.928874 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45086fd-da51-44ca-ae96-3fbedcce593b None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:14:56.022957 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45086fd-da51-44ca-ae96-3fbedcce593b None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:14:56.054124 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc67ce-4c68-4d6d-a66b-bbe2059f0047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:14:56.054891 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc67ce-4c68-4d6d-a66b-bbe2059f0047 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:56.055169 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc67ce-4c68-4d6d-a66b-bbe2059f0047 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:56.055469 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc67ce-4c68-4d6d-a66b-bbe2059f0047 None admin] PATH_INFO: `/v3/services/placement` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:56.056103 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cc67ce-4c68-4d6d-a66b-bbe2059f0047 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:14:56.057459 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cc67ce-4c68-4d6d-a66b-bbe2059f0047 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:14:56.069436 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-a5cc67ce-4c68-4d6d-a66b-bbe2059f0047 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 09 20:14:56.069436 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:14:56.069436 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 20:14:56.069436 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 20:14:56.069436 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 20:14:56.069436 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 20:14:56.069436 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 20:14:56.069436 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 20:14:56.069436 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 09 20:14:56.069436 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:14:56.069436 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 20:14:56.069436 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:14:56.069436 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:14:56.069436 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:14:56.069436 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:14:56.069436 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:14:56.069436 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:14:56.070644 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:14:56.070644 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:14:56.070644 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:14:56.070644 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:14:56.070644 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:14:56.070644 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:14:56.070644 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 20:14:56.070644 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 20:14:56.070644 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 20:14:56.070644 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 20:14:56.070644 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:14:56.070644 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:14:56.070644 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:14:56.070644 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:14:56.070644 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:14:56.070644 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:14:56.071739 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:14:56.071739 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:14:56.071739 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:14:56.071739 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:14:56.071739 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:14:56.071739 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:14:56.071739 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:14:56.071739 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:14:56.071739 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:14:56.071739 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:14:56.071739 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 20:14:56.071739 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 20:14:56.071739 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 09 20:14:56.071739 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:14:56.071739 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 642/1290] 10.222.0.44 () {56 vars in 1117 bytes} [Mon May 9 20:14:55 2022] GET /identity/v3/services/placement => generated 90 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:14:56.077020 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb79acd4-6361-46ab-8d13-2850628d83e7 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:14:56.169370 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb79acd4-6361-46ab-8d13-2850628d83e7 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:14:56.200872 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbec95b3-2817-4a7f-9a4a-db8c06e727f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:14:56.201513 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec95b3-2817-4a7f-9a4a-db8c06e727f1 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:56.201790 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec95b3-2817-4a7f-9a4a-db8c06e727f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:56.202061 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec95b3-2817-4a7f-9a4a-db8c06e727f1 None admin] PATH_INFO: `/v3/services` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:56.202758 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbec95b3-2817-4a7f-9a4a-db8c06e727f1 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:14:56.203060 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbec95b3-2817-4a7f-9a4a-db8c06e727f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:14:56.204447 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbec95b3-2817-4a7f-9a4a-db8c06e727f1 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:14:56.208993 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 649/1291] 10.222.0.44 () {56 vars in 1116 bytes} [Mon May 9 20:14:56 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:14:56.214640 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc67ce-4c68-4d6d-a66b-bbe2059f0047 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:14:56.306999 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc67ce-4c68-4d6d-a66b-bbe2059f0047 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:14:56.338189 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e01c07-36e4-4799-a9d3-8d9d3ed8f1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:14:56.338826 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e01c07-36e4-4799-a9d3-8d9d3ed8f1eb None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:56.339104 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e01c07-36e4-4799-a9d3-8d9d3ed8f1eb None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:56.339376 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e01c07-36e4-4799-a9d3-8d9d3ed8f1eb None admin] PATH_INFO: `/v3/services` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:56.340800 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e01c07-36e4-4799-a9d3-8d9d3ed8f1eb None admin] RBAC: Adding query filter params (type=placement) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:14:56.341108 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e01c07-36e4-4799-a9d3-8d9d3ed8f1eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:14:56.342461 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e01c07-36e4-4799-a9d3-8d9d3ed8f1eb None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:14:56.346652 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 643/1292] 10.222.0.44 () {56 vars in 1116 bytes} [Mon May 9 20:14:56 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:14:58.529613 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f82c6-4f48-4e40-bdc7-6f65bb860b1f None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:58.530185 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f82c6-4f48-4e40-bdc7-6f65bb860b1f None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:58.530185 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f82c6-4f48-4e40-bdc7-6f65bb860b1f None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:58.531542 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 650/1293] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:14:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:14:58.536765 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32beb009-267f-4e47-9a1c-e0e9f9367203 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:58.537131 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32beb009-267f-4e47-9a1c-e0e9f9367203 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:58.537315 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32beb009-267f-4e47-9a1c-e0e9f9367203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:58.553925 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-32beb009-267f-4e47-9a1c-e0e9f9367203 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:14:58.555095 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-32beb009-267f-4e47-9a1c-e0e9f9367203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:14:58.617046 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 644/1294] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:14:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 20:14:58.639642 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408f82c6-4f48-4e40-bdc7-6f65bb860b1f None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:14:58.734169 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408f82c6-4f48-4e40-bdc7-6f65bb860b1f None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:14:58.766029 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55b31c2-05d6-4c25-b7bf-83b6551887dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:14:58.766680 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b31c2-05d6-4c25-b7bf-83b6551887dd None admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:14:58.766958 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b31c2-05d6-4c25-b7bf-83b6551887dd None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:14:58.767226 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b31c2-05d6-4c25-b7bf-83b6551887dd None admin] PATH_INFO: `/v3/services` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:14:58.767967 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55b31c2-05d6-4c25-b7bf-83b6551887dd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:14:58.769325 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55b31c2-05d6-4c25-b7bf-83b6551887dd None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:14:58.782686 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 651/1295] 10.222.0.44 () {60 vars in 1141 bytes} [Mon May 9 20:14:58 2022] POST /identity/v3/services => generated 246 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:15:01.017047 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8a150-46f4-4671-b7d3-43070d947b73 None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:15:01.017597 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8a150-46f4-4671-b7d3-43070d947b73 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:15:01.017597 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8a150-46f4-4671-b7d3-43070d947b73 None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:15:01.018930 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 645/1296] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:15:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:15:01.024107 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c2166-bf56-46ba-8fc9-0fe105c9acf7 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:15:01.024476 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c2166-bf56-46ba-8fc9-0fe105c9acf7 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:15:01.024661 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c2166-bf56-46ba-8fc9-0fe105c9acf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:15:01.041191 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-1a5c2166-bf56-46ba-8fc9-0fe105c9acf7 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:15:01.042355 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-1a5c2166-bf56-46ba-8fc9-0fe105c9acf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:15:01.110134 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 652/1297] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:15:01 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 20:15:01.132691 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b8a150-46f4-4671-b7d3-43070d947b73 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:15:01.226726 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b8a150-46f4-4671-b7d3-43070d947b73 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:15:01.257532 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d59977-0ab8-430e-bd73-54df4003f9e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:15:01.258290 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d59977-0ab8-430e-bd73-54df4003f9e4 None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:15:01.258565 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d59977-0ab8-430e-bd73-54df4003f9e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:15:01.258828 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d59977-0ab8-430e-bd73-54df4003f9e4 None admin] PATH_INFO: `/v3/services/placement` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:15:01.259483 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d59977-0ab8-430e-bd73-54df4003f9e4 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:15:01.260833 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d59977-0ab8-430e-bd73-54df4003f9e4 None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:15:01.272885 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-85d59977-0ab8-430e-bd73-54df4003f9e4 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 09 20:15:01.272885 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:15:01.272885 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 20:15:01.272885 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 20:15:01.272885 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 20:15:01.272885 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 20:15:01.272885 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 20:15:01.272885 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 20:15:01.272885 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 09 20:15:01.272885 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:15:01.272885 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 20:15:01.272885 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:15:01.272885 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:15:01.272885 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:15:01.272885 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:15:01.272885 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:15:01.272885 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:15:01.274115 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:15:01.274115 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:15:01.274115 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:15:01.274115 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:15:01.274115 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:15:01.274115 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:15:01.274115 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 20:15:01.274115 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 20:15:01.274115 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 20:15:01.274115 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 20:15:01.274115 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:15:01.274115 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:15:01.274115 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:15:01.274115 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:15:01.274115 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:15:01.274115 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:15:01.275298 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:15:01.275298 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:15:01.275298 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:15:01.275298 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:15:01.275298 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:15:01.275298 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:15:01.275298 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:15:01.275298 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:15:01.275298 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:15:01.275298 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:15:01.275298 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 20:15:01.275298 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 20:15:01.275298 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 09 20:15:01.275298 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:15:01.275298 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 646/1298] 10.222.0.44 () {56 vars in 1117 bytes} [Mon May 9 20:15:01 2022] GET /identity/v3/services/placement => generated 90 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:15:01.280719 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c2166-bf56-46ba-8fc9-0fe105c9acf7 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:15:01.371155 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c2166-bf56-46ba-8fc9-0fe105c9acf7 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:15:01.403511 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21730dcd-e447-4958-9d06-9562d7a9f845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:15:01.404154 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21730dcd-e447-4958-9d06-9562d7a9f845 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:15:01.404431 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21730dcd-e447-4958-9d06-9562d7a9f845 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:15:01.404701 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21730dcd-e447-4958-9d06-9562d7a9f845 None admin] PATH_INFO: `/v3/services` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:15:01.405395 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21730dcd-e447-4958-9d06-9562d7a9f845 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:15:01.405697 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21730dcd-e447-4958-9d06-9562d7a9f845 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:15:01.407048 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21730dcd-e447-4958-9d06-9562d7a9f845 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:15:01.411956 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 653/1299] 10.222.0.44 () {56 vars in 1116 bytes} [Mon May 9 20:15:01 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:15:01.418272 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d59977-0ab8-430e-bd73-54df4003f9e4 None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:15:01.509964 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d59977-0ab8-430e-bd73-54df4003f9e4 None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:15:01.540886 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ffd2ec-e7be-41a3-a930-3dcdf28f321a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:15:01.541447 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ffd2ec-e7be-41a3-a930-3dcdf28f321a None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:15:01.541722 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ffd2ec-e7be-41a3-a930-3dcdf28f321a None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:15:01.541988 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ffd2ec-e7be-41a3-a930-3dcdf28f321a None admin] PATH_INFO: `/v3/endpoints` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:15:01.542834 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ffd2ec-e7be-41a3-a930-3dcdf28f321a None admin] RBAC: Adding query filter params (interface=public, service_id=1efd02bd6ebf4e84a671b0574f6cae7a, region_id=RegionOne) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:15:01.543140 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ffd2ec-e7be-41a3-a930-3dcdf28f321a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:15:01.544541 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ffd2ec-e7be-41a3-a930-3dcdf28f321a None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:15:01.549198 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 647/1300] 10.222.0.44 () {56 vars in 1251 bytes} [Mon May 9 20:15:01 2022] GET /identity/v3/endpoints?service_id=1efd02bd6ebf4e84a671b0574f6cae7a&interface=public®ion_id=RegionOne => generated 194 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:15:01.554640 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21730dcd-e447-4958-9d06-9562d7a9f845 None admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:15:01.648607 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21730dcd-e447-4958-9d06-9562d7a9f845 None admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:15:01.679558 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e6f633-71be-4192-9768-23a24cf914e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:15:01.680199 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e6f633-71be-4192-9768-23a24cf914e2 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:15:01.680471 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e6f633-71be-4192-9768-23a24cf914e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:15:01.680737 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e6f633-71be-4192-9768-23a24cf914e2 None admin] PATH_INFO: `/v3/services` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:15:01.681400 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e6f633-71be-4192-9768-23a24cf914e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:15:01.682734 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e6f633-71be-4192-9768-23a24cf914e2 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:15:01.689792 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 654/1301] 10.222.0.44 () {56 vars in 1087 bytes} [Mon May 9 20:15:01 2022] GET /identity/v3/services => generated 2191 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:15:03.863885 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864fe1d-cd96-4ea4-ad76-2d92d1e478f7 None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:15:03.864389 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864fe1d-cd96-4ea4-ad76-2d92d1e478f7 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:15:03.864389 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864fe1d-cd96-4ea4-ad76-2d92d1e478f7 None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:15:03.865675 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 648/1302] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:15:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:15:03.871281 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125bcaf1-d104-4c4f-a888-39250afccf59 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:15:03.871712 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125bcaf1-d104-4c4f-a888-39250afccf59 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:15:03.872123 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125bcaf1-d104-4c4f-a888-39250afccf59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:15:03.888872 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-125bcaf1-d104-4c4f-a888-39250afccf59 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:15:03.890037 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-125bcaf1-d104-4c4f-a888-39250afccf59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:15:03.952188 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 655/1303] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:15:03 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 20:15:03.974139 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3864fe1d-cd96-4ea4-ad76-2d92d1e478f7 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:15:04.067994 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3864fe1d-cd96-4ea4-ad76-2d92d1e478f7 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:15:04.100706 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1473d1b2-6a96-4d36-8a49-4be458ed945b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:15:04.101479 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473d1b2-6a96-4d36-8a49-4be458ed945b None admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:15:04.101753 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473d1b2-6a96-4d36-8a49-4be458ed945b None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:15:04.102018 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473d1b2-6a96-4d36-8a49-4be458ed945b None admin] PATH_INFO: `/v3/services/placement` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:15:04.102653 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1473d1b2-6a96-4d36-8a49-4be458ed945b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:15:04.104041 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1473d1b2-6a96-4d36-8a49-4be458ed945b None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:15:04.115750 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application [None req-1473d1b2-6a96-4d36-8a49-4be458ed945b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 09 20:15:04.115750 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:15:04.115750 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 20:15:04.115750 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 20:15:04.115750 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 20:15:04.115750 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 20:15:04.115750 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 20:15:04.115750 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 20:15:04.115750 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 09 20:15:04.115750 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:15:04.115750 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 20:15:04.115750 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:15:04.115750 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 20:15:04.115750 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 20:15:04.115750 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 20:15:04.115750 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 20:15:04.115750 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 20:15:04.116917 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 20:15:04.116917 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 20:15:04.116917 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 20:15:04.116917 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 20:15:04.116917 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 20:15:04.116917 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 20:15:04.116917 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 20:15:04.116917 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 20:15:04.116917 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 20:15:04.116917 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 20:15:04.116917 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 20:15:04.116917 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 20:15:04.116917 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 20:15:04.116917 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 20:15:04.116917 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 20:15:04.116917 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.get_or_create( May 09 20:15:04.117945 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 20:15:04.117945 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application with Lock( May 09 20:15:04.117945 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 20:15:04.117945 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self._enter() May 09 20:15:04.117945 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 20:15:04.117945 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 20:15:04.117945 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 20:15:04.117945 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application return self.creator() May 09 20:15:04.117945 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 20:15:04.117945 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application created_value = creator( May 09 20:15:04.117945 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 20:15:04.117945 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 20:15:04.117945 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 09 20:15:04.117945 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: ERROR keystone.server.flask.application May 09 20:15:04.117945 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 649/1304] 10.222.0.44 () {56 vars in 1117 bytes} [Mon May 9 20:15:03 2022] GET /identity/v3/services/placement => generated 90 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 20:15:04.123717 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125bcaf1-d104-4c4f-a888-39250afccf59 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:15:04.215535 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125bcaf1-d104-4c4f-a888-39250afccf59 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:15:04.247695 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3a8eba-950f-4c2e-ae39-b2b6c7088d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:15:04.248333 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a8eba-950f-4c2e-ae39-b2b6c7088d55 None admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:15:04.248613 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a8eba-950f-4c2e-ae39-b2b6c7088d55 None admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:15:04.248885 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a8eba-950f-4c2e-ae39-b2b6c7088d55 None admin] PATH_INFO: `/v3/services` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:15:04.249578 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3a8eba-950f-4c2e-ae39-b2b6c7088d55 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:15:04.249880 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3a8eba-950f-4c2e-ae39-b2b6c7088d55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:15:04.251230 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3a8eba-950f-4c2e-ae39-b2b6c7088d55 None admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:15:04.256159 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 656/1305] 10.222.0.44 () {56 vars in 1116 bytes} [Mon May 9 20:15:04 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:15:04.262228 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1473d1b2-6a96-4d36-8a49-4be458ed945b None admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:15:04.353383 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1473d1b2-6a96-4d36-8a49-4be458ed945b None admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:15:04.384867 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abc3cb2-c964-418a-9002-2b5f905844da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:15:04.385436 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abc3cb2-c964-418a-9002-2b5f905844da None admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:15:04.385711 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abc3cb2-c964-418a-9002-2b5f905844da None admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:15:04.385977 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abc3cb2-c964-418a-9002-2b5f905844da None admin] PATH_INFO: `/v3/endpoints` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:15:04.387176 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abc3cb2-c964-418a-9002-2b5f905844da None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:15:04.388570 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abc3cb2-c964-418a-9002-2b5f905844da None admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:15:04.405843 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 650/1306] 10.222.0.44 () {60 vars in 1144 bytes} [Mon May 9 20:15:04 2022] POST /identity/v3/endpoints => generated 331 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:16:08.545420 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0794f5-30b8-4187-b1e0-b5a1df8ef9ea None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:16:08.545822 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0794f5-30b8-4187-b1e0-b5a1df8ef9ea None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:16:08.545959 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0794f5-30b8-4187-b1e0-b5a1df8ef9ea None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:16:08.548638 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 657/1307] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:16:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:16:08.556714 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e9d79-fc7a-462a-90bf-1008b6431df6 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:16:08.558888 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e9d79-fc7a-462a-90bf-1008b6431df6 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:16:08.559250 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e9d79-fc7a-462a-90bf-1008b6431df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:16:08.651267 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-851e9d79-fc7a-462a-90bf-1008b6431df6 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:16:08.652943 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-851e9d79-fc7a-462a-90bf-1008b6431df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:16:08.770334 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 651/1308] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:16:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:16:08.819472 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ff17b-8271-43e8-9e84-68bbc575059b None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:16:08.819691 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ff17b-8271-43e8-9e84-68bbc575059b None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:16:08.820264 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ff17b-8271-43e8-9e84-68bbc575059b None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:16:08.821645 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 658/1309] 10.222.0.44 () {54 vars in 964 bytes} [Mon May 9 20:16:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:16:08.829155 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80260af5-d46f-4996-946f-9a054bd202a3 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:16:08.829440 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80260af5-d46f-4996-946f-9a054bd202a3 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:16:08.829716 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80260af5-d46f-4996-946f-9a054bd202a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:16:08.905349 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-80260af5-d46f-4996-946f-9a054bd202a3 None None] MFA Rules not processed for user `b2a13ad25f27471792ba0758602b6e63`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:16:08.906561 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-80260af5-d46f-4996-946f-9a054bd202a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:16:08.982874 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 652/1310] 10.222.0.44 () {58 vars in 1061 bytes} [Mon May 9 20:16:08 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:16:08.992237 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4ff17b-8271-43e8-9e84-68bbc575059b None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:16:08.994551 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-7f4ff17b-8271-43e8-9e84-68bbc575059b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:16:09.112256 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4ff17b-8271-43e8-9e84-68bbc575059b None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:16:09.187471 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44521ded-6290-4d10-a1dd-24d533a9fd05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:16:09.188122 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44521ded-6290-4d10-a1dd-24d533a9fd05 service neutron] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:16:09.188398 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44521ded-6290-4d10-a1dd-24d533a9fd05 service neutron] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:16:09.188665 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44521ded-6290-4d10-a1dd-24d533a9fd05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:16:09.190297 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-44521ded-6290-4d10-a1dd-24d533a9fd05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:16:09.301861 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44521ded-6290-4d10-a1dd-24d533a9fd05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:16:09.303228 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44521ded-6290-4d10-a1dd-24d533a9fd05 service neutron] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:16:09.321616 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 659/1311] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:16:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:16:11.886013 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dadf96c-2413-41e1-bb15-198ed3fa0388 None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:16:11.886483 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dadf96c-2413-41e1-bb15-198ed3fa0388 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:16:11.886947 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dadf96c-2413-41e1-bb15-198ed3fa0388 None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:16:11.891860 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 653/1312] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:16:11 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:16:11.897281 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6bb2f5-1e06-4bce-ab1f-99ac09b1f6dc None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:16:11.897713 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6bb2f5-1e06-4bce-ab1f-99ac09b1f6dc None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:16:11.897833 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6bb2f5-1e06-4bce-ab1f-99ac09b1f6dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:16:11.996641 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-1e6bb2f5-1e06-4bce-ab1f-99ac09b1f6dc None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:16:11.997950 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-1e6bb2f5-1e06-4bce-ab1f-99ac09b1f6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:16:12.091355 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 660/1313] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:16:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:16:12.129127 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dadf96c-2413-41e1-bb15-198ed3fa0388 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:16:12.130621 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-8dadf96c-2413-41e1-bb15-198ed3fa0388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:16:12.230573 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dadf96c-2413-41e1-bb15-198ed3fa0388 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:16:12.299514 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b6fdb6-9336-408f-a586-71b0dd0975ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:16:12.300087 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6fdb6-9336-408f-a586-71b0dd0975ff service neutron] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:16:12.300363 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6fdb6-9336-408f-a586-71b0dd0975ff service neutron] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:16:12.300630 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6fdb6-9336-408f-a586-71b0dd0975ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:16:12.302240 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-e0b6fdb6-9336-408f-a586-71b0dd0975ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:16:12.405674 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b6fdb6-9336-408f-a586-71b0dd0975ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:16:12.407033 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b6fdb6-9336-408f-a586-71b0dd0975ff service neutron] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:16:12.425185 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 654/1314] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:16:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:16:15.010705 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff5db3-62f6-4c37-808f-c73356b5ba8c None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:16:15.011268 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff5db3-62f6-4c37-808f-c73356b5ba8c None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:16:15.011268 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff5db3-62f6-4c37-808f-c73356b5ba8c None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:16:15.012929 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 661/1315] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:16:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:16:15.018181 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e014245-64a5-492d-8b2e-137e2cd9a1ac None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:16:15.018604 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e014245-64a5-492d-8b2e-137e2cd9a1ac None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:16:15.018706 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e014245-64a5-492d-8b2e-137e2cd9a1ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:16:15.086750 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-9e014245-64a5-492d-8b2e-137e2cd9a1ac None None] MFA Rules not processed for user `178306c7b6c64cbfa5ff0a58f91fde9a`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:16:15.088218 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-9e014245-64a5-492d-8b2e-137e2cd9a1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:16:15.180863 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 655/1316] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:16:15 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:16:15.236465 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800b6b9c-da18-47d7-8d69-bd02fb3f6dc0 None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:16:15.236746 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800b6b9c-da18-47d7-8d69-bd02fb3f6dc0 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:16:15.237021 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800b6b9c-da18-47d7-8d69-bd02fb3f6dc0 None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:16:15.238420 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 662/1317] 10.222.0.44 () {54 vars in 964 bytes} [Mon May 9 20:16:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:16:15.245302 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e47313c-142c-4c2d-819a-67560f2da0e9 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:16:15.245596 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e47313c-142c-4c2d-819a-67560f2da0e9 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:16:15.245874 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e47313c-142c-4c2d-819a-67560f2da0e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:16:15.317626 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-0e47313c-142c-4c2d-819a-67560f2da0e9 None None] MFA Rules not processed for user `b2a13ad25f27471792ba0758602b6e63`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:16:15.319040 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-0e47313c-142c-4c2d-819a-67560f2da0e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:16:15.402574 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 656/1318] 10.222.0.44 () {58 vars in 1061 bytes} [Mon May 9 20:16:15 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:16:15.411686 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800b6b9c-da18-47d7-8d69-bd02fb3f6dc0 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:16:15.413410 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-800b6b9c-da18-47d7-8d69-bd02fb3f6dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:16:15.518523 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800b6b9c-da18-47d7-8d69-bd02fb3f6dc0 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:16:15.590699 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65ef41c-66bb-40db-a38b-73647a9d12f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:16:15.591343 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ef41c-66bb-40db-a38b-73647a9d12f8 service neutron] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:16:15.591656 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ef41c-66bb-40db-a38b-73647a9d12f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:16:15.591924 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ef41c-66bb-40db-a38b-73647a9d12f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:16:15.593558 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-b65ef41c-66bb-40db-a38b-73647a9d12f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:16:15.701760 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65ef41c-66bb-40db-a38b-73647a9d12f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:16:15.703214 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65ef41c-66bb-40db-a38b-73647a9d12f8 service neutron] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:16:15.720830 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 663/1319] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:16:15 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:16:18.910575 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca168394-b64f-421c-b306-1f59cd67e554 None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:16:18.911089 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca168394-b64f-421c-b306-1f59cd67e554 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:16:18.911089 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca168394-b64f-421c-b306-1f59cd67e554 None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:16:18.912417 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 657/1320] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:16:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:16:18.918271 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a22f853-f455-4fcb-b6a6-6f454ca30baa None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:16:18.918696 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a22f853-f455-4fcb-b6a6-6f454ca30baa None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:16:18.918828 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a22f853-f455-4fcb-b6a6-6f454ca30baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:16:18.980565 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-2a22f853-f455-4fcb-b6a6-6f454ca30baa None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:16:18.981737 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-2a22f853-f455-4fcb-b6a6-6f454ca30baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:16:19.070855 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 664/1321] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:16:18 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:16:19.110459 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca168394-b64f-421c-b306-1f59cd67e554 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:16:19.112033 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-ca168394-b64f-421c-b306-1f59cd67e554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:16:19.211605 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca168394-b64f-421c-b306-1f59cd67e554 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:16:19.281892 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a097d41d-6f3c-41b4-a0e3-a687513a7ba6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:16:19.282521 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097d41d-6f3c-41b4-a0e3-a687513a7ba6 service neutron] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:16:19.282797 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097d41d-6f3c-41b4-a0e3-a687513a7ba6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:16:19.283068 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097d41d-6f3c-41b4-a0e3-a687513a7ba6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:16:19.284706 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-a097d41d-6f3c-41b4-a0e3-a687513a7ba6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:16:19.386420 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a097d41d-6f3c-41b4-a0e3-a687513a7ba6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:16:19.388150 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a097d41d-6f3c-41b4-a0e3-a687513a7ba6 service neutron] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:16:19.405167 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 658/1322] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:16:19 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:16:22.298412 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02430eb4-a4f1-4aee-86a3-350c1a9b2305 None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:16:22.298977 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02430eb4-a4f1-4aee-86a3-350c1a9b2305 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:16:22.298977 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02430eb4-a4f1-4aee-86a3-350c1a9b2305 None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:16:22.300344 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 665/1323] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:16:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:16:22.307303 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2efa02-4d76-4743-b3c7-ff757c1c1862 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:16:22.307735 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2efa02-4d76-4743-b3c7-ff757c1c1862 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:16:22.307888 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2efa02-4d76-4743-b3c7-ff757c1c1862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:16:22.370200 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-4d2efa02-4d76-4743-b3c7-ff757c1c1862 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:16:22.371426 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-4d2efa02-4d76-4743-b3c7-ff757c1c1862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:16:22.461861 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 659/1324] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:16:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:16:22.497220 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02430eb4-a4f1-4aee-86a3-350c1a9b2305 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:16:22.498762 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-02430eb4-a4f1-4aee-86a3-350c1a9b2305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:16:22.601974 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02430eb4-a4f1-4aee-86a3-350c1a9b2305 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:16:22.673624 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b5321e-d256-4258-a4a9-55d724886d35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:16:22.674268 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5321e-d256-4258-a4a9-55d724886d35 service neutron] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:16:22.674547 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5321e-d256-4258-a4a9-55d724886d35 service neutron] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:16:22.674821 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5321e-d256-4258-a4a9-55d724886d35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:16:22.676490 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-c2b5321e-d256-4258-a4a9-55d724886d35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:16:22.781097 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b5321e-d256-4258-a4a9-55d724886d35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:16:22.782523 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b5321e-d256-4258-a4a9-55d724886d35 service neutron] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:16:22.801879 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 666/1325] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:16:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:16:25.076556 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd285db9-6ca5-4900-8078-8ca09b183d89 None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:16:25.077090 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd285db9-6ca5-4900-8078-8ca09b183d89 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:16:25.077090 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd285db9-6ca5-4900-8078-8ca09b183d89 None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:16:25.078443 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 660/1326] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:16:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:16:25.083675 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e509d-2da1-4ddc-b463-31b0de5c015d None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:16:25.084096 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e509d-2da1-4ddc-b463-31b0de5c015d None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:16:25.084358 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e509d-2da1-4ddc-b463-31b0de5c015d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:16:25.147408 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-149e509d-2da1-4ddc-b463-31b0de5c015d None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:16:25.148603 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-149e509d-2da1-4ddc-b463-31b0de5c015d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:16:25.242178 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 667/1327] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:16:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:16:25.277328 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd285db9-6ca5-4900-8078-8ca09b183d89 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:16:25.278818 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-cd285db9-6ca5-4900-8078-8ca09b183d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:16:25.384577 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd285db9-6ca5-4900-8078-8ca09b183d89 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:16:25.453765 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd7abf5-a085-470b-9541-f45ca38a2feb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:16:25.454438 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd7abf5-a085-470b-9541-f45ca38a2feb service neutron] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:16:25.454717 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd7abf5-a085-470b-9541-f45ca38a2feb service neutron] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:16:25.455644 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd7abf5-a085-470b-9541-f45ca38a2feb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:16:25.457314 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-4bd7abf5-a085-470b-9541-f45ca38a2feb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:16:25.561076 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd7abf5-a085-470b-9541-f45ca38a2feb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:16:25.562506 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd7abf5-a085-470b-9541-f45ca38a2feb service neutron] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:16:25.580589 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 661/1328] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:16:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:16:27.854013 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4097cb-c7ab-4a9c-b7aa-ee80ef71e363 None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:16:27.854536 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4097cb-c7ab-4a9c-b7aa-ee80ef71e363 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:16:27.854536 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4097cb-c7ab-4a9c-b7aa-ee80ef71e363 None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:16:27.855892 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 668/1329] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:16:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:16:27.861056 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d42f32-e348-4872-844c-84be859fdba8 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:16:27.861476 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d42f32-e348-4872-844c-84be859fdba8 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:16:27.861667 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d42f32-e348-4872-844c-84be859fdba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:16:27.924400 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-f8d42f32-e348-4872-844c-84be859fdba8 None None] MFA Rules not processed for user `178306c7b6c64cbfa5ff0a58f91fde9a`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:16:27.925581 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-f8d42f32-e348-4872-844c-84be859fdba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:16:28.017373 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 662/1330] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:16:27 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:16:28.053838 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4097cb-c7ab-4a9c-b7aa-ee80ef71e363 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:16:28.055425 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-0d4097cb-c7ab-4a9c-b7aa-ee80ef71e363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:16:28.156431 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4097cb-c7ab-4a9c-b7aa-ee80ef71e363 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:16:28.227153 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9874a2a0-ed36-4105-bcdc-26cd77fe2ef4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:16:28.228335 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9874a2a0-ed36-4105-bcdc-26cd77fe2ef4 service neutron] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:16:28.228608 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9874a2a0-ed36-4105-bcdc-26cd77fe2ef4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:16:28.228876 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9874a2a0-ed36-4105-bcdc-26cd77fe2ef4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:16:28.230488 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-9874a2a0-ed36-4105-bcdc-26cd77fe2ef4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:16:28.334270 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9874a2a0-ed36-4105-bcdc-26cd77fe2ef4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:16:28.335748 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9874a2a0-ed36-4105-bcdc-26cd77fe2ef4 service neutron] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:16:28.356444 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 669/1331] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:16:28 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:16:30.849827 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad8b958-b064-4b63-b5e9-1e2bfa96df46 None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:16:30.850356 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad8b958-b064-4b63-b5e9-1e2bfa96df46 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:16:30.850356 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad8b958-b064-4b63-b5e9-1e2bfa96df46 None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:16:30.851748 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 663/1332] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:16:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:16:30.857536 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d795e6-88c4-47f9-b5f9-473821de243e None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:16:30.857990 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d795e6-88c4-47f9-b5f9-473821de243e None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:16:30.858092 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d795e6-88c4-47f9-b5f9-473821de243e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:16:30.934051 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-17d795e6-88c4-47f9-b5f9-473821de243e None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:16:30.935265 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-17d795e6-88c4-47f9-b5f9-473821de243e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:16:31.032433 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 670/1333] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:16:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:16:31.068453 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad8b958-b064-4b63-b5e9-1e2bfa96df46 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:16:31.069982 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-3ad8b958-b064-4b63-b5e9-1e2bfa96df46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:16:31.170465 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad8b958-b064-4b63-b5e9-1e2bfa96df46 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:16:31.242085 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53128c98-f93e-46c0-bc61-d869950ec98f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:16:31.242724 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53128c98-f93e-46c0-bc61-d869950ec98f service neutron] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:16:31.243005 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53128c98-f93e-46c0-bc61-d869950ec98f service neutron] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:16:31.244141 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53128c98-f93e-46c0-bc61-d869950ec98f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:16:31.245543 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-53128c98-f93e-46c0-bc61-d869950ec98f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:16:31.350383 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53128c98-f93e-46c0-bc61-d869950ec98f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:16:31.351899 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53128c98-f93e-46c0-bc61-d869950ec98f service neutron] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:16:31.374838 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 664/1334] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:16:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:16:33.746030 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a7d74c-8e02-4047-9a90-62b522f5f8d2 None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:16:33.746533 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a7d74c-8e02-4047-9a90-62b522f5f8d2 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:16:33.746624 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a7d74c-8e02-4047-9a90-62b522f5f8d2 None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:16:33.747975 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 671/1335] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:16:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:16:33.753145 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0459b06-bf47-4ed5-a3df-e66b0fce55aa None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:16:33.753570 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0459b06-bf47-4ed5-a3df-e66b0fce55aa None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:16:33.753694 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0459b06-bf47-4ed5-a3df-e66b0fce55aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:16:33.814897 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-c0459b06-bf47-4ed5-a3df-e66b0fce55aa None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:16:33.816086 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-c0459b06-bf47-4ed5-a3df-e66b0fce55aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:16:33.907359 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 665/1336] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:16:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:16:33.947435 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a7d74c-8e02-4047-9a90-62b522f5f8d2 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:16:33.948934 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-16a7d74c-8e02-4047-9a90-62b522f5f8d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:16:34.045336 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a7d74c-8e02-4047-9a90-62b522f5f8d2 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:16:34.118630 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034beae0-1074-449b-ab54-93c0b254112e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:16:34.119264 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034beae0-1074-449b-ab54-93c0b254112e service neutron] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:16:34.119565 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034beae0-1074-449b-ab54-93c0b254112e service neutron] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:16:34.119830 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034beae0-1074-449b-ab54-93c0b254112e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:16:34.121429 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-034beae0-1074-449b-ab54-93c0b254112e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:16:34.223642 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034beae0-1074-449b-ab54-93c0b254112e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:16:34.225068 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034beae0-1074-449b-ab54-93c0b254112e service neutron] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:16:34.242801 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 672/1337] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:16:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:16:36.915463 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147036b9-cc1f-4f69-b1b8-3c5e24fa541b None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:16:36.915990 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147036b9-cc1f-4f69-b1b8-3c5e24fa541b None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:16:36.915990 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147036b9-cc1f-4f69-b1b8-3c5e24fa541b None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:16:36.917274 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 666/1338] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:16:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:16:36.922351 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a7851d-c741-4f27-9e5a-46c4b3a1a25b None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:16:36.922773 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a7851d-c741-4f27-9e5a-46c4b3a1a25b None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:16:36.922879 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a7851d-c741-4f27-9e5a-46c4b3a1a25b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:16:36.983893 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-71a7851d-c741-4f27-9e5a-46c4b3a1a25b None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:16:36.985075 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-71a7851d-c741-4f27-9e5a-46c4b3a1a25b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:16:37.075733 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 673/1339] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:16:36 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:16:37.112684 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147036b9-cc1f-4f69-b1b8-3c5e24fa541b None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:16:37.114200 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-147036b9-cc1f-4f69-b1b8-3c5e24fa541b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:16:37.213561 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147036b9-cc1f-4f69-b1b8-3c5e24fa541b None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:16:37.282206 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200697cb-a057-4bc1-b7d4-176cfe3f20b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:16:37.282840 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200697cb-a057-4bc1-b7d4-176cfe3f20b5 service neutron] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:16:37.283117 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200697cb-a057-4bc1-b7d4-176cfe3f20b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:16:37.283385 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200697cb-a057-4bc1-b7d4-176cfe3f20b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:16:37.285014 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-200697cb-a057-4bc1-b7d4-176cfe3f20b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:16:37.385992 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200697cb-a057-4bc1-b7d4-176cfe3f20b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:16:37.387764 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200697cb-a057-4bc1-b7d4-176cfe3f20b5 service neutron] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:16:37.404629 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 667/1340] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:16:37 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:16:41.718881 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f5d916-556e-432c-a077-9183656a2360 None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:16:41.719470 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f5d916-556e-432c-a077-9183656a2360 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:16:41.719470 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f5d916-556e-432c-a077-9183656a2360 None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:16:41.720996 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 674/1341] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:16:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:16:41.726167 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c8f7e-4f14-436d-8a88-c4f5a3c3af2e None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:16:41.726576 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c8f7e-4f14-436d-8a88-c4f5a3c3af2e None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:16:41.726841 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c8f7e-4f14-436d-8a88-c4f5a3c3af2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:16:41.796871 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-1c4c8f7e-4f14-436d-8a88-c4f5a3c3af2e None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:16:41.797957 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-1c4c8f7e-4f14-436d-8a88-c4f5a3c3af2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:16:41.904458 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 668/1342] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:16:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:16:41.942490 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f5d916-556e-432c-a077-9183656a2360 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:16:41.944597 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-c5f5d916-556e-432c-a077-9183656a2360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:16:42.036106 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f5d916-556e-432c-a077-9183656a2360 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:16:42.039627 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dd7b62-8bc4-4cbd-8640-12f363a877be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:16:42.040459 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dd7b62-8bc4-4cbd-8640-12f363a877be service neutron] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:16:42.040724 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dd7b62-8bc4-4cbd-8640-12f363a877be service neutron] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:16:42.040994 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dd7b62-8bc4-4cbd-8640-12f363a877be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:16:42.049964 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dd7b62-8bc4-4cbd-8640-12f363a877be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:16:42.051320 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dd7b62-8bc4-4cbd-8640-12f363a877be service neutron] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:16:42.061207 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 675/1343] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:16:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:16:44.878077 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d23867-4dc5-44ad-9462-f273192ff1d6 None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:16:44.878661 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d23867-4dc5-44ad-9462-f273192ff1d6 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:16:44.878661 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d23867-4dc5-44ad-9462-f273192ff1d6 None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:16:44.879974 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 669/1344] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:16:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:16:44.885909 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d0e709-ccc0-4003-9f93-e7be7d75643c None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:16:44.886312 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d0e709-ccc0-4003-9f93-e7be7d75643c None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:16:44.886463 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d0e709-ccc0-4003-9f93-e7be7d75643c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:16:44.913682 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-17d0e709-ccc0-4003-9f93-e7be7d75643c None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:16:44.914804 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-17d0e709-ccc0-4003-9f93-e7be7d75643c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:16:44.986961 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 676/1345] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:16:44 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:16:45.023971 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d23867-4dc5-44ad-9462-f273192ff1d6 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:16:45.034266 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d23867-4dc5-44ad-9462-f273192ff1d6 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:16:45.037706 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e749c9-687f-48f1-be24-3b9548d6211f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:16:45.038333 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e749c9-687f-48f1-be24-3b9548d6211f service neutron] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:16:45.038617 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e749c9-687f-48f1-be24-3b9548d6211f service neutron] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:16:45.038886 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e749c9-687f-48f1-be24-3b9548d6211f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:16:45.047540 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e749c9-687f-48f1-be24-3b9548d6211f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:16:45.048978 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e749c9-687f-48f1-be24-3b9548d6211f service neutron] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:16:45.058758 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 670/1346] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:16:45 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:16:49.374924 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284a9741-eec1-4a1a-9a1a-84e0cd568215 None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:16:49.375365 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284a9741-eec1-4a1a-9a1a-84e0cd568215 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:16:49.375504 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284a9741-eec1-4a1a-9a1a-84e0cd568215 None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:16:49.376992 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 677/1347] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:16:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:16:49.382322 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac6d4f-cffa-4f8e-9cab-38932bb346c5 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:16:49.382774 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac6d4f-cffa-4f8e-9cab-38932bb346c5 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:16:49.382875 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac6d4f-cffa-4f8e-9cab-38932bb346c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:16:49.401553 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-05ac6d4f-cffa-4f8e-9cab-38932bb346c5 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:16:49.402758 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-05ac6d4f-cffa-4f8e-9cab-38932bb346c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:16:49.410627 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 671/1348] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:16:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:16:49.448406 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284a9741-eec1-4a1a-9a1a-84e0cd568215 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:16:49.458776 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284a9741-eec1-4a1a-9a1a-84e0cd568215 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:16:49.462941 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f0684d-895f-4809-a1d9-464be5d18d76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:16:49.463598 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f0684d-895f-4809-a1d9-464be5d18d76 service neutron] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:16:49.463881 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f0684d-895f-4809-a1d9-464be5d18d76 service neutron] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:16:49.464159 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f0684d-895f-4809-a1d9-464be5d18d76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:16:49.472886 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f0684d-895f-4809-a1d9-464be5d18d76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:16:49.474306 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f0684d-895f-4809-a1d9-464be5d18d76 service neutron] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:16:49.483813 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 678/1349] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:16:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:16:54.902283 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d5d3a5-fff3-4bd6-b5ea-6eaa22b899b2 None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:16:54.903273 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d5d3a5-fff3-4bd6-b5ea-6eaa22b899b2 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:16:54.903791 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d5d3a5-fff3-4bd6-b5ea-6eaa22b899b2 None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:16:54.905362 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 672/1350] 10.222.0.44 () {54 vars in 921 bytes} [Mon May 9 20:16:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:16:54.914540 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff69dab-c5e0-4172-8929-ee1568a37252 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:16:54.915571 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff69dab-c5e0-4172-8929-ee1568a37252 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:16:54.916213 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff69dab-c5e0-4172-8929-ee1568a37252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:16:55.032225 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-bff69dab-c5e0-4172-8929-ee1568a37252 None None] MFA Rules not processed for user `285198b50b50431f96f9225d106417a4`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:16:55.033726 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-bff69dab-c5e0-4172-8929-ee1568a37252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:16:55.167003 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 679/1351] 10.222.0.44 () {58 vars in 1018 bytes} [Mon May 9 20:16:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:16:59.322954 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e598b7-d7af-403a-870d-afa5c2104484 None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:16:59.323608 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e598b7-d7af-403a-870d-afa5c2104484 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:16:59.323800 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e598b7-d7af-403a-870d-afa5c2104484 None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:16:59.325491 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 673/1352] 10.222.0.44 () {54 vars in 921 bytes} [Mon May 9 20:16:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:16:59.330639 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8665f034-1a8f-467d-83a1-3cd0702e4532 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:16:59.331118 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8665f034-1a8f-467d-83a1-3cd0702e4532 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:16:59.331211 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8665f034-1a8f-467d-83a1-3cd0702e4532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:16:59.350138 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-8665f034-1a8f-467d-83a1-3cd0702e4532 None None] MFA Rules not processed for user `285198b50b50431f96f9225d106417a4`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:16:59.352340 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-8665f034-1a8f-467d-83a1-3cd0702e4532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:16:59.362357 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 680/1353] 10.222.0.44 () {58 vars in 1018 bytes} [Mon May 9 20:16:59 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:17:00.930410 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3730b327-2b31-4e8c-83bd-1cd589e207f5 None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:17:00.931051 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3730b327-2b31-4e8c-83bd-1cd589e207f5 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:17:00.931051 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3730b327-2b31-4e8c-83bd-1cd589e207f5 None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:17:00.932257 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 674/1354] 10.222.0.44 () {54 vars in 921 bytes} [Mon May 9 20:17:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:17:00.937292 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ac113-bea3-4b78-b124-d49e9529337e None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:17:00.937803 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ac113-bea3-4b78-b124-d49e9529337e None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:17:00.937900 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ac113-bea3-4b78-b124-d49e9529337e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:17:00.957749 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-ed7ac113-bea3-4b78-b124-d49e9529337e None None] MFA Rules not processed for user `285198b50b50431f96f9225d106417a4`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:17:00.958922 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-ed7ac113-bea3-4b78-b124-d49e9529337e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:17:00.967611 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 681/1355] 10.222.0.44 () {58 vars in 1018 bytes} [Mon May 9 20:17:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:17:04.831670 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02186ba-5bbc-43e1-8bf0-03d2ec2ccf20 None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:17:04.832268 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02186ba-5bbc-43e1-8bf0-03d2ec2ccf20 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:17:04.832268 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02186ba-5bbc-43e1-8bf0-03d2ec2ccf20 None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:17:04.833598 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 675/1356] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:17:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:17:04.839571 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789a9408-93ef-44d7-97a5-e033c063e457 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:17:04.840354 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789a9408-93ef-44d7-97a5-e033c063e457 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:17:04.840783 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789a9408-93ef-44d7-97a5-e033c063e457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:17:04.858886 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-789a9408-93ef-44d7-97a5-e033c063e457 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:17:04.860296 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-789a9408-93ef-44d7-97a5-e033c063e457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:17:04.869030 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 682/1357] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:17:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:17:04.918400 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868cc180-ce60-4b34-87a2-918840b6b175 None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:17:04.918808 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868cc180-ce60-4b34-87a2-918840b6b175 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:17:04.919311 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868cc180-ce60-4b34-87a2-918840b6b175 None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:17:04.920771 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 676/1358] 10.222.0.44 () {54 vars in 961 bytes} [Mon May 9 20:17:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:17:04.926132 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5d3ec-849e-44da-a7ef-64fb6059cd3e None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:17:04.926417 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5d3ec-849e-44da-a7ef-64fb6059cd3e None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:17:04.926861 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5d3ec-849e-44da-a7ef-64fb6059cd3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:17:04.982250 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-f7c5d3ec-849e-44da-a7ef-64fb6059cd3e None None] MFA Rules not processed for user `eb59440b21074d9da15679dc2d745f72`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:17:04.983889 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-f7c5d3ec-849e-44da-a7ef-64fb6059cd3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:17:05.068654 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 683/1359] 10.222.0.44 () {58 vars in 1058 bytes} [Mon May 9 20:17:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:17:05.076923 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868cc180-ce60-4b34-87a2-918840b6b175 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:17:05.091071 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868cc180-ce60-4b34-87a2-918840b6b175 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:17:05.096430 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210acbe2-df82-46cd-a033-3e0131d8bd3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb59440b21074d9da15679dc2d745f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:17:05.097149 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210acbe2-df82-46cd-a033-3e0131d8bd3a service nova] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:17:05.097503 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210acbe2-df82-46cd-a033-3e0131d8bd3a service nova] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:17:05.097848 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210acbe2-df82-46cd-a033-3e0131d8bd3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:17:05.106347 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210acbe2-df82-46cd-a033-3e0131d8bd3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:17:05.108056 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210acbe2-df82-46cd-a033-3e0131d8bd3a service nova] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:17:05.117739 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 677/1360] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:17:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:17:07.577310 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a282ca-3fb9-40e2-a9f8-4af9095148ca None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:17:07.578201 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a282ca-3fb9-40e2-a9f8-4af9095148ca None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:17:07.578632 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a282ca-3fb9-40e2-a9f8-4af9095148ca None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:17:07.581630 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 684/1361] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:17:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 20:17:07.585889 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5c050-2476-4899-a044-59f0dd354f20 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:17:07.586307 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5c050-2476-4899-a044-59f0dd354f20 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:17:07.586422 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5c050-2476-4899-a044-59f0dd354f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:17:07.606591 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-e4f5c050-2476-4899-a044-59f0dd354f20 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:17:07.607811 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-e4f5c050-2476-4899-a044-59f0dd354f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:17:07.615724 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 678/1362] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:17:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:17:07.660539 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a282ca-3fb9-40e2-a9f8-4af9095148ca None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:17:07.674970 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a282ca-3fb9-40e2-a9f8-4af9095148ca None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:17:07.681334 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cf8218-2ca3-4837-8681-93fbe356c906 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb59440b21074d9da15679dc2d745f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:17:07.682318 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf8218-2ca3-4837-8681-93fbe356c906 service nova] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:17:07.682839 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf8218-2ca3-4837-8681-93fbe356c906 service nova] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:17:07.683255 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf8218-2ca3-4837-8681-93fbe356c906 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:17:07.693108 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cf8218-2ca3-4837-8681-93fbe356c906 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:17:07.694894 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cf8218-2ca3-4837-8681-93fbe356c906 service nova] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:17:07.705325 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 685/1363] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:17:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:17:10.252668 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae1d824-a2e7-4f58-aff2-27456453591d None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:17:10.253637 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae1d824-a2e7-4f58-aff2-27456453591d None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:17:10.254205 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae1d824-a2e7-4f58-aff2-27456453591d None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:17:10.256081 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 679/1364] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:17:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:17:10.262322 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace23c4-506d-4a57-8a21-c504d23e06cb None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:17:10.262787 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace23c4-506d-4a57-8a21-c504d23e06cb None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:17:10.262900 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace23c4-506d-4a57-8a21-c504d23e06cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:17:10.281483 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-8ace23c4-506d-4a57-8a21-c504d23e06cb None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:17:10.282659 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-8ace23c4-506d-4a57-8a21-c504d23e06cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:17:10.290432 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 686/1365] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:17:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:17:10.335513 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54780dee-2c43-4980-9742-abf35b67823e None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:17:10.336650 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54780dee-2c43-4980-9742-abf35b67823e None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:17:10.336924 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54780dee-2c43-4980-9742-abf35b67823e None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:17:10.338486 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 680/1366] 10.222.0.44 () {54 vars in 961 bytes} [Mon May 9 20:17:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:17:10.346148 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb71d6f-f75f-4e9d-b6bb-7ee14455a959 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:17:10.346434 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb71d6f-f75f-4e9d-b6bb-7ee14455a959 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:17:10.346710 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb71d6f-f75f-4e9d-b6bb-7ee14455a959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:17:10.380248 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-1eb71d6f-f75f-4e9d-b6bb-7ee14455a959 None None] MFA Rules not processed for user `eb59440b21074d9da15679dc2d745f72`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:17:10.381610 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-1eb71d6f-f75f-4e9d-b6bb-7ee14455a959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:17:10.394052 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 687/1367] 10.222.0.44 () {58 vars in 1058 bytes} [Mon May 9 20:17:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:17:10.402384 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54780dee-2c43-4980-9742-abf35b67823e None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:17:10.418596 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54780dee-2c43-4980-9742-abf35b67823e None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:17:10.423983 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b36fed5-33b7-41f3-a806-8a767231544b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb59440b21074d9da15679dc2d745f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:17:10.424613 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36fed5-33b7-41f3-a806-8a767231544b service nova] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:17:10.424892 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36fed5-33b7-41f3-a806-8a767231544b service nova] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:17:10.425170 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36fed5-33b7-41f3-a806-8a767231544b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:17:10.433306 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b36fed5-33b7-41f3-a806-8a767231544b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:17:10.434876 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b36fed5-33b7-41f3-a806-8a767231544b service nova] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:17:10.444087 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 681/1368] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:17:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:17:12.779964 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb7b1f-be43-4343-8387-ac9140cf33e3 None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:17:12.780522 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb7b1f-be43-4343-8387-ac9140cf33e3 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:17:12.780522 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb7b1f-be43-4343-8387-ac9140cf33e3 None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:17:12.781879 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 688/1369] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:17:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:17:12.787214 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ea576-59a1-4376-ba1c-f2a6ec821457 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:17:12.788009 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ea576-59a1-4376-ba1c-f2a6ec821457 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:17:12.788459 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ea576-59a1-4376-ba1c-f2a6ec821457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:17:12.808659 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-0f8ea576-59a1-4376-ba1c-f2a6ec821457 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:17:12.810079 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-0f8ea576-59a1-4376-ba1c-f2a6ec821457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:17:12.818190 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 682/1370] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:17:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:17:12.871156 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fb7b1f-be43-4343-8387-ac9140cf33e3 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:17:12.885953 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fb7b1f-be43-4343-8387-ac9140cf33e3 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:17:12.892165 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0fd70c-9eaf-42a2-8d1a-68381999aa03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb59440b21074d9da15679dc2d745f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:17:12.893066 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0fd70c-9eaf-42a2-8d1a-68381999aa03 service nova] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:17:12.893635 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0fd70c-9eaf-42a2-8d1a-68381999aa03 service nova] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:17:12.894460 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0fd70c-9eaf-42a2-8d1a-68381999aa03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:17:12.905004 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0fd70c-9eaf-42a2-8d1a-68381999aa03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:17:12.907095 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0fd70c-9eaf-42a2-8d1a-68381999aa03 service nova] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:17:12.921884 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 689/1371] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:17:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:17:13.120520 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb59911-343b-4c48-bb30-1dd61889241b None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:17:13.120824 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb59911-343b-4c48-bb30-1dd61889241b None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:17:13.121088 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb59911-343b-4c48-bb30-1dd61889241b None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:17:13.122579 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 683/1372] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:17:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:17:13.128858 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea75c44c-ec41-419d-be1f-f12ee6552e0c None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:17:13.129137 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea75c44c-ec41-419d-be1f-f12ee6552e0c None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:17:13.129591 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea75c44c-ec41-419d-be1f-f12ee6552e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:17:13.152461 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-ea75c44c-ec41-419d-be1f-f12ee6552e0c None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:17:13.153765 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-ea75c44c-ec41-419d-be1f-f12ee6552e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:17:13.163458 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 690/1373] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:17:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:17:13.473095 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1311f6-da35-463e-a41d-1d28b763234e None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:17:13.473095 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1311f6-da35-463e-a41d-1d28b763234e None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:17:13.473095 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1311f6-da35-463e-a41d-1d28b763234e None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:17:13.475755 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 684/1374] 10.222.0.44 () {54 vars in 963 bytes} [Mon May 9 20:17:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:17:13.479204 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a699d-d34e-4b90-93f2-967e29b907b8 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:17:13.479526 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a699d-d34e-4b90-93f2-967e29b907b8 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:17:13.479805 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a699d-d34e-4b90-93f2-967e29b907b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:17:13.529399 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-b52a699d-d34e-4b90-93f2-967e29b907b8 None None] MFA Rules not processed for user `9d65e731386d44948dcc1ecd40cbda65`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:17:13.530819 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-b52a699d-d34e-4b90-93f2-967e29b907b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:17:13.595892 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 691/1375] 10.222.0.44 () {58 vars in 1060 bytes} [Mon May 9 20:17:13 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:17:13.606064 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1311f6-da35-463e-a41d-1d28b763234e None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:17:13.617079 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1311f6-da35-463e-a41d-1d28b763234e None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:17:13.620779 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b8a80e-f0b2-4968-b670-653aed541057 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d65e731386d44948dcc1ecd40cbda65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:17:13.621420 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8a80e-f0b2-4968-b670-653aed541057 service cinder] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:17:13.621699 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8a80e-f0b2-4968-b670-653aed541057 service cinder] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:17:13.622222 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8a80e-f0b2-4968-b670-653aed541057 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:17:13.632141 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b8a80e-f0b2-4968-b670-653aed541057 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:17:13.634227 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b8a80e-f0b2-4968-b670-653aed541057 service cinder] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:17:13.647532 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 685/1376] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:17:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:17:15.210482 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652e6e5-42e4-409d-a52b-f9d7f7a47fdc None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:17:15.211572 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652e6e5-42e4-409d-a52b-f9d7f7a47fdc None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:17:15.211753 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652e6e5-42e4-409d-a52b-f9d7f7a47fdc None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:17:15.213165 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 692/1377] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:17:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:17:15.219082 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49cb6e-cd22-47f0-84f0-c99d06d7b631 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:17:15.219639 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49cb6e-cd22-47f0-84f0-c99d06d7b631 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:17:15.219639 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49cb6e-cd22-47f0-84f0-c99d06d7b631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:17:15.238352 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-3d49cb6e-cd22-47f0-84f0-c99d06d7b631 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:17:15.239511 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-3d49cb6e-cd22-47f0-84f0-c99d06d7b631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:17:15.248015 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 686/1378] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:17:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:17:15.293258 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2652e6e5-42e4-409d-a52b-f9d7f7a47fdc None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:17:15.308617 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2652e6e5-42e4-409d-a52b-f9d7f7a47fdc None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:17:15.314063 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e7d616-113e-47b6-98a7-47d6c57a1872 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb59440b21074d9da15679dc2d745f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:17:15.314716 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7d616-113e-47b6-98a7-47d6c57a1872 service nova] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:17:15.315010 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7d616-113e-47b6-98a7-47d6c57a1872 service nova] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:17:15.315270 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7d616-113e-47b6-98a7-47d6c57a1872 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:17:15.324775 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e7d616-113e-47b6-98a7-47d6c57a1872 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:17:15.326393 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e7d616-113e-47b6-98a7-47d6c57a1872 service nova] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:17:15.337294 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 693/1379] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:17:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:17:17.642502 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c66a4-6dcd-44fe-a313-d78847ef1850 None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:17:17.643058 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c66a4-6dcd-44fe-a313-d78847ef1850 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:17:17.643058 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c66a4-6dcd-44fe-a313-d78847ef1850 None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:17:17.644438 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 687/1380] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:17:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:17:17.650299 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dbdfe6-d336-4ab3-8f45-3fdc84d9f3c5 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:17:17.650734 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dbdfe6-d336-4ab3-8f45-3fdc84d9f3c5 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:17:17.650830 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dbdfe6-d336-4ab3-8f45-3fdc84d9f3c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:17:17.668566 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-a0dbdfe6-d336-4ab3-8f45-3fdc84d9f3c5 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:17:17.669746 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-a0dbdfe6-d336-4ab3-8f45-3fdc84d9f3c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:17:17.677725 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 694/1381] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:17:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:17:17.722588 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c66a4-6dcd-44fe-a313-d78847ef1850 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:17:17.737101 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c66a4-6dcd-44fe-a313-d78847ef1850 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:17:17.742750 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710fde29-86c1-4dbe-9bf7-a03f666995a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb59440b21074d9da15679dc2d745f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:17:17.743382 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710fde29-86c1-4dbe-9bf7-a03f666995a2 service nova] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:17:17.743791 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710fde29-86c1-4dbe-9bf7-a03f666995a2 service nova] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:17:17.744068 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710fde29-86c1-4dbe-9bf7-a03f666995a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:17:17.752643 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710fde29-86c1-4dbe-9bf7-a03f666995a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:17:17.754261 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710fde29-86c1-4dbe-9bf7-a03f666995a2 service nova] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:17:17.764843 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 688/1382] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:17:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:17:20.044710 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4a9b6-2807-40cf-9a17-21946ca3c12d None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:17:20.045274 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4a9b6-2807-40cf-9a17-21946ca3c12d None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:17:20.045274 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4a9b6-2807-40cf-9a17-21946ca3c12d None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:17:20.046615 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 695/1383] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:17:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:17:20.051843 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fac398b-a2d2-4cc6-aa31-ebe536216532 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:17:20.052271 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fac398b-a2d2-4cc6-aa31-ebe536216532 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:17:20.052376 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fac398b-a2d2-4cc6-aa31-ebe536216532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:17:20.070283 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-6fac398b-a2d2-4cc6-aa31-ebe536216532 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:17:20.071536 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-6fac398b-a2d2-4cc6-aa31-ebe536216532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:17:20.079726 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 689/1384] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:17:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:17:20.123750 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad4a9b6-2807-40cf-9a17-21946ca3c12d None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:17:20.140348 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad4a9b6-2807-40cf-9a17-21946ca3c12d None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:17:20.146391 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905ac9f1-4c3f-4771-8ce0-dbf63ea84144 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb59440b21074d9da15679dc2d745f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:17:20.147146 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ac9f1-4c3f-4771-8ce0-dbf63ea84144 service nova] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:17:20.147529 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ac9f1-4c3f-4771-8ce0-dbf63ea84144 service nova] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:17:20.148473 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ac9f1-4c3f-4771-8ce0-dbf63ea84144 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:17:20.157616 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905ac9f1-4c3f-4771-8ce0-dbf63ea84144 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:17:20.159188 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905ac9f1-4c3f-4771-8ce0-dbf63ea84144 service nova] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:17:20.169302 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 696/1385] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:17:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:17:22.420729 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe61fed2-436e-4c71-a0d6-d88d51c68a8a None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:17:22.421317 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe61fed2-436e-4c71-a0d6-d88d51c68a8a None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:17:22.421317 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe61fed2-436e-4c71-a0d6-d88d51c68a8a None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:17:22.422892 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 690/1386] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:17:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:17:22.428311 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a737d6a7-913a-4326-9a42-1891fd0bcc25 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:17:22.428736 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a737d6a7-913a-4326-9a42-1891fd0bcc25 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:17:22.428882 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a737d6a7-913a-4326-9a42-1891fd0bcc25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:17:22.450805 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-a737d6a7-913a-4326-9a42-1891fd0bcc25 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:17:22.452326 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-a737d6a7-913a-4326-9a42-1891fd0bcc25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:17:22.462619 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 697/1387] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:17:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:17:22.510166 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe61fed2-436e-4c71-a0d6-d88d51c68a8a None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:17:22.525249 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe61fed2-436e-4c71-a0d6-d88d51c68a8a None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:17:22.530806 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826f4193-f09c-419a-95c4-12be451f2757 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb59440b21074d9da15679dc2d745f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:17:22.531502 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f4193-f09c-419a-95c4-12be451f2757 service nova] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:17:22.531749 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f4193-f09c-419a-95c4-12be451f2757 service nova] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:17:22.532025 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f4193-f09c-419a-95c4-12be451f2757 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:17:22.541048 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826f4193-f09c-419a-95c4-12be451f2757 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:17:22.542646 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826f4193-f09c-419a-95c4-12be451f2757 service nova] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:17:22.552545 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 691/1388] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:17:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:17:24.800743 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00309c4-b835-46be-90be-fd18f3aa5630 None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:17:24.801263 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00309c4-b835-46be-90be-fd18f3aa5630 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:17:24.801263 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00309c4-b835-46be-90be-fd18f3aa5630 None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:17:24.802563 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 698/1389] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:17:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:17:24.810145 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f376bde-8a60-46cf-9d88-c1760b903725 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:17:24.810717 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f376bde-8a60-46cf-9d88-c1760b903725 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:17:24.810717 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f376bde-8a60-46cf-9d88-c1760b903725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:17:24.829639 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-3f376bde-8a60-46cf-9d88-c1760b903725 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:17:24.830903 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-3f376bde-8a60-46cf-9d88-c1760b903725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:17:24.839737 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 692/1390] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:17:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:17:24.885245 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00309c4-b835-46be-90be-fd18f3aa5630 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:17:24.900264 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00309c4-b835-46be-90be-fd18f3aa5630 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:17:24.906047 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4358ea09-3c40-47ea-9d76-e05601688789 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb59440b21074d9da15679dc2d745f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:17:24.906714 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358ea09-3c40-47ea-9d76-e05601688789 service nova] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:17:24.907008 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358ea09-3c40-47ea-9d76-e05601688789 service nova] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:17:24.907294 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358ea09-3c40-47ea-9d76-e05601688789 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:17:24.916915 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4358ea09-3c40-47ea-9d76-e05601688789 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:17:24.918985 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4358ea09-3c40-47ea-9d76-e05601688789 service nova] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:17:24.932358 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 699/1391] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:17:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:17:27.671650 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63fcd0-66a1-4914-a5c3-bd74ad56eaef None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:17:27.672253 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63fcd0-66a1-4914-a5c3-bd74ad56eaef None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:17:27.672253 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63fcd0-66a1-4914-a5c3-bd74ad56eaef None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:17:27.673542 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 693/1392] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:17:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:17:27.679056 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7179d67-830a-4dee-b9ea-5009d85acb26 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:17:27.679550 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7179d67-830a-4dee-b9ea-5009d85acb26 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:17:27.679653 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7179d67-830a-4dee-b9ea-5009d85acb26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:17:27.698327 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-c7179d67-830a-4dee-b9ea-5009d85acb26 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:17:27.699515 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-c7179d67-830a-4dee-b9ea-5009d85acb26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:17:27.707132 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 700/1393] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:17:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:17:27.751480 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e63fcd0-66a1-4914-a5c3-bd74ad56eaef None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:17:27.766541 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e63fcd0-66a1-4914-a5c3-bd74ad56eaef None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:17:27.771786 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f06aa52-c2ae-4778-a367-7fafcf70bd4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb59440b21074d9da15679dc2d745f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:17:27.772415 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f06aa52-c2ae-4778-a367-7fafcf70bd4c service nova] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:17:27.772738 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f06aa52-c2ae-4778-a367-7fafcf70bd4c service nova] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:17:27.773006 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f06aa52-c2ae-4778-a367-7fafcf70bd4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:17:27.780973 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f06aa52-c2ae-4778-a367-7fafcf70bd4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:17:27.782540 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f06aa52-c2ae-4778-a367-7fafcf70bd4c service nova] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:17:27.791705 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 694/1394] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:17:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:17:29.334624 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf9f69-e7db-44d4-89a5-c2f86b663437 None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:17:29.335857 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf9f69-e7db-44d4-89a5-c2f86b663437 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:17:29.335857 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf9f69-e7db-44d4-89a5-c2f86b663437 None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:17:29.337572 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 701/1395] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:17:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:17:29.343760 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da738baf-5780-445b-87f1-1b459321d90b None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:17:29.344227 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da738baf-5780-445b-87f1-1b459321d90b None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:17:29.344322 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da738baf-5780-445b-87f1-1b459321d90b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:17:29.365085 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-da738baf-5780-445b-87f1-1b459321d90b None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:17:29.366995 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-da738baf-5780-445b-87f1-1b459321d90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:17:29.375793 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 695/1396] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:17:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:17:29.447284 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073906f-4ff9-4a3e-8c3a-ec6ed7d89d10 None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:17:29.447722 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073906f-4ff9-4a3e-8c3a-ec6ed7d89d10 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:17:29.448194 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073906f-4ff9-4a3e-8c3a-ec6ed7d89d10 None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:17:29.449608 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 702/1397] 10.222.0.44 () {54 vars in 962 bytes} [Mon May 9 20:17:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:17:29.455103 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9870181c-1e2c-43a2-b6ee-30b1afbce35a None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:17:29.455439 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9870181c-1e2c-43a2-b6ee-30b1afbce35a None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:17:29.455702 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9870181c-1e2c-43a2-b6ee-30b1afbce35a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:17:29.508439 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-9870181c-1e2c-43a2-b6ee-30b1afbce35a None None] MFA Rules not processed for user `65db5d9a86fd48acb5874df0165c0ef9`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:17:29.509675 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-9870181c-1e2c-43a2-b6ee-30b1afbce35a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:17:29.574291 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 696/1398] 10.222.0.44 () {58 vars in 1059 bytes} [Mon May 9 20:17:29 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:17:29.582158 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c073906f-4ff9-4a3e-8c3a-ec6ed7d89d10 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:17:29.593476 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c073906f-4ff9-4a3e-8c3a-ec6ed7d89d10 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:17:29.596924 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8462e5a6-981f-45c8-9762-f1320d4886b7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65db5d9a86fd48acb5874df0165c0ef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:17:29.597553 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8462e5a6-981f-45c8-9762-f1320d4886b7 service glance] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:17:29.598126 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8462e5a6-981f-45c8-9762-f1320d4886b7 service glance] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:17:29.598398 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8462e5a6-981f-45c8-9762-f1320d4886b7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:17:29.608936 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8462e5a6-981f-45c8-9762-f1320d4886b7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:17:29.610399 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8462e5a6-981f-45c8-9762-f1320d4886b7 service glance] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:17:29.621076 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 703/1399] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:17:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:17:30.055735 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1063d0d-3f20-492f-b85b-bd9948e5ec76 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:17:30.056031 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1063d0d-3f20-492f-b85b-bd9948e5ec76 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:17:30.056309 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1063d0d-3f20-492f-b85b-bd9948e5ec76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:17:30.103259 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95dd96-540d-4125-be37-a008f341e141 None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:17:30.103632 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95dd96-540d-4125-be37-a008f341e141 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:17:30.103845 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95dd96-540d-4125-be37-a008f341e141 None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:17:30.105263 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 704/1400] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:17:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 20:17:30.110430 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a422a3-05e8-4cfc-95a2-b3326829a7c2 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:17:30.110707 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a422a3-05e8-4cfc-95a2-b3326829a7c2 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:17:30.110974 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a422a3-05e8-4cfc-95a2-b3326829a7c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:17:30.114506 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-b1063d0d-3f20-492f-b85b-bd9948e5ec76 None None] MFA Rules not processed for user `0227b2954e61426388214e96e1741eb2`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:17:30.115760 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-b1063d0d-3f20-492f-b85b-bd9948e5ec76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:17:30.128078 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-c3a422a3-05e8-4cfc-95a2-b3326829a7c2 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:17:30.129224 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-c3a422a3-05e8-4cfc-95a2-b3326829a7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:17:30.137862 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 705/1401] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:17:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:17:30.177732 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 697/1402] 10.222.0.44 () {58 vars in 1009 bytes} [Mon May 9 20:17:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:17:30.181704 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a422a3-05e8-4cfc-95a2-b3326829a7c2 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:17:30.193782 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a422a3-05e8-4cfc-95a2-b3326829a7c2 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:17:30.200381 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b1e4bb-add0-44f7-ae74-29805a57ec81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb59440b21074d9da15679dc2d745f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:17:30.201088 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b1e4bb-add0-44f7-ae74-29805a57ec81 service nova] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:17:30.201371 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b1e4bb-add0-44f7-ae74-29805a57ec81 service nova] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:17:30.201673 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b1e4bb-add0-44f7-ae74-29805a57ec81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:17:30.210790 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b1e4bb-add0-44f7-ae74-29805a57ec81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:17:30.212393 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b1e4bb-add0-44f7-ae74-29805a57ec81 service nova] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:17:30.222048 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 706/1403] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:17:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:17:30.222713 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d349375-e7f6-47fa-9071-00d62c6ed7d3 None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:17:30.223001 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d349375-e7f6-47fa-9071-00d62c6ed7d3 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:17:30.223275 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d349375-e7f6-47fa-9071-00d62c6ed7d3 None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:17:30.224725 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 698/1404] 10.222.0.44 () {54 vars in 942 bytes} [Mon May 9 20:17:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:17:30.231121 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f046b34-1446-4711-93e4-34f38b24e8e3 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:17:30.231434 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f046b34-1446-4711-93e4-34f38b24e8e3 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:17:30.231716 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f046b34-1446-4711-93e4-34f38b24e8e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:17:30.293124 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-9f046b34-1446-4711-93e4-34f38b24e8e3 None None] MFA Rules not processed for user `965089f1a92f49bd883b337d6042c69f`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:17:30.293124 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-9f046b34-1446-4711-93e4-34f38b24e8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:17:30.361737 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 707/1405] 10.222.0.44 () {58 vars in 1039 bytes} [Mon May 9 20:17:30 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:17:30.372383 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d349375-e7f6-47fa-9071-00d62c6ed7d3 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:17:30.386429 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d349375-e7f6-47fa-9071-00d62c6ed7d3 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:17:30.392882 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a24a9cf-09a3-4e2b-b822-1242b53c8d79 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965089f1a92f49bd883b337d6042c69f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:17:30.393549 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24a9cf-09a3-4e2b-b822-1242b53c8d79 service swift] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:17:30.393831 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24a9cf-09a3-4e2b-b822-1242b53c8d79 service swift] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:17:30.394106 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24a9cf-09a3-4e2b-b822-1242b53c8d79 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:17:30.403334 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a24a9cf-09a3-4e2b-b822-1242b53c8d79 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:17:30.404993 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a24a9cf-09a3-4e2b-b822-1242b53c8d79 service swift] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:17:30.414961 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 699/1406] 10.222.0.44 () {60 vars in 1384 bytes} [Mon May 9 20:17:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 09 20:17:32.522271 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1ad1a-b72a-4a3f-b576-c25abef9bfae None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:17:32.523338 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1ad1a-b72a-4a3f-b576-c25abef9bfae None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:17:32.523626 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1ad1a-b72a-4a3f-b576-c25abef9bfae None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:17:32.525303 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 708/1407] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:17:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:17:32.530476 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b2b241-390d-41c6-adf1-a73da42175bc None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:17:32.530938 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b2b241-390d-41c6-adf1-a73da42175bc None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:17:32.531036 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b2b241-390d-41c6-adf1-a73da42175bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:17:32.554902 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-53b2b241-390d-41c6-adf1-a73da42175bc None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:17:32.556172 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-53b2b241-390d-41c6-adf1-a73da42175bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:17:32.575867 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 700/1408] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:17:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:17:32.611379 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c1ad1a-b72a-4a3f-b576-c25abef9bfae None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:17:32.626298 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c1ad1a-b72a-4a3f-b576-c25abef9bfae None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:17:32.631797 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedbf8c1-3384-4159-80ce-49c7845e3864 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb59440b21074d9da15679dc2d745f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:17:32.633159 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedbf8c1-3384-4159-80ce-49c7845e3864 service nova] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:17:32.633441 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedbf8c1-3384-4159-80ce-49c7845e3864 service nova] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:17:32.633738 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedbf8c1-3384-4159-80ce-49c7845e3864 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:17:32.642307 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedbf8c1-3384-4159-80ce-49c7845e3864 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:17:32.644106 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedbf8c1-3384-4159-80ce-49c7845e3864 service nova] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:17:32.658924 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 709/1409] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:17:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:17:53.849415 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3937792-3d74-4cc9-8311-1170f98100d0 None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:17:53.850048 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3937792-3d74-4cc9-8311-1170f98100d0 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:17:53.850048 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3937792-3d74-4cc9-8311-1170f98100d0 None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:17:53.851474 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 701/1410] 10.222.0.44 () {54 vars in 918 bytes} [Mon May 9 20:17:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:17:53.856605 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce314bf-685e-4b33-93c2-7b94a22e4d31 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:17:53.857072 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce314bf-685e-4b33-93c2-7b94a22e4d31 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:17:53.857174 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce314bf-685e-4b33-93c2-7b94a22e4d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:17:53.874434 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-9ce314bf-685e-4b33-93c2-7b94a22e4d31 None None] MFA Rules not processed for user `285198b50b50431f96f9225d106417a4`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:17:53.875646 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-9ce314bf-685e-4b33-93c2-7b94a22e4d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:17:53.884651 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 710/1411] 10.222.0.44 () {58 vars in 1015 bytes} [Mon May 9 20:17:53 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:17:53.899672 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb48871-c747-4495-b448-c27f76fa4dd7 None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:17:53.899953 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb48871-c747-4495-b448-c27f76fa4dd7 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:17:53.900222 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb48871-c747-4495-b448-c27f76fa4dd7 None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:17:53.901571 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 702/1412] 10.222.0.44 () {54 vars in 918 bytes} [Mon May 9 20:17:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:17:53.906083 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ab407-36b9-4257-aa0d-b20ea76363ca None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:17:53.906370 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ab407-36b9-4257-aa0d-b20ea76363ca None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:17:53.906646 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ab407-36b9-4257-aa0d-b20ea76363ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:17:53.923966 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-112ab407-36b9-4257-aa0d-b20ea76363ca None None] MFA Rules not processed for user `eb59440b21074d9da15679dc2d745f72`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:17:53.925128 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-112ab407-36b9-4257-aa0d-b20ea76363ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:17:53.934079 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 711/1413] 10.222.0.44 () {58 vars in 1015 bytes} [Mon May 9 20:17:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:17:56.625096 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5420db-10ba-439b-baed-f374b058d236 None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:17:56.625615 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5420db-10ba-439b-baed-f374b058d236 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:17:56.625615 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5420db-10ba-439b-baed-f374b058d236 None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:17:56.626981 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 703/1414] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 9 20:17:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:17:56.632483 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae9096-64cb-475c-9afa-5b5b50ec75f4 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:17:56.632918 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae9096-64cb-475c-9afa-5b5b50ec75f4 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:17:56.633025 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae9096-64cb-475c-9afa-5b5b50ec75f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:17:56.650624 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-41ae9096-64cb-475c-9afa-5b5b50ec75f4 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:17:56.651842 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-41ae9096-64cb-475c-9afa-5b5b50ec75f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:17:56.659444 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 712/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 9 20:17:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:17:56.701458 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5420db-10ba-439b-baed-f374b058d236 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:17:56.715316 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5420db-10ba-439b-baed-f374b058d236 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:17:56.720672 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d9e60c-5a53-4160-9ecf-2255c5b34f92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb59440b21074d9da15679dc2d745f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:17:56.721290 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9e60c-5a53-4160-9ecf-2255c5b34f92 service nova] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:17:56.721569 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9e60c-5a53-4160-9ecf-2255c5b34f92 service nova] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:17:56.721839 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9e60c-5a53-4160-9ecf-2255c5b34f92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:17:56.730453 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d9e60c-5a53-4160-9ecf-2255c5b34f92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:17:56.732086 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d9e60c-5a53-4160-9ecf-2255c5b34f92 service nova] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:17:56.741270 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 704/1416] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:17:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:17:57.730522 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c94ead-354d-4e49-b9fd-6af58a6ec668 None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:17:57.731055 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c94ead-354d-4e49-b9fd-6af58a6ec668 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:17:57.731149 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c94ead-354d-4e49-b9fd-6af58a6ec668 None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:17:57.732640 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 713/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 9 20:17:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:17:57.737494 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e66089a-fa4b-41ef-a893-7f47db67099b None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:17:57.737888 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e66089a-fa4b-41ef-a893-7f47db67099b None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:17:57.738042 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e66089a-fa4b-41ef-a893-7f47db67099b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:17:57.757186 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-3e66089a-fa4b-41ef-a893-7f47db67099b None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:17:57.758394 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-3e66089a-fa4b-41ef-a893-7f47db67099b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:17:57.766414 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 705/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 9 20:17:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:17:57.919816 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c94ead-354d-4e49-b9fd-6af58a6ec668 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:17:57.934436 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c94ead-354d-4e49-b9fd-6af58a6ec668 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:17:57.939800 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb2118f-3bec-4c0d-9369-912642bb753c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb59440b21074d9da15679dc2d745f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:17:57.940426 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb2118f-3bec-4c0d-9369-912642bb753c service nova] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:17:57.940713 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb2118f-3bec-4c0d-9369-912642bb753c service nova] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:17:57.940988 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb2118f-3bec-4c0d-9369-912642bb753c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:17:57.949560 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb2118f-3bec-4c0d-9369-912642bb753c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:17:57.951137 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb2118f-3bec-4c0d-9369-912642bb753c service nova] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:17:57.960329 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 714/1419] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:17:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:17:58.910923 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c9f4c-e41c-4d11-93d1-de91c686eb90 None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:17:58.911493 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c9f4c-e41c-4d11-93d1-de91c686eb90 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:17:58.911493 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c9f4c-e41c-4d11-93d1-de91c686eb90 None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:17:58.913406 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 706/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 9 20:17:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:17:58.918386 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a036d258-bd9e-44cd-8495-eb12d5da3fc3 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:17:58.918817 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a036d258-bd9e-44cd-8495-eb12d5da3fc3 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:17:58.918929 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a036d258-bd9e-44cd-8495-eb12d5da3fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:17:58.936849 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-a036d258-bd9e-44cd-8495-eb12d5da3fc3 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:17:58.938034 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-a036d258-bd9e-44cd-8495-eb12d5da3fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:17:58.945754 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 715/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 9 20:17:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:17:59.093145 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2c9f4c-e41c-4d11-93d1-de91c686eb90 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:17:59.107630 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2c9f4c-e41c-4d11-93d1-de91c686eb90 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:17:59.112842 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a1dcc9-dce2-4be0-a9d4-6318ed38584f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb59440b21074d9da15679dc2d745f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:17:59.113469 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a1dcc9-dce2-4be0-a9d4-6318ed38584f service nova] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:17:59.113747 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a1dcc9-dce2-4be0-a9d4-6318ed38584f service nova] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:17:59.114016 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a1dcc9-dce2-4be0-a9d4-6318ed38584f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:17:59.122695 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a1dcc9-dce2-4be0-a9d4-6318ed38584f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:17:59.124309 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a1dcc9-dce2-4be0-a9d4-6318ed38584f service nova] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:17:59.133300 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 707/1422] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:17:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:18:00.057884 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae7f5e6-eff5-45e7-975e-b565b049c3c9 None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:18:00.058482 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae7f5e6-eff5-45e7-975e-b565b049c3c9 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:18:00.058482 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae7f5e6-eff5-45e7-975e-b565b049c3c9 None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:18:00.059834 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 716/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 9 20:18:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:18:00.064797 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a74fe5-a9d1-427f-bbe4-d3b915a6c9b8 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:18:00.065198 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a74fe5-a9d1-427f-bbe4-d3b915a6c9b8 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:18:00.065376 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a74fe5-a9d1-427f-bbe4-d3b915a6c9b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:18:00.083046 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-a0a74fe5-a9d1-427f-bbe4-d3b915a6c9b8 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:18:00.084810 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-a0a74fe5-a9d1-427f-bbe4-d3b915a6c9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:18:00.092617 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 708/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 9 20:18:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:18:00.242609 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae7f5e6-eff5-45e7-975e-b565b049c3c9 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:18:00.256418 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae7f5e6-eff5-45e7-975e-b565b049c3c9 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:18:00.261646 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8518e2-62d8-4236-bfcb-3dee78e2c7ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb59440b21074d9da15679dc2d745f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:18:00.262519 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8518e2-62d8-4236-bfcb-3dee78e2c7ac service nova] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:18:00.262795 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8518e2-62d8-4236-bfcb-3dee78e2c7ac service nova] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:18:00.263060 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8518e2-62d8-4236-bfcb-3dee78e2c7ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:18:00.270934 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8518e2-62d8-4236-bfcb-3dee78e2c7ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:18:00.273386 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8518e2-62d8-4236-bfcb-3dee78e2c7ac service nova] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:18:00.282512 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 717/1425] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:18:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:18:01.214316 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac3a4b-95ad-4018-9eab-4c88dbb05ab7 None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:18:01.214859 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac3a4b-95ad-4018-9eab-4c88dbb05ab7 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:18:01.214859 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac3a4b-95ad-4018-9eab-4c88dbb05ab7 None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:18:01.216282 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 709/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 9 20:18:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:18:01.221432 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba99f4-921f-4a7f-b26c-575d959ffb19 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:18:01.221844 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba99f4-921f-4a7f-b26c-575d959ffb19 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:18:01.221988 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba99f4-921f-4a7f-b26c-575d959ffb19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:18:01.240103 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-32ba99f4-921f-4a7f-b26c-575d959ffb19 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:18:01.241954 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-32ba99f4-921f-4a7f-b26c-575d959ffb19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:18:01.249618 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 718/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 9 20:18:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:18:01.401763 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ac3a4b-95ad-4018-9eab-4c88dbb05ab7 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:18:01.416831 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ac3a4b-95ad-4018-9eab-4c88dbb05ab7 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:18:01.422179 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba85d5c-2bd1-4b1c-b342-4f1b317ae14c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb59440b21074d9da15679dc2d745f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:18:01.422806 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba85d5c-2bd1-4b1c-b342-4f1b317ae14c service nova] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:18:01.423083 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba85d5c-2bd1-4b1c-b342-4f1b317ae14c service nova] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:18:01.423351 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba85d5c-2bd1-4b1c-b342-4f1b317ae14c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:18:01.432094 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba85d5c-2bd1-4b1c-b342-4f1b317ae14c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:18:01.433670 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba85d5c-2bd1-4b1c-b342-4f1b317ae14c service nova] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:18:01.442571 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 710/1428] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:18:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:18:02.309214 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42784f6-2510-4839-86e6-1d68a11bca56 None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:18:02.309789 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42784f6-2510-4839-86e6-1d68a11bca56 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:18:02.309789 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42784f6-2510-4839-86e6-1d68a11bca56 None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:18:02.311160 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 719/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 9 20:18:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 20:18:02.316110 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e032244-8479-472d-849a-286889aa1c9e None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:18:02.316564 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e032244-8479-472d-849a-286889aa1c9e None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:18:02.316663 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e032244-8479-472d-849a-286889aa1c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:18:02.334745 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-1e032244-8479-472d-849a-286889aa1c9e None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:18:02.335834 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-1e032244-8479-472d-849a-286889aa1c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:18:02.343619 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 711/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 9 20:18:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:18:02.493429 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42784f6-2510-4839-86e6-1d68a11bca56 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:18:02.507689 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42784f6-2510-4839-86e6-1d68a11bca56 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:18:02.513237 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883a9e1f-1ca1-4329-92f7-941ee59bcca3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb59440b21074d9da15679dc2d745f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:18:02.513857 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a9e1f-1ca1-4329-92f7-941ee59bcca3 service nova] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:18:02.514143 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a9e1f-1ca1-4329-92f7-941ee59bcca3 service nova] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:18:02.514411 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a9e1f-1ca1-4329-92f7-941ee59bcca3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:18:02.522982 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883a9e1f-1ca1-4329-92f7-941ee59bcca3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:18:02.524594 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883a9e1f-1ca1-4329-92f7-941ee59bcca3 service nova] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:18:02.533592 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 720/1431] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:18:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:18:03.424150 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799cf9c8-de44-4381-a68f-6dab177ceba9 None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:18:03.424699 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799cf9c8-de44-4381-a68f-6dab177ceba9 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:18:03.424699 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799cf9c8-de44-4381-a68f-6dab177ceba9 None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:18:03.426052 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 712/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 9 20:18:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:18:03.431855 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d156da5-0726-422c-b844-3e82aad0449a None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:18:03.432271 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d156da5-0726-422c-b844-3e82aad0449a None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:18:03.432402 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d156da5-0726-422c-b844-3e82aad0449a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:18:03.449614 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-5d156da5-0726-422c-b844-3e82aad0449a None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:18:03.450782 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-5d156da5-0726-422c-b844-3e82aad0449a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:18:03.458459 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 721/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 9 20:18:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:18:03.607668 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799cf9c8-de44-4381-a68f-6dab177ceba9 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:18:03.621279 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799cf9c8-de44-4381-a68f-6dab177ceba9 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:18:03.626476 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3acb5b4-d36f-4836-83fe-4878f7dc4633 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb59440b21074d9da15679dc2d745f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:18:03.627087 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3acb5b4-d36f-4836-83fe-4878f7dc4633 service nova] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:18:03.627361 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3acb5b4-d36f-4836-83fe-4878f7dc4633 service nova] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:18:03.627664 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3acb5b4-d36f-4836-83fe-4878f7dc4633 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:18:03.635452 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3acb5b4-d36f-4836-83fe-4878f7dc4633 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:18:03.637287 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3acb5b4-d36f-4836-83fe-4878f7dc4633 service nova] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:18:03.646136 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 713/1434] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:18:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:18:04.515850 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e2a73-691d-4fb4-a801-32717c3b3c01 None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:18:04.516425 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e2a73-691d-4fb4-a801-32717c3b3c01 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:18:04.516425 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e2a73-691d-4fb4-a801-32717c3b3c01 None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:18:04.517743 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 722/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 9 20:18:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:18:04.522758 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebbb4bc-bf7d-4a8e-a67f-8f5a9ea1524b None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:18:04.523211 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebbb4bc-bf7d-4a8e-a67f-8f5a9ea1524b None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:18:04.523326 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebbb4bc-bf7d-4a8e-a67f-8f5a9ea1524b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:18:04.541722 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-0ebbb4bc-bf7d-4a8e-a67f-8f5a9ea1524b None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:18:04.542904 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-0ebbb4bc-bf7d-4a8e-a67f-8f5a9ea1524b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:18:04.550629 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 714/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 9 20:18:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:18:04.699083 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4e2a73-691d-4fb4-a801-32717c3b3c01 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:18:04.713443 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4e2a73-691d-4fb4-a801-32717c3b3c01 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:18:04.718523 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937c5f0d-0b2c-4fd4-814f-e313e44e3eb1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb59440b21074d9da15679dc2d745f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:18:04.719142 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c5f0d-0b2c-4fd4-814f-e313e44e3eb1 service nova] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:18:04.719440 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c5f0d-0b2c-4fd4-814f-e313e44e3eb1 service nova] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:18:04.719716 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c5f0d-0b2c-4fd4-814f-e313e44e3eb1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:18:04.728078 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937c5f0d-0b2c-4fd4-814f-e313e44e3eb1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:18:04.729623 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937c5f0d-0b2c-4fd4-814f-e313e44e3eb1 service nova] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:18:04.738537 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 723/1437] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:18:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:18:05.610403 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b93309d-76a0-4614-9872-77a25ed7f809 None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:18:05.610903 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b93309d-76a0-4614-9872-77a25ed7f809 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:18:05.610999 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b93309d-76a0-4614-9872-77a25ed7f809 None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:18:05.612312 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 715/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 9 20:18:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:18:05.617964 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f07b5b-58fc-4657-8937-dc9c229f5577 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:18:05.618409 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f07b5b-58fc-4657-8937-dc9c229f5577 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:18:05.618505 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f07b5b-58fc-4657-8937-dc9c229f5577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:18:05.635758 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-a8f07b5b-58fc-4657-8937-dc9c229f5577 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:18:05.637172 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-a8f07b5b-58fc-4657-8937-dc9c229f5577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:18:05.644752 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 724/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 9 20:18:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:18:05.792136 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b93309d-76a0-4614-9872-77a25ed7f809 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:18:05.806581 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b93309d-76a0-4614-9872-77a25ed7f809 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:18:05.811921 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8085581-36cd-4a7f-b6d8-60c465ee082e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb59440b21074d9da15679dc2d745f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:18:05.812545 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8085581-36cd-4a7f-b6d8-60c465ee082e service nova] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:18:05.812824 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8085581-36cd-4a7f-b6d8-60c465ee082e service nova] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:18:05.813095 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8085581-36cd-4a7f-b6d8-60c465ee082e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:18:05.821537 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8085581-36cd-4a7f-b6d8-60c465ee082e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:18:05.823111 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8085581-36cd-4a7f-b6d8-60c465ee082e service nova] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:18:05.832234 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 716/1440] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:18:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:18:07.927697 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d17322-31e1-424e-8324-1004f9aff8bd None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:18:07.928793 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d17322-31e1-424e-8324-1004f9aff8bd None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:18:07.929089 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d17322-31e1-424e-8324-1004f9aff8bd None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:18:07.930538 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 725/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 9 20:18:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:18:07.936203 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d48311-2f93-4c3a-a158-bfae5510b3b7 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:18:07.936590 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d48311-2f93-4c3a-a158-bfae5510b3b7 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:18:07.936698 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d48311-2f93-4c3a-a158-bfae5510b3b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:18:07.953896 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-b5d48311-2f93-4c3a-a158-bfae5510b3b7 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:18:07.955083 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-b5d48311-2f93-4c3a-a158-bfae5510b3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:18:07.963318 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 717/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 9 20:18:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:18:08.001048 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d17322-31e1-424e-8324-1004f9aff8bd None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:18:08.011445 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d17322-31e1-424e-8324-1004f9aff8bd None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:18:08.015149 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8007f060-94f5-42d2-a9bc-34432590c1bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:18:08.015811 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8007f060-94f5-42d2-a9bc-34432590c1bd service neutron] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:18:08.016092 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8007f060-94f5-42d2-a9bc-34432590c1bd service neutron] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:18:08.016364 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8007f060-94f5-42d2-a9bc-34432590c1bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:18:08.025464 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8007f060-94f5-42d2-a9bc-34432590c1bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:18:08.026906 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8007f060-94f5-42d2-a9bc-34432590c1bd service neutron] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:18:08.036124 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 726/1443] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:18:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:18:10.400016 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a7780-35ef-4b9e-aea8-4905a7180a42 None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:18:10.400478 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a7780-35ef-4b9e-aea8-4905a7180a42 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:18:10.400599 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a7780-35ef-4b9e-aea8-4905a7180a42 None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:18:10.401920 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 718/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 9 20:18:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:18:10.407052 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c157d-b399-4375-acf9-f2ae59623f95 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:18:10.407511 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c157d-b399-4375-acf9-f2ae59623f95 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:18:10.407625 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c157d-b399-4375-acf9-f2ae59623f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:18:10.424856 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-c82c157d-b399-4375-acf9-f2ae59623f95 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:18:10.426020 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-c82c157d-b399-4375-acf9-f2ae59623f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:18:10.434208 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 727/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 9 20:18:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:18:10.470965 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656a7780-35ef-4b9e-aea8-4905a7180a42 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:18:10.481877 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656a7780-35ef-4b9e-aea8-4905a7180a42 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:18:10.485299 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23450ad9-eb40-44b3-af95-aac81044df2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:18:10.485913 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23450ad9-eb40-44b3-af95-aac81044df2d service neutron] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:18:10.486184 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23450ad9-eb40-44b3-af95-aac81044df2d service neutron] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:18:10.486450 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23450ad9-eb40-44b3-af95-aac81044df2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:18:10.494896 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23450ad9-eb40-44b3-af95-aac81044df2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:18:10.496329 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23450ad9-eb40-44b3-af95-aac81044df2d service neutron] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:18:10.505217 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 719/1446] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:18:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:18:13.010957 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aeaa0c-d16a-4603-b2f4-4655d98cc1d0 None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:18:13.011544 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aeaa0c-d16a-4603-b2f4-4655d98cc1d0 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:18:13.011544 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aeaa0c-d16a-4603-b2f4-4655d98cc1d0 None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:18:13.013189 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 728/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 9 20:18:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:18:13.018540 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ab5f53-eba6-49d5-b960-75f080e13e8b None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:18:13.018925 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ab5f53-eba6-49d5-b960-75f080e13e8b None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:18:13.019092 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ab5f53-eba6-49d5-b960-75f080e13e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:18:13.037962 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-35ab5f53-eba6-49d5-b960-75f080e13e8b None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:18:13.039152 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-35ab5f53-eba6-49d5-b960-75f080e13e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:18:13.046901 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 720/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 9 20:18:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:18:13.086831 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aeaa0c-d16a-4603-b2f4-4655d98cc1d0 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:18:13.088508 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-33aeaa0c-d16a-4603-b2f4-4655d98cc1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:18:13.100956 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aeaa0c-d16a-4603-b2f4-4655d98cc1d0 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:18:13.104368 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf4e4d0-d675-48f8-b9c8-c152b87c4610 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:18:13.104981 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf4e4d0-d675-48f8-b9c8-c152b87c4610 service neutron] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:18:13.105258 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf4e4d0-d675-48f8-b9c8-c152b87c4610 service neutron] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:18:13.105523 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf4e4d0-d675-48f8-b9c8-c152b87c4610 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:18:13.113965 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf4e4d0-d675-48f8-b9c8-c152b87c4610 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:18:13.115365 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf4e4d0-d675-48f8-b9c8-c152b87c4610 service neutron] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:18:13.124317 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 729/1449] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:18:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:18:15.454074 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b0a5c-8467-4978-9feb-eb235f6cca5e None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:18:15.454661 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b0a5c-8467-4978-9feb-eb235f6cca5e None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:18:15.454661 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b0a5c-8467-4978-9feb-eb235f6cca5e None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:18:15.456029 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 721/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 9 20:18:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:18:15.462618 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a52a7-8fd8-426d-8798-c5b4377bfc06 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:18:15.463069 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a52a7-8fd8-426d-8798-c5b4377bfc06 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:18:15.463170 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a52a7-8fd8-426d-8798-c5b4377bfc06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:18:15.480870 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-721a52a7-8fd8-426d-8798-c5b4377bfc06 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:18:15.482045 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-721a52a7-8fd8-426d-8798-c5b4377bfc06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:18:15.489683 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 730/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 9 20:18:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:18:15.526953 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84b0a5c-8467-4978-9feb-eb235f6cca5e None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:18:15.537886 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84b0a5c-8467-4978-9feb-eb235f6cca5e None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:18:15.541259 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eff6380-939e-4401-b1b0-91280bd98027 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:18:15.541870 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eff6380-939e-4401-b1b0-91280bd98027 service neutron] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:18:15.542140 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eff6380-939e-4401-b1b0-91280bd98027 service neutron] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:18:15.542404 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eff6380-939e-4401-b1b0-91280bd98027 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:18:15.550833 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eff6380-939e-4401-b1b0-91280bd98027 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:18:15.552283 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eff6380-939e-4401-b1b0-91280bd98027 service neutron] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:18:15.561197 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 722/1452] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:18:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:18:17.820528 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff97127-79a3-4e46-9608-b96e95114c35 None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:18:17.821087 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff97127-79a3-4e46-9608-b96e95114c35 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:18:17.821194 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff97127-79a3-4e46-9608-b96e95114c35 None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:18:17.822521 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 731/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 9 20:18:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:18:17.827985 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ce7778-2b81-4c37-a085-aa92153e77d0 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:18:17.828464 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ce7778-2b81-4c37-a085-aa92153e77d0 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:18:17.828572 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ce7778-2b81-4c37-a085-aa92153e77d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:18:17.846574 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-c0ce7778-2b81-4c37-a085-aa92153e77d0 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:18:17.847724 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-c0ce7778-2b81-4c37-a085-aa92153e77d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:18:17.855910 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 723/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 9 20:18:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:18:17.893347 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff97127-79a3-4e46-9608-b96e95114c35 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:18:17.904371 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff97127-79a3-4e46-9608-b96e95114c35 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:18:17.907819 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab23585c-0ff1-400a-a963-99c04efbbf3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:18:17.908441 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab23585c-0ff1-400a-a963-99c04efbbf3f service neutron] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:18:17.908722 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab23585c-0ff1-400a-a963-99c04efbbf3f service neutron] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:18:17.908995 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab23585c-0ff1-400a-a963-99c04efbbf3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:18:17.918276 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab23585c-0ff1-400a-a963-99c04efbbf3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:18:17.919731 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab23585c-0ff1-400a-a963-99c04efbbf3f service neutron] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:18:17.929627 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 732/1455] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:18:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:18:20.188713 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed97839-3ebd-48f5-b1f0-be8e16828d39 None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:18:20.189282 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed97839-3ebd-48f5-b1f0-be8e16828d39 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:18:20.189282 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed97839-3ebd-48f5-b1f0-be8e16828d39 None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:18:20.190694 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 724/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 9 20:18:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:18:20.196654 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4012d8a8-8fb4-4d65-8d20-c4fb861ea978 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:18:20.197085 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4012d8a8-8fb4-4d65-8d20-c4fb861ea978 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:18:20.197188 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4012d8a8-8fb4-4d65-8d20-c4fb861ea978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:18:20.215989 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-4012d8a8-8fb4-4d65-8d20-c4fb861ea978 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:18:20.217171 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-4012d8a8-8fb4-4d65-8d20-c4fb861ea978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:18:20.225140 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 733/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 9 20:18:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:18:20.263173 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed97839-3ebd-48f5-b1f0-be8e16828d39 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:18:20.273695 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed97839-3ebd-48f5-b1f0-be8e16828d39 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:18:20.277166 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5915e02-f95b-4acc-beb2-3c4ac23e6a55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:18:20.277790 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5915e02-f95b-4acc-beb2-3c4ac23e6a55 service neutron] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:18:20.278069 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5915e02-f95b-4acc-beb2-3c4ac23e6a55 service neutron] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:18:20.278339 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5915e02-f95b-4acc-beb2-3c4ac23e6a55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:18:20.287455 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5915e02-f95b-4acc-beb2-3c4ac23e6a55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:18:20.289035 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5915e02-f95b-4acc-beb2-3c4ac23e6a55 service neutron] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:18:20.298014 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 725/1458] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:18:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 09 20:18:22.549699 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd9352-5b78-4d1e-bd4c-69887abd4487 None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:18:22.550310 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd9352-5b78-4d1e-bd4c-69887abd4487 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:18:22.550310 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd9352-5b78-4d1e-bd4c-69887abd4487 None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:18:22.551657 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 734/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 9 20:18:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:18:22.557175 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f939da60-e02d-426b-b239-800ae306a7de None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:18:22.557651 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f939da60-e02d-426b-b239-800ae306a7de None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:18:22.557762 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f939da60-e02d-426b-b239-800ae306a7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:18:22.575656 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-f939da60-e02d-426b-b239-800ae306a7de None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:18:22.576845 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-f939da60-e02d-426b-b239-800ae306a7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:18:22.587914 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 726/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 9 20:18:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:18:22.621389 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dd9352-5b78-4d1e-bd4c-69887abd4487 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:18:22.632431 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dd9352-5b78-4d1e-bd4c-69887abd4487 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:18:22.635858 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7da005-ac5c-4597-a76f-2ad96792621a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:18:22.636474 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7da005-ac5c-4597-a76f-2ad96792621a service neutron] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:18:22.636747 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7da005-ac5c-4597-a76f-2ad96792621a service neutron] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:18:22.637274 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7da005-ac5c-4597-a76f-2ad96792621a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:18:22.645655 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7da005-ac5c-4597-a76f-2ad96792621a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:18:22.647852 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7da005-ac5c-4597-a76f-2ad96792621a service neutron] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:18:22.656743 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 735/1461] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:18:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:18:24.898316 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f26bc6-1937-48cf-804f-5aac9d667756 None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:18:24.898871 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f26bc6-1937-48cf-804f-5aac9d667756 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:18:24.898871 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f26bc6-1937-48cf-804f-5aac9d667756 None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:18:24.900148 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 727/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 9 20:18:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:18:24.905298 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6df2f95-8e69-425b-86ad-ef4456c2a2a8 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:18:24.905707 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6df2f95-8e69-425b-86ad-ef4456c2a2a8 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:18:24.905842 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6df2f95-8e69-425b-86ad-ef4456c2a2a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:18:24.922972 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-d6df2f95-8e69-425b-86ad-ef4456c2a2a8 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:18:24.924179 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-d6df2f95-8e69-425b-86ad-ef4456c2a2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:18:24.931757 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 736/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 9 20:18:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:18:24.969546 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f26bc6-1937-48cf-804f-5aac9d667756 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:18:24.980250 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f26bc6-1937-48cf-804f-5aac9d667756 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:18:24.983688 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b9da06-8b14-4123-a6c5-7c67591c1fa5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:18:24.984306 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b9da06-8b14-4123-a6c5-7c67591c1fa5 service neutron] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:18:24.984578 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b9da06-8b14-4123-a6c5-7c67591c1fa5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:18:24.984844 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b9da06-8b14-4123-a6c5-7c67591c1fa5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:18:24.993601 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b9da06-8b14-4123-a6c5-7c67591c1fa5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:18:24.995013 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b9da06-8b14-4123-a6c5-7c67591c1fa5 service neutron] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:18:25.004234 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 728/1464] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:18:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:18:27.247991 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a835df04-a1ab-48b8-b9a2-ed98faa8d285 None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:18:27.248534 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a835df04-a1ab-48b8-b9a2-ed98faa8d285 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:18:27.248658 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a835df04-a1ab-48b8-b9a2-ed98faa8d285 None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:18:27.249997 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 737/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 9 20:18:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:18:27.255161 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b423613-d16f-4a7b-a7f9-1c2aee77fab4 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:18:27.256421 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b423613-d16f-4a7b-a7f9-1c2aee77fab4 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:18:27.256711 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b423613-d16f-4a7b-a7f9-1c2aee77fab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:18:27.274991 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-8b423613-d16f-4a7b-a7f9-1c2aee77fab4 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:18:27.276211 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-8b423613-d16f-4a7b-a7f9-1c2aee77fab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:18:27.283989 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 729/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 9 20:18:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:18:27.319968 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a835df04-a1ab-48b8-b9a2-ed98faa8d285 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:18:27.330187 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a835df04-a1ab-48b8-b9a2-ed98faa8d285 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:18:27.334595 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7bb393-74ad-42fa-aa02-7d6c31ae9fbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:18:27.335216 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7bb393-74ad-42fa-aa02-7d6c31ae9fbf service neutron] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:18:27.335525 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7bb393-74ad-42fa-aa02-7d6c31ae9fbf service neutron] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:18:27.335796 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7bb393-74ad-42fa-aa02-7d6c31ae9fbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:18:27.344437 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7bb393-74ad-42fa-aa02-7d6c31ae9fbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:18:27.345833 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7bb393-74ad-42fa-aa02-7d6c31ae9fbf service neutron] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:18:27.354908 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 738/1467] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:18:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 09 20:18:29.595985 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5428f214-bcb1-49ea-a7ea-587a4559f636 None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:18:29.596469 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5428f214-bcb1-49ea-a7ea-587a4559f636 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:18:29.596564 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5428f214-bcb1-49ea-a7ea-587a4559f636 None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:18:29.597897 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 730/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 9 20:18:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:18:29.603841 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd68866f-a383-47f8-9ed6-c52845d4ef9a None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:18:29.604277 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd68866f-a383-47f8-9ed6-c52845d4ef9a None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:18:29.604382 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd68866f-a383-47f8-9ed6-c52845d4ef9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:18:29.621353 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-dd68866f-a383-47f8-9ed6-c52845d4ef9a None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:18:29.622514 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-dd68866f-a383-47f8-9ed6-c52845d4ef9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:18:29.630115 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 739/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 9 20:18:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:18:29.667170 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5428f214-bcb1-49ea-a7ea-587a4559f636 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:18:29.677532 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5428f214-bcb1-49ea-a7ea-587a4559f636 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:18:29.681028 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea7f1f8-383e-461d-970e-1c7998c9a038 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:18:29.681650 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea7f1f8-383e-461d-970e-1c7998c9a038 service neutron] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:18:29.681929 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea7f1f8-383e-461d-970e-1c7998c9a038 service neutron] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:18:29.682200 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea7f1f8-383e-461d-970e-1c7998c9a038 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:18:29.690783 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea7f1f8-383e-461d-970e-1c7998c9a038 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:18:29.692235 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea7f1f8-383e-461d-970e-1c7998c9a038 service neutron] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:18:29.701835 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 731/1470] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:18:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:19:02.781859 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e89a475-4772-4952-8bdd-5f4c96de94fb None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:19:02.782447 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e89a475-4772-4952-8bdd-5f4c96de94fb None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:19:02.782447 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e89a475-4772-4952-8bdd-5f4c96de94fb None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:19:02.783793 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 740/1471] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:19:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:19:02.789695 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4464e-8230-47a6-9776-fb2e46eee7ae None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:19:02.790105 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4464e-8230-47a6-9776-fb2e46eee7ae None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:19:02.790237 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4464e-8230-47a6-9776-fb2e46eee7ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:19:02.807885 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-25f4464e-8230-47a6-9776-fb2e46eee7ae None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:19:02.809054 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-25f4464e-8230-47a6-9776-fb2e46eee7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:19:02.816597 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 732/1472] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:19:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:19:02.861585 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f941b5-465f-4ea5-ad4e-ef9f4f96d5c6 None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:19:02.861868 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f941b5-465f-4ea5-ad4e-ef9f4f96d5c6 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:19:02.862143 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f941b5-465f-4ea5-ad4e-ef9f4f96d5c6 None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:19:02.863506 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 741/1473] 10.222.0.44 () {54 vars in 962 bytes} [Mon May 9 20:19:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 20:19:02.868969 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c5f40-b57c-4930-b5b5-47cc48d20113 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:19:02.869249 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c5f40-b57c-4930-b5b5-47cc48d20113 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:19:02.869516 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c5f40-b57c-4930-b5b5-47cc48d20113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:19:02.886649 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-ce8c5f40-b57c-4930-b5b5-47cc48d20113 None None] MFA Rules not processed for user `65db5d9a86fd48acb5874df0165c0ef9`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:19:02.888089 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-ce8c5f40-b57c-4930-b5b5-47cc48d20113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:19:02.894241 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 733/1474] 10.222.0.44 () {58 vars in 1059 bytes} [Mon May 9 20:19:02 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 26 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:19:02.901575 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f941b5-465f-4ea5-ad4e-ef9f4f96d5c6 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:19:02.912484 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f941b5-465f-4ea5-ad4e-ef9f4f96d5c6 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:19:02.915936 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a50e83e-8162-4039-81e0-10ae9326d862 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65db5d9a86fd48acb5874df0165c0ef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:19:02.916554 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a50e83e-8162-4039-81e0-10ae9326d862 service glance] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:19:02.916830 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a50e83e-8162-4039-81e0-10ae9326d862 service glance] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:19:02.917102 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a50e83e-8162-4039-81e0-10ae9326d862 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:19:02.925683 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a50e83e-8162-4039-81e0-10ae9326d862 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:19:02.927927 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a50e83e-8162-4039-81e0-10ae9326d862 service glance] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:19:02.936941 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 742/1475] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:19:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:19:05.239384 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0245c92-e368-4c37-a1c3-c7c4d15e8d95 None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:19:05.240155 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0245c92-e368-4c37-a1c3-c7c4d15e8d95 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:19:05.240155 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0245c92-e368-4c37-a1c3-c7c4d15e8d95 None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:19:05.241320 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 734/1476] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:19:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:19:05.246435 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56130f3-e863-4baa-962d-8b08a361727e None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:19:05.246854 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56130f3-e863-4baa-962d-8b08a361727e None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:19:05.247021 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56130f3-e863-4baa-962d-8b08a361727e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:19:05.264399 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-f56130f3-e863-4baa-962d-8b08a361727e None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:19:05.265586 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-f56130f3-e863-4baa-962d-8b08a361727e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:19:05.273458 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 743/1477] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:19:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:19:05.296626 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0245c92-e368-4c37-a1c3-c7c4d15e8d95 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:19:05.310142 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0245c92-e368-4c37-a1c3-c7c4d15e8d95 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:19:05.314824 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d3d0c1-088b-4bee-bbdb-d78e646d344a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:19:05.315501 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3d0c1-088b-4bee-bbdb-d78e646d344a admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:19:05.315784 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3d0c1-088b-4bee-bbdb-d78e646d344a admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:19:05.316158 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3d0c1-088b-4bee-bbdb-d78e646d344a admin admin] PATH_INFO: `/v3/projects` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:19:05.316844 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d3d0c1-088b-4bee-bbdb-d78e646d344a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:19:05.318970 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: WARNING py.warnings [None req-b3d3d0c1-088b-4bee-bbdb-d78e646d344a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 09 20:19:05.318970 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: warnings.warn(msg) May 09 20:19:05.318970 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: May 09 20:19:05.320629 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d3d0c1-088b-4bee-bbdb-d78e646d344a admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:19:05.339581 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 735/1478] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 9 20:19:05 2022] GET /identity/v3/projects => generated 2553 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:19:07.580099 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055a1d3-8d7d-48b9-b594-8d63c0f9676e None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:19:07.580099 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055a1d3-8d7d-48b9-b594-8d63c0f9676e None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:19:07.580556 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055a1d3-8d7d-48b9-b594-8d63c0f9676e None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:19:07.581543 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 744/1479] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:19:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:19:07.587329 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8a069-846c-46a5-8acd-f3a9b3199fa7 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:19:07.587851 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8a069-846c-46a5-8acd-f3a9b3199fa7 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:19:07.587968 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8a069-846c-46a5-8acd-f3a9b3199fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:19:07.606439 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-a7e8a069-846c-46a5-8acd-f3a9b3199fa7 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:19:07.607658 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-a7e8a069-846c-46a5-8acd-f3a9b3199fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:19:07.617398 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 736/1480] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:19:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:19:07.659277 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8055a1d3-8d7d-48b9-b594-8d63c0f9676e None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:19:07.674538 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8055a1d3-8d7d-48b9-b594-8d63c0f9676e None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:19:07.681350 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86fb602-abf9-4e33-8992-e015bb139e3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb59440b21074d9da15679dc2d745f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:19:07.682207 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86fb602-abf9-4e33-8992-e015bb139e3d service nova] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:19:07.682686 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86fb602-abf9-4e33-8992-e015bb139e3d service nova] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:19:07.682970 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86fb602-abf9-4e33-8992-e015bb139e3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:19:07.692730 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86fb602-abf9-4e33-8992-e015bb139e3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:19:07.694316 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86fb602-abf9-4e33-8992-e015bb139e3d service nova] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:19:07.703610 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 745/1481] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:19:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:19:10.093014 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969427c4-8565-49ce-9fd4-afabeaab1435 None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:19:10.093596 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969427c4-8565-49ce-9fd4-afabeaab1435 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:19:10.093596 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969427c4-8565-49ce-9fd4-afabeaab1435 None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:19:10.094880 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 737/1482] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:19:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:19:10.100759 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8386c82-0e19-4750-8ff5-ce3fd5d87a14 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:19:10.101171 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8386c82-0e19-4750-8ff5-ce3fd5d87a14 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:19:10.101284 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8386c82-0e19-4750-8ff5-ce3fd5d87a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:19:10.118384 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-b8386c82-0e19-4750-8ff5-ce3fd5d87a14 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:19:10.119590 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-b8386c82-0e19-4750-8ff5-ce3fd5d87a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:19:10.127188 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 746/1483] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:19:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:19:10.163905 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969427c4-8565-49ce-9fd4-afabeaab1435 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:19:10.174300 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969427c4-8565-49ce-9fd4-afabeaab1435 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:19:10.177895 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8f4dd9-4c62-41cf-a119-b762c1f72f22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:19:10.178514 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f4dd9-4c62-41cf-a119-b762c1f72f22 service neutron] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:19:10.178792 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f4dd9-4c62-41cf-a119-b762c1f72f22 service neutron] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:19:10.179060 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f4dd9-4c62-41cf-a119-b762c1f72f22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:19:10.188090 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8f4dd9-4c62-41cf-a119-b762c1f72f22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:19:10.189515 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8f4dd9-4c62-41cf-a119-b762c1f72f22 service neutron] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:19:10.199183 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 738/1484] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:19:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:19:12.595477 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12acec33-1083-4107-b164-490270dd5c40 None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:19:12.595913 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12acec33-1083-4107-b164-490270dd5c40 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:19:12.596041 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12acec33-1083-4107-b164-490270dd5c40 None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:19:12.597423 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 747/1485] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:19:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:19:12.602887 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428e69a-bdc0-4559-8aaa-bb11db56a415 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:19:12.603289 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428e69a-bdc0-4559-8aaa-bb11db56a415 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:19:12.603457 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428e69a-bdc0-4559-8aaa-bb11db56a415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:19:12.621433 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-c428e69a-bdc0-4559-8aaa-bb11db56a415 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:19:12.622626 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-c428e69a-bdc0-4559-8aaa-bb11db56a415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:19:12.631037 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 739/1486] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:19:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:19:12.668532 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12acec33-1083-4107-b164-490270dd5c40 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:19:12.678760 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12acec33-1083-4107-b164-490270dd5c40 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:19:12.682192 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b44e20-e569-45b4-bd1f-14167633ac09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:19:12.682810 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b44e20-e569-45b4-bd1f-14167633ac09 service neutron] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:19:12.683085 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b44e20-e569-45b4-bd1f-14167633ac09 service neutron] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:19:12.683350 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b44e20-e569-45b4-bd1f-14167633ac09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:19:12.692363 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b44e20-e569-45b4-bd1f-14167633ac09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:19:12.693759 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b44e20-e569-45b4-bd1f-14167633ac09 service neutron] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:19:12.702644 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 748/1487] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:19:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:19:14.990615 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52388018-8d43-4ce5-820a-c986aa9b209b None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:19:14.991199 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52388018-8d43-4ce5-820a-c986aa9b209b None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:19:14.991199 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52388018-8d43-4ce5-820a-c986aa9b209b None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:19:14.992547 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 740/1488] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:19:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:19:14.997848 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77db355-d9ed-4995-bedd-0523d3af3281 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:19:14.998279 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77db355-d9ed-4995-bedd-0523d3af3281 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:19:14.998384 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77db355-d9ed-4995-bedd-0523d3af3281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:19:15.015665 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-f77db355-d9ed-4995-bedd-0523d3af3281 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:19:15.016835 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-f77db355-d9ed-4995-bedd-0523d3af3281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:19:15.024607 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 749/1489] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:19:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:19:15.064042 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52388018-8d43-4ce5-820a-c986aa9b209b None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:19:15.074504 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52388018-8d43-4ce5-820a-c986aa9b209b None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:19:15.078078 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd8f844-022f-449c-b183-647650ab4c6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:19:15.078731 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8f844-022f-449c-b183-647650ab4c6f service neutron] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:19:15.079012 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8f844-022f-449c-b183-647650ab4c6f service neutron] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:19:15.079284 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8f844-022f-449c-b183-647650ab4c6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:19:15.088156 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd8f844-022f-449c-b183-647650ab4c6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:19:15.089578 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd8f844-022f-449c-b183-647650ab4c6f service neutron] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:19:15.099204 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 741/1490] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:19:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:19:17.524424 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4de2ad-79fc-40c0-bcb9-394098db0998 None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:19:17.525039 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4de2ad-79fc-40c0-bcb9-394098db0998 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:19:17.525039 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4de2ad-79fc-40c0-bcb9-394098db0998 None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:19:17.526333 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 750/1491] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 9 20:19:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:19:17.531510 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d4cdd0-e6c2-4536-ad82-690c48d196e4 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:19:17.531934 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d4cdd0-e6c2-4536-ad82-690c48d196e4 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:19:17.532039 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d4cdd0-e6c2-4536-ad82-690c48d196e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:19:17.549807 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-e2d4cdd0-e6c2-4536-ad82-690c48d196e4 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:19:17.551182 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-e2d4cdd0-e6c2-4536-ad82-690c48d196e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:19:17.558794 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 742/1492] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 9 20:19:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:19:17.597013 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4de2ad-79fc-40c0-bcb9-394098db0998 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:19:17.608023 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4de2ad-79fc-40c0-bcb9-394098db0998 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:19:17.611525 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b1771d-7a01-4b45-ab79-d55c1dc957e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:19:17.612150 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b1771d-7a01-4b45-ab79-d55c1dc957e6 service neutron] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:19:17.612430 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b1771d-7a01-4b45-ab79-d55c1dc957e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:19:17.612698 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b1771d-7a01-4b45-ab79-d55c1dc957e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:19:17.621279 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b1771d-7a01-4b45-ab79-d55c1dc957e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:19:17.622726 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b1771d-7a01-4b45-ab79-d55c1dc957e6 service neutron] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:19:17.632018 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 751/1493] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:19:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:20:45.045075 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20527614-4f32-4f31-8e5f-ee69ee696c31 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:20:45.045693 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20527614-4f32-4f31-8e5f-ee69ee696c31 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:20:45.045693 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20527614-4f32-4f31-8e5f-ee69ee696c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:20:45.063518 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-20527614-4f32-4f31-8e5f-ee69ee696c31 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:20:45.064735 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-20527614-4f32-4f31-8e5f-ee69ee696c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:20:45.072881 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 743/1494] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:20:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:20:45.082164 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd6cf4-588c-4450-88fd-cc31a296ec85 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:20:45.082693 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd6cf4-588c-4450-88fd-cc31a296ec85 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:20:45.082693 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd6cf4-588c-4450-88fd-cc31a296ec85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:20:45.100314 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-e1bd6cf4-588c-4450-88fd-cc31a296ec85 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:20:45.101471 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-e1bd6cf4-588c-4450-88fd-cc31a296ec85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:20:45.108913 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 752/1495] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:20:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:20:45.113974 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20527614-4f32-4f31-8e5f-ee69ee696c31 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:20:45.123462 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20527614-4f32-4f31-8e5f-ee69ee696c31 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:20:45.127962 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9feee24-fb2d-47db-ac5b-855f24accc05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:20:45.128597 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9feee24-fb2d-47db-ac5b-855f24accc05 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:20:45.128876 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9feee24-fb2d-47db-ac5b-855f24accc05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:20:45.129147 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9feee24-fb2d-47db-ac5b-855f24accc05 admin admin] PATH_INFO: `/v3/domains` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:20:45.129856 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9feee24-fb2d-47db-ac5b-855f24accc05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:20:45.130154 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9feee24-fb2d-47db-ac5b-855f24accc05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:20:45.131165 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: WARNING py.warnings [None req-d9feee24-fb2d-47db-ac5b-855f24accc05 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 09 20:20:45.131165 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: warnings.warn(msg) May 09 20:20:45.131165 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: May 09 20:20:45.132082 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9feee24-fb2d-47db-ac5b-855f24accc05 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:20:45.143704 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 744/1496] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 9 20:20:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:20:45.151675 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bd6cf4-588c-4450-88fd-cc31a296ec85 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:20:45.161040 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bd6cf4-588c-4450-88fd-cc31a296ec85 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:20:45.165654 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a6299e-7928-406a-b1d2-fa683492dcf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:20:45.166293 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a6299e-7928-406a-b1d2-fa683492dcf8 admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:20:45.166601 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a6299e-7928-406a-b1d2-fa683492dcf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:20:45.166871 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a6299e-7928-406a-b1d2-fa683492dcf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:20:45.167595 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a6299e-7928-406a-b1d2-fa683492dcf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:20:45.169340 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: WARNING py.warnings [None req-59a6299e-7928-406a-b1d2-fa683492dcf8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 09 20:20:45.169340 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: warnings.warn(msg) May 09 20:20:45.169340 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: May 09 20:20:45.170524 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a6299e-7928-406a-b1d2-fa683492dcf8 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:20:45.203670 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 753/1497] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:20:45 2022] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:20:45.208481 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9feee24-fb2d-47db-ac5b-855f24accc05 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:20:45.218071 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9feee24-fb2d-47db-ac5b-855f24accc05 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:20:45.271301 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29fbce3-324c-46e3-8503-bff6fa1fb757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:20:45.271982 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29fbce3-324c-46e3-8503-bff6fa1fb757 admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:20:45.272261 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29fbce3-324c-46e3-8503-bff6fa1fb757 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:20:45.272533 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29fbce3-324c-46e3-8503-bff6fa1fb757 admin admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:20:45.273241 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29fbce3-324c-46e3-8503-bff6fa1fb757 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:20:45.274264 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: WARNING py.warnings [None req-b29fbce3-324c-46e3-8503-bff6fa1fb757 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 09 20:20:45.274264 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: warnings.warn(msg) May 09 20:20:45.274264 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: May 09 20:20:45.275489 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29fbce3-324c-46e3-8503-bff6fa1fb757 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:20:45.294502 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 745/1498] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:20:45 2022] POST /identity/v3/users => generated 290 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 20:20:45.298817 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a6299e-7928-406a-b1d2-fa683492dcf8 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:20:45.308708 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a6299e-7928-406a-b1d2-fa683492dcf8 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:20:45.313179 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9191798b-e4cc-45d6-98b4-ab4a3685f3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:20:45.313815 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9191798b-e4cc-45d6-98b4-ab4a3685f3a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:20:45.314093 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9191798b-e4cc-45d6-98b4-ab4a3685f3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:20:45.314377 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9191798b-e4cc-45d6-98b4-ab4a3685f3a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:20:45.315069 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9191798b-e4cc-45d6-98b4-ab4a3685f3a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:20:45.316207 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: WARNING py.warnings [None req-9191798b-e4cc-45d6-98b4-ab4a3685f3a2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 09 20:20:45.316207 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: warnings.warn(msg) May 09 20:20:45.316207 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: May 09 20:20:45.317075 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9191798b-e4cc-45d6-98b4-ab4a3685f3a2 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:20:45.330018 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 754/1499] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:20:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:20:45.334389 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29fbce3-324c-46e3-8503-bff6fa1fb757 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:20:45.343988 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29fbce3-324c-46e3-8503-bff6fa1fb757 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:20:45.349740 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78d7321-a1b7-4fb3-861e-6b9a93f13089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:20:45.350387 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d7321-a1b7-4fb3-861e-6b9a93f13089 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:20:45.350668 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d7321-a1b7-4fb3-861e-6b9a93f13089 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:20:45.350941 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d7321-a1b7-4fb3-861e-6b9a93f13089 admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:20:45.351697 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78d7321-a1b7-4fb3-861e-6b9a93f13089 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:20:45.352711 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: WARNING py.warnings [None req-e78d7321-a1b7-4fb3-861e-6b9a93f13089 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 09 20:20:45.352711 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: warnings.warn(msg) May 09 20:20:45.352711 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: May 09 20:20:45.353586 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78d7321-a1b7-4fb3-861e-6b9a93f13089 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:20:45.367175 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 746/1500] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:20:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:20:45.371261 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9191798b-e4cc-45d6-98b4-ab4a3685f3a2 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:20:45.380791 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9191798b-e4cc-45d6-98b4-ab4a3685f3a2 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:20:45.385221 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f041730-d894-4efd-8837-b59e1291d1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:20:45.386084 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f041730-d894-4efd-8837-b59e1291d1ca admin admin] REQUEST_METHOD: `PUT` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:20:45.386365 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f041730-d894-4efd-8837-b59e1291d1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:20:45.386637 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f041730-d894-4efd-8837-b59e1291d1ca admin admin] PATH_INFO: `/v3/projects/c39041d93e3e47008483858a17b84659/users/523d15bf700942f9ace245b22e51b80d/roles/79f90a0bf6ea43d0b3c434e31556253a` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:20:45.401543 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f041730-d894-4efd-8837-b59e1291d1ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=c39041d93e3e47008483858a17b84659, user_id=523d15bf700942f9ace245b22e51b80d, role_id=79f90a0bf6ea43d0b3c434e31556253a)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:20:45.402568 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: WARNING py.warnings [None req-2f041730-d894-4efd-8837-b59e1291d1ca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 09 20:20:45.402568 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: warnings.warn(msg) May 09 20:20:45.402568 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: May 09 20:20:45.404519 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f041730-d894-4efd-8837-b59e1291d1ca admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:20:45.417514 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 755/1501] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:20:45 2022] PUT /identity/v3/projects/c39041d93e3e47008483858a17b84659/users/523d15bf700942f9ace245b22e51b80d/roles/79f90a0bf6ea43d0b3c434e31556253a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:20:45.428747 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e98c44e-7ce7-45a7-9017-835fa4e10471 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:20:45.429038 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e98c44e-7ce7-45a7-9017-835fa4e10471 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:20:45.429342 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e98c44e-7ce7-45a7-9017-835fa4e10471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:20:45.455057 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-7e98c44e-7ce7-45a7-9017-835fa4e10471 None None] MFA Rules not processed for user `523d15bf700942f9ace245b22e51b80d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:20:45.456308 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-7e98c44e-7ce7-45a7-9017-835fa4e10471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:20:45.518506 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 747/1502] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:20:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:20:45.531708 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a3f59c-db5e-4608-9a1f-8b1547ff4ec1 None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:20:45.532002 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a3f59c-db5e-4608-9a1f-8b1547ff4ec1 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:20:45.532279 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a3f59c-db5e-4608-9a1f-8b1547ff4ec1 None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:20:45.533751 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 756/1503] 10.222.0.44 () {54 vars in 963 bytes} [Mon May 9 20:20:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:20:45.538580 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6e0768-8e3a-46b4-822b-eac97a49c2d0 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:20:45.538868 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6e0768-8e3a-46b4-822b-eac97a49c2d0 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:20:45.539139 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6e0768-8e3a-46b4-822b-eac97a49c2d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:20:45.556747 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-fd6e0768-8e3a-46b4-822b-eac97a49c2d0 None None] MFA Rules not processed for user `9d65e731386d44948dcc1ecd40cbda65`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:20:45.557849 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-fd6e0768-8e3a-46b4-822b-eac97a49c2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:20:45.606776 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 748/1504] 10.222.0.44 () {58 vars in 1060 bytes} [Mon May 9 20:20:45 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:20:45.614192 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a3f59c-db5e-4608-9a1f-8b1547ff4ec1 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:20:45.624650 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a3f59c-db5e-4608-9a1f-8b1547ff4ec1 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:20:45.628602 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd04c81-6a7d-4eb1-9f9b-0077f1ad74ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d65e731386d44948dcc1ecd40cbda65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:20:45.629217 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd04c81-6a7d-4eb1-9f9b-0077f1ad74ef service cinder] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:20:45.629492 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd04c81-6a7d-4eb1-9f9b-0077f1ad74ef service cinder] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:20:45.629759 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd04c81-6a7d-4eb1-9f9b-0077f1ad74ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:20:45.637959 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd04c81-6a7d-4eb1-9f9b-0077f1ad74ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:20:45.639362 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd04c81-6a7d-4eb1-9f9b-0077f1ad74ef service cinder] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:20:45.648119 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 757/1505] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:20:45 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 09 20:20:45.691027 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816ccab-47af-4cb9-a4a9-2f56141ccbed None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:20:45.691334 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816ccab-47af-4cb9-a4a9-2f56141ccbed None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:20:45.691623 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816ccab-47af-4cb9-a4a9-2f56141ccbed None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:20:45.692915 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 749/1506] 10.222.0.44 () {52 vars in 829 bytes} [Mon May 9 20:20:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 20:20:45.696563 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd04c81-6a7d-4eb1-9f9b-0077f1ad74ef service cinder] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:20:45.755248 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd04c81-6a7d-4eb1-9f9b-0077f1ad74ef service cinder] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:20:45.759700 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a47bdb8-8dc0-4574-9e77-8c782580b09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:20:45.760549 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a47bdb8-8dc0-4574-9e77-8c782580b09f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:20:45.760828 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a47bdb8-8dc0-4574-9e77-8c782580b09f admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:20:45.761123 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a47bdb8-8dc0-4574-9e77-8c782580b09f admin admin] PATH_INFO: `/v3/users/523d15bf700942f9ace245b22e51b80d` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:20:45.762532 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a47bdb8-8dc0-4574-9e77-8c782580b09f admin admin] RBAC: Authorizing `identity:delete_user(user_id=523d15bf700942f9ace245b22e51b80d)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:20:45.763576 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: WARNING py.warnings [None req-3a47bdb8-8dc0-4574-9e77-8c782580b09f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 09 20:20:45.763576 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: warnings.warn(msg) May 09 20:20:45.763576 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: May 09 20:20:45.764778 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a47bdb8-8dc0-4574-9e77-8c782580b09f admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:20:45.828682 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-3a47bdb8-8dc0-4574-9e77-8c782580b09f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '523d15bf700942f9ace245b22e51b80d'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:20:45.829242 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-3a47bdb8-8dc0-4574-9e77-8c782580b09f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '523d15bf700942f9ace245b22e51b80d'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:20:45.842376 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-3a47bdb8-8dc0-4574-9e77-8c782580b09f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '523d15bf700942f9ace245b22e51b80d'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:20:45.843113 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-3a47bdb8-8dc0-4574-9e77-8c782580b09f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '523d15bf700942f9ace245b22e51b80d'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:20:45.853684 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-3a47bdb8-8dc0-4574-9e77-8c782580b09f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '523d15bf700942f9ace245b22e51b80d'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:20:45.877201 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 758/1507] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:20:45 2022] DELETE /identity/v3/users/523d15bf700942f9ace245b22e51b80d => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:20:45.881723 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce4bd3-42af-45c1-9406-784460523485 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:20:45.882001 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce4bd3-42af-45c1-9406-784460523485 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:20:45.882270 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce4bd3-42af-45c1-9406-784460523485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:20:45.899904 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-71ce4bd3-42af-45c1-9406-784460523485 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:20:45.901092 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-71ce4bd3-42af-45c1-9406-784460523485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:20:45.956578 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 750/1508] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:20:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:20:45.965972 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a47bdb8-8dc0-4574-9e77-8c782580b09f admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:20:45.967505 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-3a47bdb8-8dc0-4574-9e77-8c782580b09f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:20:46.022617 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a47bdb8-8dc0-4574-9e77-8c782580b09f admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:20:46.026171 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab1f4a-71af-41ad-bbdb-68054782d88f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:20:46.026804 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab1f4a-71af-41ad-bbdb-68054782d88f service neutron] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:20:46.027087 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab1f4a-71af-41ad-bbdb-68054782d88f service neutron] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:20:46.027358 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab1f4a-71af-41ad-bbdb-68054782d88f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:20:46.036717 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ab1f4a-71af-41ad-bbdb-68054782d88f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:20:46.038148 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ab1f4a-71af-41ad-bbdb-68054782d88f service neutron] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:20:46.047218 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 759/1509] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:20:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:20:46.364858 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ce4bd3-42af-45c1-9406-784460523485 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:20:46.366473 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-71ce4bd3-42af-45c1-9406-784460523485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:20:46.385485 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ce4bd3-42af-45c1-9406-784460523485 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:20:46.390999 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08717471-4dd7-4d36-987f-eb7d6295155d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:20:46.392769 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08717471-4dd7-4d36-987f-eb7d6295155d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:20:46.393584 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08717471-4dd7-4d36-987f-eb7d6295155d admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:20:46.393856 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08717471-4dd7-4d36-987f-eb7d6295155d admin admin] PATH_INFO: `/v3/projects/c39041d93e3e47008483858a17b84659` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:20:46.395059 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08717471-4dd7-4d36-987f-eb7d6295155d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c39041d93e3e47008483858a17b84659)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:20:46.396133 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: WARNING py.warnings [None req-08717471-4dd7-4d36-987f-eb7d6295155d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 09 20:20:46.396133 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: warnings.warn(msg) May 09 20:20:46.396133 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: May 09 20:20:46.397331 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08717471-4dd7-4d36-987f-eb7d6295155d admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:20:46.456431 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-08717471-4dd7-4d36-987f-eb7d6295155d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c39041d93e3e47008483858a17b84659', 'request_id': 'req-08717471-4dd7-4d36-987f-eb7d6295155d'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:20:46.473397 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-08717471-4dd7-4d36-987f-eb7d6295155d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c39041d93e3e47008483858a17b84659', 'request_id': 'req-08717471-4dd7-4d36-987f-eb7d6295155d'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:20:46.479349 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-08717471-4dd7-4d36-987f-eb7d6295155d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c39041d93e3e47008483858a17b84659', 'request_id': 'req-08717471-4dd7-4d36-987f-eb7d6295155d'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:20:46.494238 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-08717471-4dd7-4d36-987f-eb7d6295155d admin admin] The token cache is being invalidate because project c39041d93e3e47008483858a17b84659 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:20:46.494599 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-08717471-4dd7-4d36-987f-eb7d6295155d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:20:46.495225 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-08717471-4dd7-4d36-987f-eb7d6295155d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:20:46.496861 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 751/1510] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:20:46 2022] DELETE /identity/v3/projects/c39041d93e3e47008483858a17b84659 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:22:24.245929 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d30c74-6ee3-443f-a740-8e8b2f1853c2 None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:22:24.246529 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d30c74-6ee3-443f-a740-8e8b2f1853c2 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:22:24.246529 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d30c74-6ee3-443f-a740-8e8b2f1853c2 None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:22:24.247913 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 760/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 9 20:22:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:22:24.253527 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e42e2-01ac-4dd5-b1ef-26ea4ac14e64 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:22:24.253995 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e42e2-01ac-4dd5-b1ef-26ea4ac14e64 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:22:24.254104 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e42e2-01ac-4dd5-b1ef-26ea4ac14e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:22:24.272451 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-812e42e2-01ac-4dd5-b1ef-26ea4ac14e64 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:22:24.273628 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-812e42e2-01ac-4dd5-b1ef-26ea4ac14e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:22:24.329891 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 752/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 9 20:22:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:22:24.497214 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d30c74-6ee3-443f-a740-8e8b2f1853c2 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:22:24.499304 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-44d30c74-6ee3-443f-a740-8e8b2f1853c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:22:24.569927 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d30c74-6ee3-443f-a740-8e8b2f1853c2 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:22:24.575276 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a4b6c6-1ff1-4e71-ad66-107dd1f785b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb59440b21074d9da15679dc2d745f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:22:24.575953 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4b6c6-1ff1-4e71-ad66-107dd1f785b5 service nova] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:22:24.576233 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4b6c6-1ff1-4e71-ad66-107dd1f785b5 service nova] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:22:24.577112 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4b6c6-1ff1-4e71-ad66-107dd1f785b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:22:24.585648 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a4b6c6-1ff1-4e71-ad66-107dd1f785b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:22:24.587248 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a4b6c6-1ff1-4e71-ad66-107dd1f785b5 service nova] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:22:24.598352 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 761/1513] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:22:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:22:25.495640 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d277a7f3-1f0d-4030-b845-04f0a221a85a None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:22:25.496222 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d277a7f3-1f0d-4030-b845-04f0a221a85a None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:22:25.496222 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d277a7f3-1f0d-4030-b845-04f0a221a85a None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:22:25.497581 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 753/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 9 20:22:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:22:25.502955 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463527b0-41c5-4634-a28d-26ac19cc8209 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:22:25.503425 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463527b0-41c5-4634-a28d-26ac19cc8209 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:22:25.503602 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463527b0-41c5-4634-a28d-26ac19cc8209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:22:25.522081 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-463527b0-41c5-4634-a28d-26ac19cc8209 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:22:25.523260 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-463527b0-41c5-4634-a28d-26ac19cc8209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:22:25.530974 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 762/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 9 20:22:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:22:25.683122 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d277a7f3-1f0d-4030-b845-04f0a221a85a None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:22:25.697772 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d277a7f3-1f0d-4030-b845-04f0a221a85a None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:22:25.704232 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87d53e5-3e15-45dd-aaab-1181c3f465dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb59440b21074d9da15679dc2d745f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:22:25.704862 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d53e5-3e15-45dd-aaab-1181c3f465dd service nova] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:22:25.705136 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d53e5-3e15-45dd-aaab-1181c3f465dd service nova] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:22:25.705402 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d53e5-3e15-45dd-aaab-1181c3f465dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:22:25.713515 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87d53e5-3e15-45dd-aaab-1181c3f465dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:22:25.715111 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87d53e5-3e15-45dd-aaab-1181c3f465dd service nova] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:22:25.724876 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 754/1516] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:22:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:22:26.287530 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a0132d-bd78-4536-afc6-8c88b3cac79d None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:22:26.287813 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a0132d-bd78-4536-afc6-8c88b3cac79d None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:22:26.288087 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a0132d-bd78-4536-afc6-8c88b3cac79d None None] PATH_INFO: `/v3` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:22:26.289395 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 763/1517] 10.222.0.48 () {54 vars in 925 bytes} [Mon May 9 20:22:26 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:22:26.295469 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e8fe3-9949-419d-abec-50166a573545 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:22:26.295726 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e8fe3-9949-419d-abec-50166a573545 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:22:26.296005 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e8fe3-9949-419d-abec-50166a573545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:22:26.313581 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-476e8fe3-9949-419d-abec-50166a573545 None None] MFA Rules not processed for user `285198b50b50431f96f9225d106417a4`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:22:26.314928 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-476e8fe3-9949-419d-abec-50166a573545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:22:26.372955 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 755/1518] 10.222.0.48 () {58 vars in 1015 bytes} [Mon May 9 20:22:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:22:30.299967 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab2c251-4869-430f-b362-8b42127b57ef None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:22:30.300532 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab2c251-4869-430f-b362-8b42127b57ef None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:22:30.300532 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab2c251-4869-430f-b362-8b42127b57ef None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:22:30.301888 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 764/1519] 10.222.0.44 () {54 vars in 960 bytes} [Mon May 9 20:22:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:22:30.306934 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15b7ee-c76c-453f-9d73-69b3ed7b364f None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:22:30.307344 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15b7ee-c76c-453f-9d73-69b3ed7b364f None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:22:30.307532 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15b7ee-c76c-453f-9d73-69b3ed7b364f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:22:30.325311 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-6e15b7ee-c76c-453f-9d73-69b3ed7b364f None None] MFA Rules not processed for user `285198b50b50431f96f9225d106417a4`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:22:30.327095 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-6e15b7ee-c76c-453f-9d73-69b3ed7b364f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:22:30.335592 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 756/1520] 10.222.0.44 () {58 vars in 1057 bytes} [Mon May 9 20:22:30 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:22:30.344174 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab2c251-4869-430f-b362-8b42127b57ef None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:22:30.357182 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab2c251-4869-430f-b362-8b42127b57ef None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:22:30.362047 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468525b4-04d1-4d27-b15f-aa7b4283f596 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '285198b50b50431f96f9225d106417a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:22:30.362666 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468525b4-04d1-4d27-b15f-aa7b4283f596 service placement] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:22:30.362951 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468525b4-04d1-4d27-b15f-aa7b4283f596 service placement] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:22:30.363228 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468525b4-04d1-4d27-b15f-aa7b4283f596 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:22:30.371274 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468525b4-04d1-4d27-b15f-aa7b4283f596 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:22:30.372931 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468525b4-04d1-4d27-b15f-aa7b4283f596 service placement] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:22:30.382748 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 765/1521] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:22:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:22:37.049495 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d5d7f-ea03-446e-b32e-d2187ddc7a1b None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:22:37.050086 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d5d7f-ea03-446e-b32e-d2187ddc7a1b None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:22:37.050086 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d5d7f-ea03-446e-b32e-d2187ddc7a1b None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:22:37.051414 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 757/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 9 20:22:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:22:37.056255 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4750afa-9c3a-4d61-8587-86c776259f5a None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:22:37.056711 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4750afa-9c3a-4d61-8587-86c776259f5a None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:22:37.056816 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4750afa-9c3a-4d61-8587-86c776259f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:22:37.074092 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-c4750afa-9c3a-4d61-8587-86c776259f5a None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:22:37.075265 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-c4750afa-9c3a-4d61-8587-86c776259f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:22:37.082911 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 766/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 9 20:22:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:22:37.233496 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d5d7f-ea03-446e-b32e-d2187ddc7a1b None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:22:37.247615 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d5d7f-ea03-446e-b32e-d2187ddc7a1b None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:22:37.253711 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b9e91a-d625-40de-9d07-2eeb85de0a44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb59440b21074d9da15679dc2d745f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:22:37.254325 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b9e91a-d625-40de-9d07-2eeb85de0a44 service nova] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:22:37.254599 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b9e91a-d625-40de-9d07-2eeb85de0a44 service nova] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:22:37.254866 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b9e91a-d625-40de-9d07-2eeb85de0a44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:22:37.263176 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b9e91a-d625-40de-9d07-2eeb85de0a44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:22:37.265729 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b9e91a-d625-40de-9d07-2eeb85de0a44 service nova] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:22:37.274816 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 758/1524] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:22:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 09 20:22:38.169723 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0150a6e4-b78c-4e9d-8e0c-ae3b6cbebb1c None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:22:38.170767 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0150a6e4-b78c-4e9d-8e0c-ae3b6cbebb1c None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:22:38.170767 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0150a6e4-b78c-4e9d-8e0c-ae3b6cbebb1c None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:22:38.172175 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 767/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 9 20:22:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:22:38.176854 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7994f9d6-d0ed-4f2e-acc6-ba44c30064cc None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:22:38.177257 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7994f9d6-d0ed-4f2e-acc6-ba44c30064cc None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:22:38.177380 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7994f9d6-d0ed-4f2e-acc6-ba44c30064cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:22:38.195260 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-7994f9d6-d0ed-4f2e-acc6-ba44c30064cc None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:22:38.196466 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-7994f9d6-d0ed-4f2e-acc6-ba44c30064cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:22:38.204243 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 759/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 9 20:22:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:22:38.354718 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0150a6e4-b78c-4e9d-8e0c-ae3b6cbebb1c None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:22:38.369247 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0150a6e4-b78c-4e9d-8e0c-ae3b6cbebb1c None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:22:38.375071 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48856c02-e0ca-408f-8857-0f2b580c2763 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb59440b21074d9da15679dc2d745f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:22:38.375731 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48856c02-e0ca-408f-8857-0f2b580c2763 service nova] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:22:38.376015 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48856c02-e0ca-408f-8857-0f2b580c2763 service nova] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:22:38.376289 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48856c02-e0ca-408f-8857-0f2b580c2763 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:22:38.384100 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48856c02-e0ca-408f-8857-0f2b580c2763 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:22:38.385682 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48856c02-e0ca-408f-8857-0f2b580c2763 service nova] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:22:38.395080 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 768/1527] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:22:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:22:42.742915 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e616abce-0a55-424c-8183-c8c8e54b4b44 None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:22:42.743446 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e616abce-0a55-424c-8183-c8c8e54b4b44 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:22:42.743544 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e616abce-0a55-424c-8183-c8c8e54b4b44 None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:22:42.744936 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 760/1528] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 9 20:22:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:22:42.751499 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad4283-8d76-45be-a354-7de87a1eaf2a None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:22:42.751936 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad4283-8d76-45be-a354-7de87a1eaf2a None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:22:42.752030 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad4283-8d76-45be-a354-7de87a1eaf2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:22:42.770526 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-49ad4283-8d76-45be-a354-7de87a1eaf2a None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:22:42.771751 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-49ad4283-8d76-45be-a354-7de87a1eaf2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:22:42.779365 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 769/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 9 20:22:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:22:42.815521 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e616abce-0a55-424c-8183-c8c8e54b4b44 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:22:42.817204 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-e616abce-0a55-424c-8183-c8c8e54b4b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:22:42.871900 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e616abce-0a55-424c-8183-c8c8e54b4b44 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:22:42.875964 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cf869f-8b5a-4dac-b95e-6519d8a7f9ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:22:42.876600 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf869f-8b5a-4dac-b95e-6519d8a7f9ac service neutron] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:22:42.876877 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf869f-8b5a-4dac-b95e-6519d8a7f9ac service neutron] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:22:42.877149 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf869f-8b5a-4dac-b95e-6519d8a7f9ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:22:42.885933 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cf869f-8b5a-4dac-b95e-6519d8a7f9ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:22:42.887639 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cf869f-8b5a-4dac-b95e-6519d8a7f9ac service neutron] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:22:42.896842 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 761/1530] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:22:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:22:45.139766 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa9c8d5-e03d-452e-9b4c-68d509cce95b None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:22:45.140345 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa9c8d5-e03d-452e-9b4c-68d509cce95b None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:22:45.140345 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa9c8d5-e03d-452e-9b4c-68d509cce95b None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:22:45.141723 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 770/1531] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 9 20:22:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:22:45.147066 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06904a2c-5cab-4fee-ae75-9450c691bae3 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:22:45.147533 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06904a2c-5cab-4fee-ae75-9450c691bae3 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:22:45.147629 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06904a2c-5cab-4fee-ae75-9450c691bae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:22:45.165748 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-06904a2c-5cab-4fee-ae75-9450c691bae3 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:22:45.166917 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-06904a2c-5cab-4fee-ae75-9450c691bae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:22:45.174790 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 762/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 9 20:22:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:22:45.211043 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa9c8d5-e03d-452e-9b4c-68d509cce95b None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:22:45.212774 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-7fa9c8d5-e03d-452e-9b4c-68d509cce95b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:22:45.225837 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa9c8d5-e03d-452e-9b4c-68d509cce95b None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:22:45.229446 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e323aa-f10e-480c-a989-4edb2339142a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:22:45.230086 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e323aa-f10e-480c-a989-4edb2339142a service neutron] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:22:45.230365 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e323aa-f10e-480c-a989-4edb2339142a service neutron] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:22:45.230637 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e323aa-f10e-480c-a989-4edb2339142a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:22:45.239635 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e323aa-f10e-480c-a989-4edb2339142a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:22:45.241047 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e323aa-f10e-480c-a989-4edb2339142a service neutron] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:22:45.250812 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 771/1533] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:22:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:22:48.800740 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24aa32-e23b-4e85-a194-9bc402b68bdf None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:22:48.801297 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24aa32-e23b-4e85-a194-9bc402b68bdf None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:22:48.801297 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24aa32-e23b-4e85-a194-9bc402b68bdf None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:22:48.802657 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 763/1534] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 9 20:22:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:22:48.808118 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb1ae94-b08b-47b3-866d-12a025388f7a None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:22:48.808524 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb1ae94-b08b-47b3-866d-12a025388f7a None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:22:48.808665 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb1ae94-b08b-47b3-866d-12a025388f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:22:48.826649 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-ffb1ae94-b08b-47b3-866d-12a025388f7a None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:22:48.827887 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-ffb1ae94-b08b-47b3-866d-12a025388f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:22:48.835541 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 772/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 9 20:22:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:22:49.109250 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd24aa32-e23b-4e85-a194-9bc402b68bdf None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:22:49.110886 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-fd24aa32-e23b-4e85-a194-9bc402b68bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:22:49.164736 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd24aa32-e23b-4e85-a194-9bc402b68bdf None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:22:49.168468 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31740953-9c6d-49ac-b229-bee707a048ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d65e731386d44948dcc1ecd40cbda65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:22:49.169116 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31740953-9c6d-49ac-b229-bee707a048ba service cinder] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:22:49.169402 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31740953-9c6d-49ac-b229-bee707a048ba service cinder] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:22:49.170364 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31740953-9c6d-49ac-b229-bee707a048ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:22:49.179419 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31740953-9c6d-49ac-b229-bee707a048ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:22:49.180857 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31740953-9c6d-49ac-b229-bee707a048ba service cinder] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:22:49.190397 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 764/1536] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:22:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:22:51.469139 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d1271-0757-431d-bdbe-f8576a489650 None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:22:51.469744 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d1271-0757-431d-bdbe-f8576a489650 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:22:51.469744 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d1271-0757-431d-bdbe-f8576a489650 None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:22:51.471039 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 773/1537] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 9 20:22:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:22:51.476367 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a9bd0-48bf-4926-aae3-847cf477c74e None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:22:51.476824 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a9bd0-48bf-4926-aae3-847cf477c74e None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:22:51.476931 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a9bd0-48bf-4926-aae3-847cf477c74e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:22:51.495729 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-745a9bd0-48bf-4926-aae3-847cf477c74e None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:22:51.496906 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-745a9bd0-48bf-4926-aae3-847cf477c74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:22:51.504969 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 765/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 9 20:22:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:22:51.774702 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d1271-0757-431d-bdbe-f8576a489650 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:22:51.776449 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-972d1271-0757-431d-bdbe-f8576a489650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:22:51.789224 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d1271-0757-431d-bdbe-f8576a489650 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:22:51.792697 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c6c1e3-8f9f-4d85-a8c3-49a4cb7e999f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d65e731386d44948dcc1ecd40cbda65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:22:51.793316 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6c1e3-8f9f-4d85-a8c3-49a4cb7e999f service cinder] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:22:51.793596 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6c1e3-8f9f-4d85-a8c3-49a4cb7e999f service cinder] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:22:51.793870 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6c1e3-8f9f-4d85-a8c3-49a4cb7e999f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:22:51.802839 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c6c1e3-8f9f-4d85-a8c3-49a4cb7e999f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:22:51.804273 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c6c1e3-8f9f-4d85-a8c3-49a4cb7e999f service cinder] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:22:51.813965 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 774/1539] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:22:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:24:21.404758 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad6194a-530e-440b-9037-d3a12c19eed4 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:21.405461 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad6194a-530e-440b-9037-d3a12c19eed4 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:21.405461 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad6194a-530e-440b-9037-d3a12c19eed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:21.432582 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-1ad6194a-530e-440b-9037-d3a12c19eed4 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:24:21.434032 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-1ad6194a-530e-440b-9037-d3a12c19eed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:24:21.447307 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 766/1540] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:24:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:24:21.458261 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e52db5-0dc6-4644-8b9d-20b30e65c6a6 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:21.458836 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e52db5-0dc6-4644-8b9d-20b30e65c6a6 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:21.458836 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e52db5-0dc6-4644-8b9d-20b30e65c6a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:21.487695 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-36e52db5-0dc6-4644-8b9d-20b30e65c6a6 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:24:21.488912 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-36e52db5-0dc6-4644-8b9d-20b30e65c6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:24:21.506028 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 775/1541] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:24:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:24:21.510676 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad6194a-530e-440b-9037-d3a12c19eed4 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:21.524242 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad6194a-530e-440b-9037-d3a12c19eed4 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:21.535743 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6910daa4-5fa9-46d1-8b60-1d83acc6299c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:21.536419 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910daa4-5fa9-46d1-8b60-1d83acc6299c admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:21.536702 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910daa4-5fa9-46d1-8b60-1d83acc6299c admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:21.536973 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910daa4-5fa9-46d1-8b60-1d83acc6299c admin admin] PATH_INFO: `/v3/domains` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:21.537700 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6910daa4-5fa9-46d1-8b60-1d83acc6299c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:24:21.538006 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6910daa4-5fa9-46d1-8b60-1d83acc6299c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:21.539654 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6910daa4-5fa9-46d1-8b60-1d83acc6299c admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:21.556548 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 767/1542] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 9 20:24:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:24:21.569528 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e52db5-0dc6-4644-8b9d-20b30e65c6a6 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:21.581309 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e52db5-0dc6-4644-8b9d-20b30e65c6a6 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:21.592586 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf34b0-3cca-423e-ab22-9c81920838f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:21.593260 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf34b0-3cca-423e-ab22-9c81920838f2 admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:21.593545 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf34b0-3cca-423e-ab22-9c81920838f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:21.593821 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf34b0-3cca-423e-ab22-9c81920838f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:21.594540 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcf34b0-3cca-423e-ab22-9c81920838f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:21.598984 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcf34b0-3cca-423e-ab22-9c81920838f2 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:21.632012 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 776/1543] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:24:21 2022] POST /identity/v3/projects => generated 391 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 20:24:21.636343 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6910daa4-5fa9-46d1-8b60-1d83acc6299c admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:21.647759 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6910daa4-5fa9-46d1-8b60-1d83acc6299c admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:21.728479 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a21b446-7dad-4be8-9eda-7649bf66f183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:21.729158 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21b446-7dad-4be8-9eda-7649bf66f183 admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:21.729441 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21b446-7dad-4be8-9eda-7649bf66f183 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:21.729719 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21b446-7dad-4be8-9eda-7649bf66f183 admin admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:21.730542 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a21b446-7dad-4be8-9eda-7649bf66f183 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:21.733742 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a21b446-7dad-4be8-9eda-7649bf66f183 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:21.764526 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 768/1544] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:24:21 2022] POST /identity/v3/users => generated 296 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:24:21.769461 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf34b0-3cca-423e-ab22-9c81920838f2 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:21.781747 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf34b0-3cca-423e-ab22-9c81920838f2 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:21.792019 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38f8d0a-17ad-4de5-89fd-dc76c9f2acdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:21.792741 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f8d0a-17ad-4de5-89fd-dc76c9f2acdf admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:21.793072 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f8d0a-17ad-4de5-89fd-dc76c9f2acdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:21.793350 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f8d0a-17ad-4de5-89fd-dc76c9f2acdf admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:21.794199 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38f8d0a-17ad-4de5-89fd-dc76c9f2acdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:21.796076 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38f8d0a-17ad-4de5-89fd-dc76c9f2acdf admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:21.812901 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 777/1545] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:24:21 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:24:21.817771 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a21b446-7dad-4be8-9eda-7649bf66f183 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:21.823111 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd3b5e-9d13-4aab-8c9d-c9c41ff508ae None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:21.823801 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd3b5e-9d13-4aab-8c9d-c9c41ff508ae None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:21.824463 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd3b5e-9d13-4aab-8c9d-c9c41ff508ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:21.829292 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a21b446-7dad-4be8-9eda-7649bf66f183 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:21.845106 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaae9a9-7cf2-4a3f-b986-ea4759f737d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:21.845788 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaae9a9-7cf2-4a3f-b986-ea4759f737d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:21.846061 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaae9a9-7cf2-4a3f-b986-ea4759f737d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:21.846330 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaae9a9-7cf2-4a3f-b986-ea4759f737d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:21.847048 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaae9a9-7cf2-4a3f-b986-ea4759f737d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:21.858476 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaae9a9-7cf2-4a3f-b986-ea4759f737d8 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:21.864911 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-77bd3b5e-9d13-4aab-8c9d-c9c41ff508ae None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:24:21.866191 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-77bd3b5e-9d13-4aab-8c9d-c9c41ff508ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:24:21.883426 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 769/1546] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:24:21 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:24:21.892106 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 778/1547] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:24:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:24:21.893056 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaae9a9-7cf2-4a3f-b986-ea4759f737d8 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:21.902655 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20cd056-547c-494c-93ea-39f3fc80d3d0 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:21.903284 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20cd056-547c-494c-93ea-39f3fc80d3d0 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:21.903864 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20cd056-547c-494c-93ea-39f3fc80d3d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:21.908998 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaae9a9-7cf2-4a3f-b986-ea4759f737d8 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:21.916005 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebdc308-71f6-4b1a-ab28-d51688223e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:21.919567 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebdc308-71f6-4b1a-ab28-d51688223e7b admin admin] REQUEST_METHOD: `PUT` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:21.920069 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebdc308-71f6-4b1a-ab28-d51688223e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:21.921531 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebdc308-71f6-4b1a-ab28-d51688223e7b admin admin] PATH_INFO: `/v3/projects/96a116cd334648f185dbf35bfa3ade00/users/797d7c0dfda747549456236e9e639466/roles/79f90a0bf6ea43d0b3c434e31556253a` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:21.939263 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-a20cd056-547c-494c-93ea-39f3fc80d3d0 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:24:21.940934 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-a20cd056-547c-494c-93ea-39f3fc80d3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:24:21.955423 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebdc308-71f6-4b1a-ab28-d51688223e7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=96a116cd334648f185dbf35bfa3ade00, user_id=797d7c0dfda747549456236e9e639466, role_id=79f90a0bf6ea43d0b3c434e31556253a)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:21.958012 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: WARNING py.warnings [None req-aebdc308-71f6-4b1a-ab28-d51688223e7b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 09 20:24:21.958012 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: warnings.warn(msg) May 09 20:24:21.958012 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: May 09 20:24:21.962040 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebdc308-71f6-4b1a-ab28-d51688223e7b admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:21.962811 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 779/1548] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:24:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:24:21.971599 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20cd056-547c-494c-93ea-39f3fc80d3d0 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:21.993060 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20cd056-547c-494c-93ea-39f3fc80d3d0 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:22.001093 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 770/1549] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:24:21 2022] PUT /identity/v3/projects/96a116cd334648f185dbf35bfa3ade00/users/797d7c0dfda747549456236e9e639466/roles/79f90a0bf6ea43d0b3c434e31556253a => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:24:22.033206 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e8b61-798a-4a4e-9da5-d9a1c7a330a3 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:22.033891 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e8b61-798a-4a4e-9da5-d9a1c7a330a3 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:22.034527 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e8b61-798a-4a4e-9da5-d9a1c7a330a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:22.068228 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-5e3e8b61-798a-4a4e-9da5-d9a1c7a330a3 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:24:22.070128 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-5e3e8b61-798a-4a4e-9da5-d9a1c7a330a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:24:22.131895 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb495ef-0d7d-4d8a-9a49-8b7035ff3150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:22.133025 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb495ef-0d7d-4d8a-9a49-8b7035ff3150 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:22.135486 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb495ef-0d7d-4d8a-9a49-8b7035ff3150 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:22.136057 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb495ef-0d7d-4d8a-9a49-8b7035ff3150 admin admin] PATH_INFO: `/v3/domains` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:22.137321 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb495ef-0d7d-4d8a-9a49-8b7035ff3150 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:24:22.140827 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb495ef-0d7d-4d8a-9a49-8b7035ff3150 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:22.142349 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: WARNING py.warnings [None req-6bb495ef-0d7d-4d8a-9a49-8b7035ff3150 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 09 20:24:22.142349 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: warnings.warn(msg) May 09 20:24:22.142349 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: May 09 20:24:22.143646 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb495ef-0d7d-4d8a-9a49-8b7035ff3150 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:22.181079 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 780/1550] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 9 20:24:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:24:22.183154 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d52264e-ca8d-4bd7-a483-44eeffb5e14a None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:22.183707 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d52264e-ca8d-4bd7-a483-44eeffb5e14a None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:22.186247 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d52264e-ca8d-4bd7-a483-44eeffb5e14a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:22.230232 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-5d52264e-ca8d-4bd7-a483-44eeffb5e14a None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:24:22.236308 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-5d52264e-ca8d-4bd7-a483-44eeffb5e14a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:24:22.238029 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 771/1551] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:24:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:24:22.240045 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c9572-fc1c-4ddd-b17a-c9370fb96133 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:22.240662 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c9572-fc1c-4ddd-b17a-c9370fb96133 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:22.241156 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c9572-fc1c-4ddd-b17a-c9370fb96133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:22.256764 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 781/1552] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:24:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:24:22.259380 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d52264e-ca8d-4bd7-a483-44eeffb5e14a None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:22.271128 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-e99c9572-fc1c-4ddd-b17a-c9370fb96133 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:24:22.272722 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-e99c9572-fc1c-4ddd-b17a-c9370fb96133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:24:22.273167 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d52264e-ca8d-4bd7-a483-44eeffb5e14a None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:22.278345 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd220c-383a-4063-b9ef-10495add35cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:22.279350 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd220c-383a-4063-b9ef-10495add35cd admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:22.279759 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd220c-383a-4063-b9ef-10495add35cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:22.280067 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd220c-383a-4063-b9ef-10495add35cd admin admin] PATH_INFO: `/v3/projects` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:22.280909 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fd220c-383a-4063-b9ef-10495add35cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:22.283442 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fd220c-383a-4063-b9ef-10495add35cd admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:22.284924 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 772/1553] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:24:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:24:22.286909 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413bb72-16f7-4711-a29a-72b9baa63c85 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:22.287435 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413bb72-16f7-4711-a29a-72b9baa63c85 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:22.287928 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413bb72-16f7-4711-a29a-72b9baa63c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:22.309118 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-7413bb72-16f7-4711-a29a-72b9baa63c85 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:24:22.311055 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-7413bb72-16f7-4711-a29a-72b9baa63c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:24:22.318281 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 782/1554] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:24:22 2022] POST /identity/v3/projects => generated 377 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:24:22.318281 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60a5b8-40b4-4263-b442-b9667a75259d None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:22.318281 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60a5b8-40b4-4263-b442-b9667a75259d None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:22.318281 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60a5b8-40b4-4263-b442-b9667a75259d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:22.322329 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 773/1555] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:24:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:24:22.323208 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7413bb72-16f7-4711-a29a-72b9baa63c85 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:22.336055 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-0b60a5b8-40b4-4263-b442-b9667a75259d None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:24:22.337333 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-0b60a5b8-40b4-4263-b442-b9667a75259d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:24:22.378532 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7413bb72-16f7-4711-a29a-72b9baa63c85 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:22.397344 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 783/1556] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:24:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:24:22.398831 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac9436-dce7-4664-8087-308ccf4bc439 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:22.399037 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac9436-dce7-4664-8087-308ccf4bc439 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:22.400274 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac9436-dce7-4664-8087-308ccf4bc439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:22.418028 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-cfac9436-dce7-4664-8087-308ccf4bc439 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:24:22.419761 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-cfac9436-dce7-4664-8087-308ccf4bc439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:24:22.427513 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3541e32b-259b-4a56-af86-1850f4c4b63b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:22.428166 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 784/1557] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:24:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:24:22.429410 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3aeb3d-5ed4-4d04-9553-684d6bb70848 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:22.429697 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3aeb3d-5ed4-4d04-9553-684d6bb70848 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:22.429967 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3aeb3d-5ed4-4d04-9553-684d6bb70848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:22.431497 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3541e32b-259b-4a56-af86-1850f4c4b63b service neutron] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:22.431986 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3541e32b-259b-4a56-af86-1850f4c4b63b service neutron] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:22.432381 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3541e32b-259b-4a56-af86-1850f4c4b63b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:22.442210 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3541e32b-259b-4a56-af86-1850f4c4b63b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:22.443794 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3541e32b-259b-4a56-af86-1850f4c4b63b service neutron] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:22.447526 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-2c3aeb3d-5ed4-4d04-9553-684d6bb70848 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:24:22.448866 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-2c3aeb3d-5ed4-4d04-9553-684d6bb70848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:24:22.454348 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 774/1558] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:24:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:24:22.455828 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e09022-7680-448d-9f21-17f3afd23648 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:22.456115 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e09022-7680-448d-9f21-17f3afd23648 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:22.456380 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e09022-7680-448d-9f21-17f3afd23648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:22.457508 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 785/1559] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:24:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:24:22.458558 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57c4a9-1b5f-442d-8291-a8b9e75f412b None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:22.459122 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57c4a9-1b5f-442d-8291-a8b9e75f412b None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:22.459122 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57c4a9-1b5f-442d-8291-a8b9e75f412b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:22.478108 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-75e09022-7680-448d-9f21-17f3afd23648 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:24:22.478405 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-ee57c4a9-1b5f-442d-8291-a8b9e75f412b None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:24:22.479476 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-75e09022-7680-448d-9f21-17f3afd23648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:24:22.479802 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-ee57c4a9-1b5f-442d-8291-a8b9e75f412b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:24:22.488625 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 775/1560] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:24:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:24:22.489224 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e09022-7680-448d-9f21-17f3afd23648 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:22.496333 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 786/1561] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:24:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:24:22.500074 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e09022-7680-448d-9f21-17f3afd23648 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:22.500454 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e58a1dc-4dec-42e8-9b61-337a06f2f6ef None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:22.500753 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e58a1dc-4dec-42e8-9b61-337a06f2f6ef None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:22.501051 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e58a1dc-4dec-42e8-9b61-337a06f2f6ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:22.511241 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89283534-11fc-4c43-a4c4-a7ae778e03df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:22.512845 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89283534-11fc-4c43-a4c4-a7ae778e03df admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:22.512845 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89283534-11fc-4c43-a4c4-a7ae778e03df admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:22.513051 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89283534-11fc-4c43-a4c4-a7ae778e03df admin admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:22.513671 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89283534-11fc-4c43-a4c4-a7ae778e03df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:22.515773 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89283534-11fc-4c43-a4c4-a7ae778e03df admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:22.523647 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-3e58a1dc-4dec-42e8-9b61-337a06f2f6ef None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:24:22.525921 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-3e58a1dc-4dec-42e8-9b61-337a06f2f6ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:24:22.536321 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 787/1562] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:24:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:24:22.537873 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92410fa4-3573-45c7-aed2-bf05325c63c7 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:22.538222 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92410fa4-3573-45c7-aed2-bf05325c63c7 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:22.538575 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92410fa4-3573-45c7-aed2-bf05325c63c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:22.538919 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 776/1563] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:24:22 2022] POST /identity/v3/users => generated 289 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:24:22.540027 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89283534-11fc-4c43-a4c4-a7ae778e03df admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:22.551791 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89283534-11fc-4c43-a4c4-a7ae778e03df admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:22.556682 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc82d7c6-31c0-48ee-a0b6-ef9f5dcc706e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:22.557425 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82d7c6-31c0-48ee-a0b6-ef9f5dcc706e admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:22.557731 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82d7c6-31c0-48ee-a0b6-ef9f5dcc706e admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:22.558002 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82d7c6-31c0-48ee-a0b6-ef9f5dcc706e admin admin] PATH_INFO: `/v3/domains` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:22.558759 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc82d7c6-31c0-48ee-a0b6-ef9f5dcc706e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:24:22.559059 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc82d7c6-31c0-48ee-a0b6-ef9f5dcc706e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:22.561652 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc82d7c6-31c0-48ee-a0b6-ef9f5dcc706e admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:22.562205 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-92410fa4-3573-45c7-aed2-bf05325c63c7 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:24:22.563451 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-92410fa4-3573-45c7-aed2-bf05325c63c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:24:22.575892 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 788/1564] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:24:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:24:22.575892 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92410fa4-3573-45c7-aed2-bf05325c63c7 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:22.588525 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 777/1565] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 9 20:24:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:24:22.588525 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8418c112-7382-47ab-9894-642840b29c58 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:22.588525 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8418c112-7382-47ab-9894-642840b29c58 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:22.588525 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8418c112-7382-47ab-9894-642840b29c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:22.591785 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92410fa4-3573-45c7-aed2-bf05325c63c7 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:22.596789 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad6392c-c3dd-460d-ade3-61ee6599a1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:22.597554 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad6392c-c3dd-460d-ade3-61ee6599a1e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:22.597906 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad6392c-c3dd-460d-ade3-61ee6599a1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:22.598250 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad6392c-c3dd-460d-ade3-61ee6599a1e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:22.599095 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad6392c-c3dd-460d-ade3-61ee6599a1e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:24:22.599560 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad6392c-c3dd-460d-ade3-61ee6599a1e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:22.601330 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad6392c-c3dd-460d-ade3-61ee6599a1e5 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:22.603246 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-8418c112-7382-47ab-9894-642840b29c58 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:24:22.604566 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-8418c112-7382-47ab-9894-642840b29c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:24:22.613527 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 778/1566] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:24:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:24:22.614685 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c165a256-094b-44c2-b9a9-2e46a9246ae1 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:22.615024 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c165a256-094b-44c2-b9a9-2e46a9246ae1 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:22.615352 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c165a256-094b-44c2-b9a9-2e46a9246ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:22.620250 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 789/1567] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 9 20:24:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:24:22.621215 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad6392c-c3dd-460d-ade3-61ee6599a1e5 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:22.633160 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad6392c-c3dd-460d-ade3-61ee6599a1e5 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:22.639582 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fd21fb-7baf-4e16-acb2-0c53e59fd378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:22.640278 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd21fb-7baf-4e16-acb2-0c53e59fd378 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:22.640578 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd21fb-7baf-4e16-acb2-0c53e59fd378 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:22.640876 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd21fb-7baf-4e16-acb2-0c53e59fd378 admin admin] PATH_INFO: `/v3/domains` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:22.641665 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fd21fb-7baf-4e16-acb2-0c53e59fd378 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:24:22.642160 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fd21fb-7baf-4e16-acb2-0c53e59fd378 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:22.642638 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-c165a256-094b-44c2-b9a9-2e46a9246ae1 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:24:22.643812 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fd21fb-7baf-4e16-acb2-0c53e59fd378 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:22.643938 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-c165a256-094b-44c2-b9a9-2e46a9246ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:24:22.653276 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 779/1568] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:24:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:24:22.654925 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c165a256-094b-44c2-b9a9-2e46a9246ae1 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:22.661594 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 790/1569] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 9 20:24:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:24:22.662588 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fd21fb-7baf-4e16-acb2-0c53e59fd378 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:22.673301 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fd21fb-7baf-4e16-acb2-0c53e59fd378 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:22.674328 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c165a256-094b-44c2-b9a9-2e46a9246ae1 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:22.679117 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c009539b-9ad6-40d4-b9a3-745868e0be12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:22.679805 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c009539b-9ad6-40d4-b9a3-745868e0be12 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:22.679935 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5e4a2c-a172-4d41-9a6d-7a1eb199ef2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:22.680142 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c009539b-9ad6-40d4-b9a3-745868e0be12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:22.680842 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c009539b-9ad6-40d4-b9a3-745868e0be12 admin admin] PATH_INFO: `/v3/domains` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:22.680989 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5e4a2c-a172-4d41-9a6d-7a1eb199ef2b admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:22.680989 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5e4a2c-a172-4d41-9a6d-7a1eb199ef2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:22.681237 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c009539b-9ad6-40d4-b9a3-745868e0be12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:24:22.681342 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5e4a2c-a172-4d41-9a6d-7a1eb199ef2b admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:22.681519 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c009539b-9ad6-40d4-b9a3-745868e0be12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:22.681938 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5e4a2c-a172-4d41-9a6d-7a1eb199ef2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:22.683166 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c009539b-9ad6-40d4-b9a3-745868e0be12 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:22.683666 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5e4a2c-a172-4d41-9a6d-7a1eb199ef2b admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:22.704359 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 791/1570] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 9 20:24:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:24:22.704359 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c009539b-9ad6-40d4-b9a3-745868e0be12 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:22.704675 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 780/1571] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:24:22 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:24:22.704675 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5e4a2c-a172-4d41-9a6d-7a1eb199ef2b admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:22.714538 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c009539b-9ad6-40d4-b9a3-745868e0be12 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:22.714862 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5e4a2c-a172-4d41-9a6d-7a1eb199ef2b admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:22.720312 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da48efaf-4bb4-4e96-9237-1dfda9da3770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:22.721106 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48efaf-4bb4-4e96-9237-1dfda9da3770 admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:22.721243 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6368c8-7de2-45bb-b548-fd7fcb1980ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:22.721401 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48efaf-4bb4-4e96-9237-1dfda9da3770 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:22.721840 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6368c8-7de2-45bb-b548-fd7fcb1980ac admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:22.722008 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48efaf-4bb4-4e96-9237-1dfda9da3770 admin admin] PATH_INFO: `/v3/projects` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:22.722112 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6368c8-7de2-45bb-b548-fd7fcb1980ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:22.722371 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6368c8-7de2-45bb-b548-fd7fcb1980ac admin admin] PATH_INFO: `/v3/domains` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:22.723117 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6368c8-7de2-45bb-b548-fd7fcb1980ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:24:22.723383 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da48efaf-4bb4-4e96-9237-1dfda9da3770 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:22.723523 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6368c8-7de2-45bb-b548-fd7fcb1980ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:22.725072 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6368c8-7de2-45bb-b548-fd7fcb1980ac admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:22.725748 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da48efaf-4bb4-4e96-9237-1dfda9da3770 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:22.750945 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 781/1572] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 9 20:24:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:24:22.750945 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6368c8-7de2-45bb-b548-fd7fcb1980ac admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:22.760033 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6368c8-7de2-45bb-b548-fd7fcb1980ac admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:22.766098 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbf8f13-7fe7-4474-ac36-944e15ad6b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:22.766911 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf8f13-7fe7-4474-ac36-944e15ad6b1d admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:22.767235 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf8f13-7fe7-4474-ac36-944e15ad6b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:22.767501 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf8f13-7fe7-4474-ac36-944e15ad6b1d admin admin] PATH_INFO: `/v3/projects` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:22.768194 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbf8f13-7fe7-4474-ac36-944e15ad6b1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:22.769375 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: WARNING py.warnings [None req-acbf8f13-7fe7-4474-ac36-944e15ad6b1d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 09 20:24:22.769375 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: warnings.warn(msg) May 09 20:24:22.769375 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: May 09 20:24:22.770585 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbf8f13-7fe7-4474-ac36-944e15ad6b1d admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:22.785332 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 792/1573] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:24:22 2022] POST /identity/v3/projects => generated 389 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:24:22.786272 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da48efaf-4bb4-4e96-9237-1dfda9da3770 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:22.800161 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 782/1574] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:24:22 2022] POST /identity/v3/projects => generated 383 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:24:22.801072 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbf8f13-7fe7-4474-ac36-944e15ad6b1d admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:22.862408 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da48efaf-4bb4-4e96-9237-1dfda9da3770 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:22.868605 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be603f5-02d1-47e8-833a-00c71b500f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:22.869934 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be603f5-02d1-47e8-833a-00c71b500f99 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:22.870626 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be603f5-02d1-47e8-833a-00c71b500f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:22.870747 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbf8f13-7fe7-4474-ac36-944e15ad6b1d admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:22.871379 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be603f5-02d1-47e8-833a-00c71b500f99 admin admin] PATH_INFO: `/v3/domains` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:22.873138 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be603f5-02d1-47e8-833a-00c71b500f99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:24:22.873675 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be603f5-02d1-47e8-833a-00c71b500f99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:22.876007 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be603f5-02d1-47e8-833a-00c71b500f99 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:22.876140 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a4898-19ed-4f0d-96e7-2fa9979450b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:22.876794 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a4898-19ed-4f0d-96e7-2fa9979450b6 admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:22.877072 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a4898-19ed-4f0d-96e7-2fa9979450b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:22.877345 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a4898-19ed-4f0d-96e7-2fa9979450b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:22.878020 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289a4898-19ed-4f0d-96e7-2fa9979450b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:22.880220 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289a4898-19ed-4f0d-96e7-2fa9979450b6 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:22.895916 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 793/1575] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 9 20:24:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:24:22.896917 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be603f5-02d1-47e8-833a-00c71b500f99 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:22.911923 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be603f5-02d1-47e8-833a-00c71b500f99 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:22.923256 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf0a4e3-0c2f-44e8-bbf9-832cd1b13e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:22.924171 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf0a4e3-0c2f-44e8-bbf9-832cd1b13e08 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:22.924544 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf0a4e3-0c2f-44e8-bbf9-832cd1b13e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:22.924826 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf0a4e3-0c2f-44e8-bbf9-832cd1b13e08 admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:22.925561 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf0a4e3-0c2f-44e8-bbf9-832cd1b13e08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:22.927343 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf0a4e3-0c2f-44e8-bbf9-832cd1b13e08 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:22.927523 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 783/1576] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:24:22 2022] POST /identity/v3/projects => generated 403 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:24:22.932044 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a4898-19ed-4f0d-96e7-2fa9979450b6 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:22.941838 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 794/1577] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:24:22 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:24:22.941838 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf0a4e3-0c2f-44e8-bbf9-832cd1b13e08 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:22.953058 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf0a4e3-0c2f-44e8-bbf9-832cd1b13e08 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:23.015333 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbd25dd-98ba-478f-a135-7f995b026e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:23.015673 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a4898-19ed-4f0d-96e7-2fa9979450b6 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:23.016032 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd25dd-98ba-478f-a135-7f995b026e40 admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:23.016309 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd25dd-98ba-478f-a135-7f995b026e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:23.016648 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd25dd-98ba-478f-a135-7f995b026e40 admin admin] PATH_INFO: `/v3/projects` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:23.017400 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbd25dd-98ba-478f-a135-7f995b026e40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:23.019441 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbd25dd-98ba-478f-a135-7f995b026e40 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:23.021673 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37df10b5-33ed-45e5-887d-59d6d4951685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:23.022384 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df10b5-33ed-45e5-887d-59d6d4951685 admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:23.022749 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df10b5-33ed-45e5-887d-59d6d4951685 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:23.022940 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df10b5-33ed-45e5-887d-59d6d4951685 admin admin] PATH_INFO: `/v3/projects` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:23.023754 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37df10b5-33ed-45e5-887d-59d6d4951685 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:23.025557 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37df10b5-33ed-45e5-887d-59d6d4951685 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:23.049656 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 795/1578] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:24:22 2022] POST /identity/v3/projects => generated 377 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:24:23.050701 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbd25dd-98ba-478f-a135-7f995b026e40 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:23.057115 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 784/1579] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:24:22 2022] POST /identity/v3/projects => generated 375 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:24:23.058216 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37df10b5-33ed-45e5-887d-59d6d4951685 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:23.114574 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbd25dd-98ba-478f-a135-7f995b026e40 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:23.124867 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37df10b5-33ed-45e5-887d-59d6d4951685 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:23.129870 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235a0600-59f7-4a6a-96a3-4cb353fb5570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:23.130537 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a0600-59f7-4a6a-96a3-4cb353fb5570 admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:23.131635 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a0600-59f7-4a6a-96a3-4cb353fb5570 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:23.132085 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a0600-59f7-4a6a-96a3-4cb353fb5570 admin admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:23.133336 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235a0600-59f7-4a6a-96a3-4cb353fb5570 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:23.137464 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235a0600-59f7-4a6a-96a3-4cb353fb5570 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:23.162487 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 785/1580] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:24:23 2022] POST /identity/v3/users => generated 292 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:24:23.162487 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235a0600-59f7-4a6a-96a3-4cb353fb5570 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:23.172863 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235a0600-59f7-4a6a-96a3-4cb353fb5570 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:23.178420 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469b70e6-0681-4915-b53f-0c741b354c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:23.179068 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469b70e6-0681-4915-b53f-0c741b354c17 admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:23.179351 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469b70e6-0681-4915-b53f-0c741b354c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:23.179530 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e8d64-3fc3-4dbf-a49f-a30d7f1c7970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:23.179697 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469b70e6-0681-4915-b53f-0c741b354c17 admin admin] PATH_INFO: `/v3/projects` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:23.180290 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e8d64-3fc3-4dbf-a49f-a30d7f1c7970 admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:23.180412 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469b70e6-0681-4915-b53f-0c741b354c17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:23.180654 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e8d64-3fc3-4dbf-a49f-a30d7f1c7970 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:23.180977 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e8d64-3fc3-4dbf-a49f-a30d7f1c7970 admin admin] PATH_INFO: `/v3/users` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:23.181770 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e8d64-3fc3-4dbf-a49f-a30d7f1c7970 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:23.182355 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469b70e6-0681-4915-b53f-0c741b354c17 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:23.182927 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: WARNING py.warnings [None req-8b3e8d64-3fc3-4dbf-a49f-a30d7f1c7970 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 09 20:24:23.182927 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: warnings.warn(msg) May 09 20:24:23.182927 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: May 09 20:24:23.185911 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e8d64-3fc3-4dbf-a49f-a30d7f1c7970 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:23.208843 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 796/1581] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:24:23 2022] POST /identity/v3/users => generated 295 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:24:23.211937 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 786/1582] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:24:23 2022] POST /identity/v3/projects => generated 355 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:24:23.212706 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469b70e6-0681-4915-b53f-0c741b354c17 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:23.213094 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e8d64-3fc3-4dbf-a49f-a30d7f1c7970 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:23.225743 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e8d64-3fc3-4dbf-a49f-a30d7f1c7970 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:23.301282 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469b70e6-0681-4915-b53f-0c741b354c17 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:23.302417 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354419f1-42b5-4bef-ba68-434da355127a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:23.303310 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354419f1-42b5-4bef-ba68-434da355127a admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:23.303853 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354419f1-42b5-4bef-ba68-434da355127a admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:23.304340 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354419f1-42b5-4bef-ba68-434da355127a admin admin] PATH_INFO: `/v3/users` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:23.305363 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354419f1-42b5-4bef-ba68-434da355127a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:23.307556 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354419f1-42b5-4bef-ba68-434da355127a admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:23.314907 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d943c3f2-827f-423c-9be9-44ab41ec2863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:23.316044 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d943c3f2-827f-423c-9be9-44ab41ec2863 admin admin] REQUEST_METHOD: `PUT` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:23.316357 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d943c3f2-827f-423c-9be9-44ab41ec2863 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:23.316629 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d943c3f2-827f-423c-9be9-44ab41ec2863 admin admin] PATH_INFO: `/v3/projects/1689d104c0184a36816bb6e361733e16/users/d9342c8759514113aeec13ce910e4a21/roles/79f90a0bf6ea43d0b3c434e31556253a` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:23.333584 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 797/1583] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:24:23 2022] POST /identity/v3/users => generated 302 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:24:23.334566 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354419f1-42b5-4bef-ba68-434da355127a admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:23.338762 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d943c3f2-827f-423c-9be9-44ab41ec2863 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1689d104c0184a36816bb6e361733e16, user_id=d9342c8759514113aeec13ce910e4a21, role_id=79f90a0bf6ea43d0b3c434e31556253a)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:23.342168 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d943c3f2-827f-423c-9be9-44ab41ec2863 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:23.354470 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354419f1-42b5-4bef-ba68-434da355127a admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:23.360737 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 787/1584] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:24:23 2022] PUT /identity/v3/projects/1689d104c0184a36816bb6e361733e16/users/d9342c8759514113aeec13ce910e4a21/roles/79f90a0bf6ea43d0b3c434e31556253a => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:24:23.360737 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d943c3f2-827f-423c-9be9-44ab41ec2863 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:23.432337 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d943c3f2-827f-423c-9be9-44ab41ec2863 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:23.437811 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba1c13f-1d66-4d7c-b4e4-9ce2927531af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:23.438644 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fbd760-7576-4320-b9bb-285617692ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:23.439008 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba1c13f-1d66-4d7c-b4e4-9ce2927531af admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:23.439493 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fbd760-7576-4320-b9bb-285617692ec6 admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:23.439745 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba1c13f-1d66-4d7c-b4e4-9ce2927531af admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:23.439902 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fbd760-7576-4320-b9bb-285617692ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:23.440176 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fbd760-7576-4320-b9bb-285617692ec6 admin admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:23.440659 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba1c13f-1d66-4d7c-b4e4-9ce2927531af admin admin] PATH_INFO: `/v3/users` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:23.441130 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fbd760-7576-4320-b9bb-285617692ec6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:23.441789 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba1c13f-1d66-4d7c-b4e4-9ce2927531af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:23.443236 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fbd760-7576-4320-b9bb-285617692ec6 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:23.444739 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba1c13f-1d66-4d7c-b4e4-9ce2927531af admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:23.471353 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 788/1585] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:24:23 2022] POST /identity/v3/users => generated 288 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:24:23.471353 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fbd760-7576-4320-b9bb-285617692ec6 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:23.481103 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 798/1586] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:24:23 2022] POST /identity/v3/users => generated 289 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:24:23.481746 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fbd760-7576-4320-b9bb-285617692ec6 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:23.481864 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba1c13f-1d66-4d7c-b4e4-9ce2927531af admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:23.490847 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a215ec-2791-4ff6-afac-97f5146bacad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:23.491292 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba1c13f-1d66-4d7c-b4e4-9ce2927531af admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:23.491551 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a215ec-2791-4ff6-afac-97f5146bacad admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:23.491834 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a215ec-2791-4ff6-afac-97f5146bacad admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:23.492108 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a215ec-2791-4ff6-afac-97f5146bacad admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:23.493549 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a215ec-2791-4ff6-afac-97f5146bacad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:23.494674 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a215ec-2791-4ff6-afac-97f5146bacad admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:23.496807 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5327d2-c4bb-4fad-b4ad-ba8f085d7ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:23.497955 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5327d2-c4bb-4fad-b4ad-ba8f085d7ec2 admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:23.498330 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5327d2-c4bb-4fad-b4ad-ba8f085d7ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:23.498715 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5327d2-c4bb-4fad-b4ad-ba8f085d7ec2 admin admin] PATH_INFO: `/v3/users` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:23.499523 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5327d2-c4bb-4fad-b4ad-ba8f085d7ec2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:23.501516 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5327d2-c4bb-4fad-b4ad-ba8f085d7ec2 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:23.509072 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 789/1587] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:24:23 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:24:23.510038 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a215ec-2791-4ff6-afac-97f5146bacad admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:23.521860 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a215ec-2791-4ff6-afac-97f5146bacad admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:23.527295 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 799/1588] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:24:23 2022] POST /identity/v3/users => generated 278 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:24:23.528211 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a917e6a-a183-4406-afe9-1ba93594778b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:23.529051 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5327d2-c4bb-4fad-b4ad-ba8f085d7ec2 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:23.529978 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a917e6a-a183-4406-afe9-1ba93594778b admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:23.530438 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a917e6a-a183-4406-afe9-1ba93594778b admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:23.530771 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a917e6a-a183-4406-afe9-1ba93594778b admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:23.531526 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a917e6a-a183-4406-afe9-1ba93594778b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:23.534021 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a917e6a-a183-4406-afe9-1ba93594778b admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:23.541558 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5327d2-c4bb-4fad-b4ad-ba8f085d7ec2 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:23.547783 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2a46b3-8e26-4905-889f-bf856b1af355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:23.548779 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a46b3-8e26-4905-889f-bf856b1af355 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:23.552680 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 790/1589] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:24:23 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:24:23.552680 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3678712-9dec-4249-afff-58a10034e235 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:23.552680 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3678712-9dec-4249-afff-58a10034e235 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:23.552680 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3678712-9dec-4249-afff-58a10034e235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:23.553989 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a46b3-8e26-4905-889f-bf856b1af355 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:23.554492 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a46b3-8e26-4905-889f-bf856b1af355 admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:23.555506 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2a46b3-8e26-4905-889f-bf856b1af355 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:23.557591 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2a46b3-8e26-4905-889f-bf856b1af355 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:23.571724 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-b3678712-9dec-4249-afff-58a10034e235 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:24:23.572937 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-b3678712-9dec-4249-afff-58a10034e235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:24:23.576274 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 800/1590] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:24:23 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:24:23.577433 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2a46b3-8e26-4905-889f-bf856b1af355 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:23.586999 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 791/1591] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:24:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:24:23.588029 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3678712-9dec-4249-afff-58a10034e235 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:23.599330 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3678712-9dec-4249-afff-58a10034e235 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:23.599935 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2a46b3-8e26-4905-889f-bf856b1af355 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:23.605853 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f1af21-08c7-495b-952b-0332966d2149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:23.607200 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1af21-08c7-495b-952b-0332966d2149 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:23.607532 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1af21-08c7-495b-952b-0332966d2149 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:23.607640 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fbf2ce-d27a-4fa2-a097-95c439129848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:23.607816 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1af21-08c7-495b-952b-0332966d2149 admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:23.608551 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f1af21-08c7-495b-952b-0332966d2149 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:23.608673 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fbf2ce-d27a-4fa2-a097-95c439129848 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:23.610325 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f1af21-08c7-495b-952b-0332966d2149 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:23.610690 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fbf2ce-d27a-4fa2-a097-95c439129848 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:23.611247 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fbf2ce-d27a-4fa2-a097-95c439129848 admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:23.612353 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fbf2ce-d27a-4fa2-a097-95c439129848 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:23.614160 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fbf2ce-d27a-4fa2-a097-95c439129848 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:23.624574 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 801/1592] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:24:23 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:24:23.624574 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f1af21-08c7-495b-952b-0332966d2149 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:23.628859 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 792/1593] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:24:23 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:24:23.628859 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fbf2ce-d27a-4fa2-a097-95c439129848 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:23.634316 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f1af21-08c7-495b-952b-0332966d2149 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:23.641010 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04bfdda-4e8f-4ea4-a31e-190c65b1eb2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:23.641533 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fbf2ce-d27a-4fa2-a097-95c439129848 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:23.641666 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04bfdda-4e8f-4ea4-a31e-190c65b1eb2f admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:23.641953 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04bfdda-4e8f-4ea4-a31e-190c65b1eb2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:23.642225 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04bfdda-4e8f-4ea4-a31e-190c65b1eb2f admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:23.642958 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04bfdda-4e8f-4ea4-a31e-190c65b1eb2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:23.644594 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04bfdda-4e8f-4ea4-a31e-190c65b1eb2f admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:23.648871 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613536c4-c8c1-49da-ba66-60ec8ae64f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:23.649803 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613536c4-c8c1-49da-ba66-60ec8ae64f97 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:23.650504 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613536c4-c8c1-49da-ba66-60ec8ae64f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:23.651382 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613536c4-c8c1-49da-ba66-60ec8ae64f97 admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:23.652724 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613536c4-c8c1-49da-ba66-60ec8ae64f97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:23.654946 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613536c4-c8c1-49da-ba66-60ec8ae64f97 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:23.658223 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 802/1594] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:24:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:24:23.660142 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04bfdda-4e8f-4ea4-a31e-190c65b1eb2f admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:23.669176 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 793/1595] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:24:23 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:24:23.670385 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613536c4-c8c1-49da-ba66-60ec8ae64f97 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:23.674511 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04bfdda-4e8f-4ea4-a31e-190c65b1eb2f admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:23.680675 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea48e5-791f-4250-8166-7f4081f0d4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:23.681231 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613536c4-c8c1-49da-ba66-60ec8ae64f97 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:23.682149 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea48e5-791f-4250-8166-7f4081f0d4a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:23.682651 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea48e5-791f-4250-8166-7f4081f0d4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:23.683257 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea48e5-791f-4250-8166-7f4081f0d4a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:23.684133 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ea48e5-791f-4250-8166-7f4081f0d4a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:23.686625 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ea48e5-791f-4250-8166-7f4081f0d4a2 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:23.688014 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01243e1-4030-4041-b4b2-dbb331e040c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:23.689047 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01243e1-4030-4041-b4b2-dbb331e040c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:23.689500 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01243e1-4030-4041-b4b2-dbb331e040c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:23.689933 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01243e1-4030-4041-b4b2-dbb331e040c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:23.690856 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01243e1-4030-4041-b4b2-dbb331e040c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:23.692752 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01243e1-4030-4041-b4b2-dbb331e040c5 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:23.702690 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 803/1596] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:24:23 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:24:23.702690 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea48e5-791f-4250-8166-7f4081f0d4a2 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:23.709059 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 794/1597] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:24:23 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:24:23.709934 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01243e1-4030-4041-b4b2-dbb331e040c5 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:23.721947 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01243e1-4030-4041-b4b2-dbb331e040c5 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:23.727851 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a077d95-192e-4a8b-ae5b-3c4c96a4254a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:23.728720 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a077d95-192e-4a8b-ae5b-3c4c96a4254a admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:23.729004 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a077d95-192e-4a8b-ae5b-3c4c96a4254a admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:23.729289 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a077d95-192e-4a8b-ae5b-3c4c96a4254a admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:23.730441 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a077d95-192e-4a8b-ae5b-3c4c96a4254a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:23.732368 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a077d95-192e-4a8b-ae5b-3c4c96a4254a admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:23.746616 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 795/1598] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:24:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:24:23.748260 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a077d95-192e-4a8b-ae5b-3c4c96a4254a admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:23.759256 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a077d95-192e-4a8b-ae5b-3c4c96a4254a admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:23.765849 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598ab328-29d8-4140-b2a3-1ea98dbd2069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:23.766711 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ab328-29d8-4140-b2a3-1ea98dbd2069 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:23.767175 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ab328-29d8-4140-b2a3-1ea98dbd2069 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:23.767449 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ab328-29d8-4140-b2a3-1ea98dbd2069 admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:23.768247 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598ab328-29d8-4140-b2a3-1ea98dbd2069 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:23.770063 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598ab328-29d8-4140-b2a3-1ea98dbd2069 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:23.778552 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea48e5-791f-4250-8166-7f4081f0d4a2 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:23.786779 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 796/1599] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:24:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:24:23.786779 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598ab328-29d8-4140-b2a3-1ea98dbd2069 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:23.787039 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39c0b02-e8e1-48fc-9115-0bcd5403b64e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:23.787039 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c0b02-e8e1-48fc-9115-0bcd5403b64e service neutron] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:23.787039 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c0b02-e8e1-48fc-9115-0bcd5403b64e service neutron] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:23.787452 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c0b02-e8e1-48fc-9115-0bcd5403b64e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:23.796390 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598ab328-29d8-4140-b2a3-1ea98dbd2069 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:23.801549 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0061d3a-6366-4911-acbe-9fbb42da8187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:23.802229 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0061d3a-6366-4911-acbe-9fbb42da8187 admin admin] REQUEST_METHOD: `PUT` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:23.802509 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0061d3a-6366-4911-acbe-9fbb42da8187 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:23.802783 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0061d3a-6366-4911-acbe-9fbb42da8187 admin admin] PATH_INFO: `/v3/projects/5fe87375072b4dbbaac833caf2f705aa/users/dee809a4a41f4d2c91edb83c1f4d224c/roles/79f90a0bf6ea43d0b3c434e31556253a` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:23.813350 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39c0b02-e8e1-48fc-9115-0bcd5403b64e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:23.815165 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39c0b02-e8e1-48fc-9115-0bcd5403b64e service neutron] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:23.827794 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 804/1600] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:24:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:24:23.828997 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39c0b02-e8e1-48fc-9115-0bcd5403b64e service neutron] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:23.831162 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0061d3a-6366-4911-acbe-9fbb42da8187 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fe87375072b4dbbaac833caf2f705aa, user_id=dee809a4a41f4d2c91edb83c1f4d224c, role_id=79f90a0bf6ea43d0b3c434e31556253a)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:23.834716 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0061d3a-6366-4911-acbe-9fbb42da8187 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:23.840664 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39c0b02-e8e1-48fc-9115-0bcd5403b64e service neutron] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:23.847908 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f03306-b6c9-4862-9700-29f569c7f428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:23.849439 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f03306-b6c9-4862-9700-29f569c7f428 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:23.849439 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f03306-b6c9-4862-9700-29f569c7f428 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:23.849439 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f03306-b6c9-4862-9700-29f569c7f428 admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:23.849839 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f03306-b6c9-4862-9700-29f569c7f428 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:23.851432 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f03306-b6c9-4862-9700-29f569c7f428 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:23.871373 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 805/1602] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:24:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:24:23.871373 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f03306-b6c9-4862-9700-29f569c7f428 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:23.874001 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 797/1602] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:24:23 2022] PUT /identity/v3/projects/5fe87375072b4dbbaac833caf2f705aa/users/dee809a4a41f4d2c91edb83c1f4d224c/roles/79f90a0bf6ea43d0b3c434e31556253a => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:24:23.875305 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0061d3a-6366-4911-acbe-9fbb42da8187 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:23.892639 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f03306-b6c9-4862-9700-29f569c7f428 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:23.972238 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0061d3a-6366-4911-acbe-9fbb42da8187 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:23.987143 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d2f805-5712-4d3c-8a6c-b037898532eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:23.988267 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2f805-5712-4d3c-8a6c-b037898532eb admin admin] REQUEST_METHOD: `PUT` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:23.988603 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2f805-5712-4d3c-8a6c-b037898532eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:23.988854 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2f805-5712-4d3c-8a6c-b037898532eb admin admin] PATH_INFO: `/v3/projects/3a1d51b40933485d8999170f0567705b/users/a8793b53649e4c688725d53725390119/roles/79f90a0bf6ea43d0b3c434e31556253a` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:24.012124 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d2f805-5712-4d3c-8a6c-b037898532eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a1d51b40933485d8999170f0567705b, user_id=a8793b53649e4c688725d53725390119, role_id=79f90a0bf6ea43d0b3c434e31556253a)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:24.015698 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d2f805-5712-4d3c-8a6c-b037898532eb admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:24.023641 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377d6a69-6ae9-49b3-a890-7d2108d3373e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:24.024675 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d6a69-6ae9-49b3-a890-7d2108d3373e admin admin] REQUEST_METHOD: `PUT` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:24.025037 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d6a69-6ae9-49b3-a890-7d2108d3373e admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:24.025285 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d6a69-6ae9-49b3-a890-7d2108d3373e admin admin] PATH_INFO: `/v3/projects/f579878e20bc40d282c9c38200581b98/users/38716aefb55246079de2658159fd5ca4/roles/79f90a0bf6ea43d0b3c434e31556253a` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:24.042277 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 798/1603] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:24:23 2022] PUT /identity/v3/projects/3a1d51b40933485d8999170f0567705b/users/a8793b53649e4c688725d53725390119/roles/79f90a0bf6ea43d0b3c434e31556253a => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:24:24.043668 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d2f805-5712-4d3c-8a6c-b037898532eb admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:24.058832 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377d6a69-6ae9-49b3-a890-7d2108d3373e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f579878e20bc40d282c9c38200581b98, user_id=38716aefb55246079de2658159fd5ca4, role_id=79f90a0bf6ea43d0b3c434e31556253a)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:24.066150 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377d6a69-6ae9-49b3-a890-7d2108d3373e admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:24.099048 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 806/1604] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:24:23 2022] PUT /identity/v3/projects/f579878e20bc40d282c9c38200581b98/users/38716aefb55246079de2658159fd5ca4/roles/79f90a0bf6ea43d0b3c434e31556253a => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:24:24.100190 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377d6a69-6ae9-49b3-a890-7d2108d3373e admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:24.188934 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d2f805-5712-4d3c-8a6c-b037898532eb admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:24.190532 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377d6a69-6ae9-49b3-a890-7d2108d3373e admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:24.197877 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f2aaa3-eb17-4209-b9bb-bf332996674a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:24.199179 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f2aaa3-eb17-4209-b9bb-bf332996674a admin admin] REQUEST_METHOD: `PUT` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:24.199706 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f2aaa3-eb17-4209-b9bb-bf332996674a admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:24.201007 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f2aaa3-eb17-4209-b9bb-bf332996674a admin admin] PATH_INFO: `/v3/projects/4a703048ebbc44d497f95e1c5e221875/users/d2608eb3457640fc9858ce38ce943947/roles/79f90a0bf6ea43d0b3c434e31556253a` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:24.201914 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc90dffb-d215-4a65-ac31-75b1dc43e95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:24.203104 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc90dffb-d215-4a65-ac31-75b1dc43e95f admin admin] REQUEST_METHOD: `PUT` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:24.203559 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc90dffb-d215-4a65-ac31-75b1dc43e95f admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:24.203943 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc90dffb-d215-4a65-ac31-75b1dc43e95f admin admin] PATH_INFO: `/v3/projects/b9825a892fe14e409eb97a504d3c8b92/users/c6ed7ee782974e199e6202aca7b6e9e3/roles/79f90a0bf6ea43d0b3c434e31556253a` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:24.224314 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f2aaa3-eb17-4209-b9bb-bf332996674a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a703048ebbc44d497f95e1c5e221875, user_id=d2608eb3457640fc9858ce38ce943947, role_id=79f90a0bf6ea43d0b3c434e31556253a)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:24.227500 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f2aaa3-eb17-4209-b9bb-bf332996674a admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:24.239308 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc90dffb-d215-4a65-ac31-75b1dc43e95f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9825a892fe14e409eb97a504d3c8b92, user_id=c6ed7ee782974e199e6202aca7b6e9e3, role_id=79f90a0bf6ea43d0b3c434e31556253a)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:24.242677 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc90dffb-d215-4a65-ac31-75b1dc43e95f admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:24.252436 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 799/1605] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:24:24 2022] PUT /identity/v3/projects/4a703048ebbc44d497f95e1c5e221875/users/d2608eb3457640fc9858ce38ce943947/roles/79f90a0bf6ea43d0b3c434e31556253a => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:24:24.253923 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f2aaa3-eb17-4209-b9bb-bf332996674a admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:24.277547 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 807/1606] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:24:24 2022] PUT /identity/v3/projects/b9825a892fe14e409eb97a504d3c8b92/users/c6ed7ee782974e199e6202aca7b6e9e3/roles/79f90a0bf6ea43d0b3c434e31556253a => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:24:24.279798 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83525b67-5307-4b92-9944-620ae53d08b7 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:24.280379 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83525b67-5307-4b92-9944-620ae53d08b7 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:24.281597 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83525b67-5307-4b92-9944-620ae53d08b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:24.307816 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-83525b67-5307-4b92-9944-620ae53d08b7 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:24:24.310351 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-83525b67-5307-4b92-9944-620ae53d08b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:24:24.348873 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f2aaa3-eb17-4209-b9bb-bf332996674a admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:24.395615 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 808/1607] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:24:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:24:24.398523 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197b3ed-58a3-44b3-87c8-548ab39fa000 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:24.400618 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197b3ed-58a3-44b3-87c8-548ab39fa000 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:24.400981 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197b3ed-58a3-44b3-87c8-548ab39fa000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:24.433799 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21c82ba-cb29-4a93-afe3-53b9eed7373d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:24.439614 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c82ba-cb29-4a93-afe3-53b9eed7373d admin admin] REQUEST_METHOD: `PUT` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:24.440032 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c82ba-cb29-4a93-afe3-53b9eed7373d admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:24.441071 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c82ba-cb29-4a93-afe3-53b9eed7373d admin admin] PATH_INFO: `/v3/projects/cbc55eab146c40fe9aa70847ab9406c4/users/a269ec312d224e1bb8dde565d24f4f71/roles/79f90a0bf6ea43d0b3c434e31556253a` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:24.458136 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21c82ba-cb29-4a93-afe3-53b9eed7373d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbc55eab146c40fe9aa70847ab9406c4, user_id=a269ec312d224e1bb8dde565d24f4f71, role_id=79f90a0bf6ea43d0b3c434e31556253a)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:24.461468 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21c82ba-cb29-4a93-afe3-53b9eed7373d admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:24.471962 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-8197b3ed-58a3-44b3-87c8-548ab39fa000 None None] MFA Rules not processed for user `a8793b53649e4c688725d53725390119`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:24:24.479169 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-8197b3ed-58a3-44b3-87c8-548ab39fa000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:24:24.506636 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 800/1608] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:24:24 2022] PUT /identity/v3/projects/cbc55eab146c40fe9aa70847ab9406c4/users/a269ec312d224e1bb8dde565d24f4f71/roles/79f90a0bf6ea43d0b3c434e31556253a => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:24:24.511021 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860dbe1e-466a-4b92-9d1f-3e125cec6ef8 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:24.515046 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860dbe1e-466a-4b92-9d1f-3e125cec6ef8 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:24.516495 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860dbe1e-466a-4b92-9d1f-3e125cec6ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:24.540455 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-860dbe1e-466a-4b92-9d1f-3e125cec6ef8 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:24:24.541478 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-860dbe1e-466a-4b92-9d1f-3e125cec6ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:24:24.577608 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 809/1609] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:24:24 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:24:24.579786 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8810d91-d3f8-4eb6-9014-dd26880ef042 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:24.580893 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8810d91-d3f8-4eb6-9014-dd26880ef042 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:24.581387 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8810d91-d3f8-4eb6-9014-dd26880ef042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:24.614165 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-e8810d91-d3f8-4eb6-9014-dd26880ef042 None None] MFA Rules not processed for user `d2608eb3457640fc9858ce38ce943947`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:24:24.616132 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-e8810d91-d3f8-4eb6-9014-dd26880ef042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:24:24.644391 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 801/1610] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:24:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:24:24.644391 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da91ba-7480-4fcc-bcb6-dd88d662fb8c None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:24.644391 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da91ba-7480-4fcc-bcb6-dd88d662fb8c None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:24.644391 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da91ba-7480-4fcc-bcb6-dd88d662fb8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:24.670138 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-10da91ba-7480-4fcc-bcb6-dd88d662fb8c None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:24:24.671937 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-10da91ba-7480-4fcc-bcb6-dd88d662fb8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:24:24.681504 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 802/1611] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:24:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:24:24.683662 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da91ba-7480-4fcc-bcb6-dd88d662fb8c None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:24.719766 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 810/1612] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:24:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:24:24.722218 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d96ac-1a8e-4a51-97d5-40d3516ed298 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:24.722740 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d96ac-1a8e-4a51-97d5-40d3516ed298 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:24.723215 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d96ac-1a8e-4a51-97d5-40d3516ed298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:24.757961 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-601d96ac-1a8e-4a51-97d5-40d3516ed298 None None] MFA Rules not processed for user `a269ec312d224e1bb8dde565d24f4f71`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:24:24.759389 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-601d96ac-1a8e-4a51-97d5-40d3516ed298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:24:24.769287 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da91ba-7480-4fcc-bcb6-dd88d662fb8c None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:24.774485 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b6cf5d-cd0c-4c39-86fe-46422052bfe4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:24.775169 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b6cf5d-cd0c-4c39-86fe-46422052bfe4 service neutron] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:24.775475 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b6cf5d-cd0c-4c39-86fe-46422052bfe4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:24.775753 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b6cf5d-cd0c-4c39-86fe-46422052bfe4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:24.790162 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b6cf5d-cd0c-4c39-86fe-46422052bfe4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:24.792740 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b6cf5d-cd0c-4c39-86fe-46422052bfe4 service neutron] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:24.813807 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 803/1613] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:24:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:24:24.814774 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b6cf5d-cd0c-4c39-86fe-46422052bfe4 service neutron] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:24.829406 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b6cf5d-cd0c-4c39-86fe-46422052bfe4 service neutron] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:24.835677 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08779575-52e3-4da5-8271-52ddfc350fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:24.836425 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08779575-52e3-4da5-8271-52ddfc350fad admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:24.836526 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08779575-52e3-4da5-8271-52ddfc350fad admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:24.836794 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08779575-52e3-4da5-8271-52ddfc350fad admin admin] PATH_INFO: `/v3/projects` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:24.837840 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08779575-52e3-4da5-8271-52ddfc350fad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:24.839982 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08779575-52e3-4da5-8271-52ddfc350fad admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:24.874454 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 804/1614] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:24:24 2022] POST /identity/v3/projects => generated 405 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:24:24.875436 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08779575-52e3-4da5-8271-52ddfc350fad admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:24.883697 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 811/1615] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:24:24 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:24:24.885062 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d96ac-1a8e-4a51-97d5-40d3516ed298 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:24.912754 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d96ac-1a8e-4a51-97d5-40d3516ed298 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:24.980526 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08779575-52e3-4da5-8271-52ddfc350fad admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:24.993172 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d7f46a-efbb-4d81-85f1-8c554bb2d698 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:24.993835 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d7f46a-efbb-4d81-85f1-8c554bb2d698 service neutron] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:24.994112 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d7f46a-efbb-4d81-85f1-8c554bb2d698 service neutron] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:24.994379 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d7f46a-efbb-4d81-85f1-8c554bb2d698 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:25.030139 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a85f8e-ad2c-4791-9539-7daa3c6b3cb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:25.033261 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a85f8e-ad2c-4791-9539-7daa3c6b3cb1 service neutron] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:25.033936 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a85f8e-ad2c-4791-9539-7daa3c6b3cb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:25.035354 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a85f8e-ad2c-4791-9539-7daa3c6b3cb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:25.161515 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a85f8e-ad2c-4791-9539-7daa3c6b3cb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:25.163324 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a85f8e-ad2c-4791-9539-7daa3c6b3cb1 service neutron] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:25.185626 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 812/1616] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:24:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:24:25.187312 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278559ce-4051-4255-8a2f-d85b31e0899c None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:25.187312 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278559ce-4051-4255-8a2f-d85b31e0899c None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:25.190140 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278559ce-4051-4255-8a2f-d85b31e0899c None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:25.195651 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 813/1617] 10.222.0.44 () {54 vars in 961 bytes} [Mon May 9 20:24:25 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:24:25.196599 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278559ce-4051-4255-8a2f-d85b31e0899c None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:25.200485 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d7f46a-efbb-4d81-85f1-8c554bb2d698 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:25.202447 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d7f46a-efbb-4d81-85f1-8c554bb2d698 service neutron] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:25.223629 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 805/1618] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:24:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:24:25.224341 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d7f46a-efbb-4d81-85f1-8c554bb2d698 service neutron] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:25.224524 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278559ce-4051-4255-8a2f-d85b31e0899c None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:25.236704 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f48c4d-03a6-4fa4-970d-5b74ffefdb2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:25.237494 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f48c4d-03a6-4fa4-970d-5b74ffefdb2e admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:25.237758 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f48c4d-03a6-4fa4-970d-5b74ffefdb2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:25.238025 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f48c4d-03a6-4fa4-970d-5b74ffefdb2e admin admin] PATH_INFO: `/v3/users` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:25.238432 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d7f46a-efbb-4d81-85f1-8c554bb2d698 service neutron] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:25.238716 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f48c4d-03a6-4fa4-970d-5b74ffefdb2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:25.240697 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f48c4d-03a6-4fa4-970d-5b74ffefdb2e admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:25.250825 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc85058-ec41-41f7-8f51-70a7c0bd9b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:25.251929 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc85058-ec41-41f7-8f51-70a7c0bd9b49 admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:25.251929 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc85058-ec41-41f7-8f51-70a7c0bd9b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:25.252187 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc85058-ec41-41f7-8f51-70a7c0bd9b49 admin admin] PATH_INFO: `/v3/projects` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:25.252732 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc85058-ec41-41f7-8f51-70a7c0bd9b49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:25.254672 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc85058-ec41-41f7-8f51-70a7c0bd9b49 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:25.288937 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 814/1619] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:24:25 2022] POST /identity/v3/users => generated 309 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:24:25.288937 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24060df3-74d3-409c-ad3d-4e0fe5b6ba3e None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:25.288937 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24060df3-74d3-409c-ad3d-4e0fe5b6ba3e None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:25.288937 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24060df3-74d3-409c-ad3d-4e0fe5b6ba3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:25.310869 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 806/1620] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:24:25 2022] POST /identity/v3/projects => generated 357 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:24:25.311786 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc85058-ec41-41f7-8f51-70a7c0bd9b49 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:25.335670 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-24060df3-74d3-409c-ad3d-4e0fe5b6ba3e None None] MFA Rules not processed for user `eb59440b21074d9da15679dc2d745f72`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:24:25.336900 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-24060df3-74d3-409c-ad3d-4e0fe5b6ba3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:24:25.456495 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc85058-ec41-41f7-8f51-70a7c0bd9b49 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:25.467129 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad124ef-3e66-4f77-ba96-9d4a91a2b224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:25.468175 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad124ef-3e66-4f77-ba96-9d4a91a2b224 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:25.468444 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad124ef-3e66-4f77-ba96-9d4a91a2b224 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:25.468712 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad124ef-3e66-4f77-ba96-9d4a91a2b224 admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:25.469439 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad124ef-3e66-4f77-ba96-9d4a91a2b224 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:25.471061 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad124ef-3e66-4f77-ba96-9d4a91a2b224 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:25.503631 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 807/1621] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:24:25 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:24:25.503631 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad124ef-3e66-4f77-ba96-9d4a91a2b224 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:25.520262 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 815/1622] 10.222.0.44 () {58 vars in 1058 bytes} [Mon May 9 20:24:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:24:25.521607 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24060df3-74d3-409c-ad3d-4e0fe5b6ba3e None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:25.532564 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad124ef-3e66-4f77-ba96-9d4a91a2b224 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:25.546176 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5de5a10-c4f1-4327-9beb-31ac1dbb7dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:25.546860 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de5a10-c4f1-4327-9beb-31ac1dbb7dc1 admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:25.547067 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24060df3-74d3-409c-ad3d-4e0fe5b6ba3e None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:25.549589 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de5a10-c4f1-4327-9beb-31ac1dbb7dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:25.549589 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de5a10-c4f1-4327-9beb-31ac1dbb7dc1 admin admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:25.549850 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5de5a10-c4f1-4327-9beb-31ac1dbb7dc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:25.552792 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5de5a10-c4f1-4327-9beb-31ac1dbb7dc1 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:25.560158 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dbb65f-0e5e-4109-ae80-1480b1e44a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:25.561470 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dbb65f-0e5e-4109-ae80-1480b1e44a11 admin admin] REQUEST_METHOD: `PUT` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:25.561837 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dbb65f-0e5e-4109-ae80-1480b1e44a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:25.562117 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dbb65f-0e5e-4109-ae80-1480b1e44a11 admin admin] PATH_INFO: `/v3/projects/9f8f2db15f24407eb097c653027de016/users/ab8f26e277d34a7fa7c9541e2a68e704/roles/274130b78e304bb88789c1b349263f3c` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:25.604955 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 808/1623] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:24:25 2022] POST /identity/v3/users => generated 285 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:24:25.605165 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dbb65f-0e5e-4109-ae80-1480b1e44a11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f8f2db15f24407eb097c653027de016, user_id=ab8f26e277d34a7fa7c9541e2a68e704, role_id=274130b78e304bb88789c1b349263f3c)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:25.607075 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5de5a10-c4f1-4327-9beb-31ac1dbb7dc1 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:25.612254 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dbb65f-0e5e-4109-ae80-1480b1e44a11 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:25.638372 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5de5a10-c4f1-4327-9beb-31ac1dbb7dc1 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:25.639821 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 816/1624] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:24:25 2022] PUT /identity/v3/projects/9f8f2db15f24407eb097c653027de016/users/ab8f26e277d34a7fa7c9541e2a68e704/roles/274130b78e304bb88789c1b349263f3c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:24:25.641728 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dbb65f-0e5e-4109-ae80-1480b1e44a11 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:25.746191 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defd3e3c-df7f-4988-a383-5211f79071fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb59440b21074d9da15679dc2d745f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:25.748035 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd3e3c-df7f-4988-a383-5211f79071fa service nova] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:25.748327 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd3e3c-df7f-4988-a383-5211f79071fa service nova] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:25.748594 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd3e3c-df7f-4988-a383-5211f79071fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:25.777334 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dbb65f-0e5e-4109-ae80-1480b1e44a11 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:25.786828 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a9ab62-9a95-46ab-bc6c-f6950fb14c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:25.788731 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a9ab62-9a95-46ab-bc6c-f6950fb14c22 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:25.789150 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a9ab62-9a95-46ab-bc6c-f6950fb14c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:25.789765 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a9ab62-9a95-46ab-bc6c-f6950fb14c22 admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:25.791628 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a9ab62-9a95-46ab-bc6c-f6950fb14c22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:25.795442 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a9ab62-9a95-46ab-bc6c-f6950fb14c22 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:25.820039 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 817/1625] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:24:25 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:24:25.824619 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a9ab62-9a95-46ab-bc6c-f6950fb14c22 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:25.838560 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a9ab62-9a95-46ab-bc6c-f6950fb14c22 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:25.846260 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7143e671-ab84-428b-a97b-8652f01be49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:25.846955 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7143e671-ab84-428b-a97b-8652f01be49d admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:25.847238 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7143e671-ab84-428b-a97b-8652f01be49d admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:25.847591 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7143e671-ab84-428b-a97b-8652f01be49d admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:25.848391 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7143e671-ab84-428b-a97b-8652f01be49d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:25.851342 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7143e671-ab84-428b-a97b-8652f01be49d admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:25.869082 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 818/1626] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:24:25 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:24:25.869639 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defd3e3c-df7f-4988-a383-5211f79071fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:25.870128 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7143e671-ab84-428b-a97b-8652f01be49d admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:25.871436 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defd3e3c-df7f-4988-a383-5211f79071fa service nova] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:25.888086 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7143e671-ab84-428b-a97b-8652f01be49d admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:25.895854 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5616303-7171-426a-8f9f-f28fe8322fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:25.897082 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 809/1627] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:24:25 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:24:25.897947 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defd3e3c-df7f-4988-a383-5211f79071fa service nova] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:25.910538 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5616303-7171-426a-8f9f-f28fe8322fc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:25.911325 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5616303-7171-426a-8f9f-f28fe8322fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:25.913997 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5616303-7171-426a-8f9f-f28fe8322fc1 admin admin] PATH_INFO: `/v3/projects/8449a3c0d42644b9a71f3b44527357ae/users/3cc050c3efa84c51a2449831b75255e8/roles/274130b78e304bb88789c1b349263f3c` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:25.916797 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defd3e3c-df7f-4988-a383-5211f79071fa service nova] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:25.926136 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31856a8-ccf6-4c51-a859-c51d7e1a721c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:25.926963 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31856a8-ccf6-4c51-a859-c51d7e1a721c admin admin] REQUEST_METHOD: `PUT` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:25.927240 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31856a8-ccf6-4c51-a859-c51d7e1a721c admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:25.927533 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31856a8-ccf6-4c51-a859-c51d7e1a721c admin admin] PATH_INFO: `/v3/projects/9f8f2db15f24407eb097c653027de016/users/ab8f26e277d34a7fa7c9541e2a68e704/roles/274130b78e304bb88789c1b349263f3c` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:25.936269 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5616303-7171-426a-8f9f-f28fe8322fc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8449a3c0d42644b9a71f3b44527357ae, user_id=3cc050c3efa84c51a2449831b75255e8, role_id=274130b78e304bb88789c1b349263f3c)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:25.939679 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5616303-7171-426a-8f9f-f28fe8322fc1 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:25.940896 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31856a8-ccf6-4c51-a859-c51d7e1a721c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f8f2db15f24407eb097c653027de016, user_id=ab8f26e277d34a7fa7c9541e2a68e704, role_id=274130b78e304bb88789c1b349263f3c)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:25.943562 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31856a8-ccf6-4c51-a859-c51d7e1a721c admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:25.961978 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 810/1629] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:24:25 2022] PUT /identity/v3/projects/9f8f2db15f24407eb097c653027de016/users/ab8f26e277d34a7fa7c9541e2a68e704/roles/274130b78e304bb88789c1b349263f3c => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:24:25.962377 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 819/1629] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:24:25 2022] PUT /identity/v3/projects/8449a3c0d42644b9a71f3b44527357ae/users/3cc050c3efa84c51a2449831b75255e8/roles/274130b78e304bb88789c1b349263f3c => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:24:25.971979 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31856a8-ccf6-4c51-a859-c51d7e1a721c admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:25.973930 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea39864-c631-4ffe-8fe9-d28898a8f3c4 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:25.974161 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea39864-c631-4ffe-8fe9-d28898a8f3c4 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:25.974425 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea39864-c631-4ffe-8fe9-d28898a8f3c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:26.054439 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-fea39864-c631-4ffe-8fe9-d28898a8f3c4 None None] MFA Rules not processed for user `ab8f26e277d34a7fa7c9541e2a68e704`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:24:26.055735 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-fea39864-c631-4ffe-8fe9-d28898a8f3c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:24:26.142566 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31856a8-ccf6-4c51-a859-c51d7e1a721c admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:26.157256 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630c9a48-85a5-4d1c-b3e9-6a2b8359bdf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:26.158470 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c9a48-85a5-4d1c-b3e9-6a2b8359bdf2 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:26.159175 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c9a48-85a5-4d1c-b3e9-6a2b8359bdf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:26.159716 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c9a48-85a5-4d1c-b3e9-6a2b8359bdf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:26.160680 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630c9a48-85a5-4d1c-b3e9-6a2b8359bdf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:26.162741 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630c9a48-85a5-4d1c-b3e9-6a2b8359bdf2 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:26.196813 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 820/1630] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:24:25 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:24:26.209506 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea39864-c631-4ffe-8fe9-d28898a8f3c4 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:26.211234 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 811/1631] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:24:25 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:24:26.212273 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630c9a48-85a5-4d1c-b3e9-6a2b8359bdf2 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:26.234875 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630c9a48-85a5-4d1c-b3e9-6a2b8359bdf2 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:26.261548 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bbd049-7e75-462a-bf45-0a1ba2faa2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:26.263469 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bbd049-7e75-462a-bf45-0a1ba2faa2c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:26.263799 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bbd049-7e75-462a-bf45-0a1ba2faa2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:26.264098 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bbd049-7e75-462a-bf45-0a1ba2faa2c0 admin admin] PATH_INFO: `/v3/projects/8449a3c0d42644b9a71f3b44527357ae/users/3cc050c3efa84c51a2449831b75255e8/roles/274130b78e304bb88789c1b349263f3c` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:26.275749 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bbd049-7e75-462a-bf45-0a1ba2faa2c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8449a3c0d42644b9a71f3b44527357ae, user_id=3cc050c3efa84c51a2449831b75255e8, role_id=274130b78e304bb88789c1b349263f3c)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:26.278968 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bbd049-7e75-462a-bf45-0a1ba2faa2c0 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:26.284231 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea39864-c631-4ffe-8fe9-d28898a8f3c4 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:26.293420 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47355d5-5e68-4029-bb3f-7622bb185182 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d65e731386d44948dcc1ecd40cbda65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:26.295004 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47355d5-5e68-4029-bb3f-7622bb185182 service cinder] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:26.295346 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47355d5-5e68-4029-bb3f-7622bb185182 service cinder] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:26.295804 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47355d5-5e68-4029-bb3f-7622bb185182 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:26.310707 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47355d5-5e68-4029-bb3f-7622bb185182 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:26.313939 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47355d5-5e68-4029-bb3f-7622bb185182 service cinder] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:26.323146 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 812/1632] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:24:26 2022] PUT /identity/v3/projects/8449a3c0d42644b9a71f3b44527357ae/users/3cc050c3efa84c51a2449831b75255e8/roles/274130b78e304bb88789c1b349263f3c => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:24:26.339713 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ef102-3f96-4c16-9b6c-9249b247fcb4 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:26.340110 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ef102-3f96-4c16-9b6c-9249b247fcb4 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:26.340433 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ef102-3f96-4c16-9b6c-9249b247fcb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:26.354028 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 821/1633] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:24:26 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:24:26.441665 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-a87ef102-3f96-4c16-9b6c-9249b247fcb4 None None] MFA Rules not processed for user `3cc050c3efa84c51a2449831b75255e8`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:24:26.442920 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-a87ef102-3f96-4c16-9b6c-9249b247fcb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:24:26.704370 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 813/1634] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:24:26 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:24:26.716823 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47355d5-5e68-4029-bb3f-7622bb185182 service cinder] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:26.736503 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47355d5-5e68-4029-bb3f-7622bb185182 service cinder] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:26.755355 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ef102-3f96-4c16-9b6c-9249b247fcb4 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:26.930015 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc2730-da17-43d2-a2e3-0bdf51c8c4c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d65e731386d44948dcc1ecd40cbda65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:26.930015 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc2730-da17-43d2-a2e3-0bdf51c8c4c1 service cinder] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:26.930015 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc2730-da17-43d2-a2e3-0bdf51c8c4c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:26.930564 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc2730-da17-43d2-a2e3-0bdf51c8c4c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:26.955629 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfc2730-da17-43d2-a2e3-0bdf51c8c4c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:26.962243 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfc2730-da17-43d2-a2e3-0bdf51c8c4c1 service cinder] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:26.990660 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ef102-3f96-4c16-9b6c-9249b247fcb4 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:26.992224 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 822/1635] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:24:26 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:24:27.008662 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9573512a-f93a-43c7-b5e7-5014c3bc0527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:27.012566 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9573512a-f93a-43c7-b5e7-5014c3bc0527 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:27.014930 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9573512a-f93a-43c7-b5e7-5014c3bc0527 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:27.016521 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9573512a-f93a-43c7-b5e7-5014c3bc0527 admin admin] PATH_INFO: `/v3/users/a8793b53649e4c688725d53725390119` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:27.020445 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9573512a-f93a-43c7-b5e7-5014c3bc0527 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8793b53649e4c688725d53725390119)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:27.023341 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: WARNING py.warnings [None req-9573512a-f93a-43c7-b5e7-5014c3bc0527 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 09 20:24:27.023341 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: warnings.warn(msg) May 09 20:24:27.023341 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: May 09 20:24:27.026721 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9573512a-f93a-43c7-b5e7-5014c3bc0527 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:27.049986 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e775b-e647-4690-b683-66d342290c2e None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:27.050750 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e775b-e647-4690-b683-66d342290c2e None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:27.051053 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e775b-e647-4690-b683-66d342290c2e None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:27.054103 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 823/1636] 10.222.0.44 () {54 vars in 961 bytes} [Mon May 9 20:24:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:24:27.061987 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee231af-8ce6-4c7e-9752-24f75a788e71 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:27.062293 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee231af-8ce6-4c7e-9752-24f75a788e71 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:27.062553 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee231af-8ce6-4c7e-9752-24f75a788e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:27.091005 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-8ee231af-8ce6-4c7e-9752-24f75a788e71 None None] MFA Rules not processed for user `eb59440b21074d9da15679dc2d745f72`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:24:27.092562 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-8ee231af-8ce6-4c7e-9752-24f75a788e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:24:27.197144 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 824/1637] 10.222.0.44 () {58 vars in 1058 bytes} [Mon May 9 20:24:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:24:27.198041 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee231af-8ce6-4c7e-9752-24f75a788e71 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:27.210877 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee231af-8ce6-4c7e-9752-24f75a788e71 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:27.221866 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0a3b07-84f4-454b-9528-35008325208e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d65e731386d44948dcc1ecd40cbda65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:27.223764 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a3b07-84f4-454b-9528-35008325208e service cinder] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:27.224048 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a3b07-84f4-454b-9528-35008325208e service cinder] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:27.224324 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a3b07-84f4-454b-9528-35008325208e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:27.248601 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-9573512a-f93a-43c7-b5e7-5014c3bc0527 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8793b53649e4c688725d53725390119'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:24:27.281090 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-9573512a-f93a-43c7-b5e7-5014c3bc0527 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8793b53649e4c688725d53725390119'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:24:27.298127 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-9573512a-f93a-43c7-b5e7-5014c3bc0527 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8793b53649e4c688725d53725390119'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:24:27.298894 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-9573512a-f93a-43c7-b5e7-5014c3bc0527 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8793b53649e4c688725d53725390119'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:24:27.299624 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-9573512a-f93a-43c7-b5e7-5014c3bc0527 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8793b53649e4c688725d53725390119'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:24:27.364145 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 814/1638] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:24:26 2022] DELETE /identity/v3/users/a8793b53649e4c688725d53725390119 => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:24:27.368315 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d27d9c-8b43-4c69-8b54-5338dd12473d None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:27.368625 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d27d9c-8b43-4c69-8b54-5338dd12473d None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:27.368952 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d27d9c-8b43-4c69-8b54-5338dd12473d None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:27.373286 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 815/1639] 10.222.0.44 () {54 vars in 912 bytes} [Mon May 9 20:24:27 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:24:27.376418 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d94849-3da8-4e2d-aad5-2e9cde287f35 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:27.377127 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d94849-3da8-4e2d-aad5-2e9cde287f35 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:27.377457 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d94849-3da8-4e2d-aad5-2e9cde287f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:27.397074 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0a3b07-84f4-454b-9528-35008325208e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:27.399302 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0a3b07-84f4-454b-9528-35008325208e service cinder] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:27.422370 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 825/1640] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:24:27 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:24:27.423992 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c59ccea-b366-4184-a6c8-ccc60defe141 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:27.424461 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c59ccea-b366-4184-a6c8-ccc60defe141 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:27.424904 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c59ccea-b366-4184-a6c8-ccc60defe141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:27.436965 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-74d94849-3da8-4e2d-aad5-2e9cde287f35 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:24:27.439968 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-74d94849-3da8-4e2d-aad5-2e9cde287f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:24:27.479004 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-3c59ccea-b366-4184-a6c8-ccc60defe141 None None] MFA Rules not processed for user `eb59440b21074d9da15679dc2d745f72`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:24:27.486652 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-3c59ccea-b366-4184-a6c8-ccc60defe141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:24:27.614509 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 816/1641] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:24:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:24:27.644936 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d94849-3da8-4e2d-aad5-2e9cde287f35 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:27.646792 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-74d94849-3da8-4e2d-aad5-2e9cde287f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:24:27.693052 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 826/1642] 10.222.0.44 () {58 vars in 1009 bytes} [Mon May 9 20:24:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:24:27.698535 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c59ccea-b366-4184-a6c8-ccc60defe141 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:27.701410 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-3c59ccea-b366-4184-a6c8-ccc60defe141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:24:27.752618 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d94849-3da8-4e2d-aad5-2e9cde287f35 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:27.777039 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1a1d5d-b343-47ad-a0e4-7baba39b98fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:27.778040 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a1d5d-b343-47ad-a0e4-7baba39b98fb service neutron] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:27.778769 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a1d5d-b343-47ad-a0e4-7baba39b98fb service neutron] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:27.779742 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a1d5d-b343-47ad-a0e4-7baba39b98fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:27.813541 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1a1d5d-b343-47ad-a0e4-7baba39b98fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:27.817889 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1a1d5d-b343-47ad-a0e4-7baba39b98fb service neutron] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:27.841454 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 817/1643] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:24:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:24:27.895310 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c59ccea-b366-4184-a6c8-ccc60defe141 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:27.911797 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939ff5e3-1b58-4b3f-95ef-3bf2aca07855 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d65e731386d44948dcc1ecd40cbda65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:27.924077 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ff5e3-1b58-4b3f-95ef-3bf2aca07855 service cinder] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:27.924791 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ff5e3-1b58-4b3f-95ef-3bf2aca07855 service cinder] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:27.925275 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ff5e3-1b58-4b3f-95ef-3bf2aca07855 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:27.941644 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939ff5e3-1b58-4b3f-95ef-3bf2aca07855 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:27.943789 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939ff5e3-1b58-4b3f-95ef-3bf2aca07855 service cinder] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:27.958721 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 827/1644] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:24:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 09 20:24:27.978287 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44e120-a457-4bd7-a929-53e2a23a2ab1 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:27.978619 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44e120-a457-4bd7-a929-53e2a23a2ab1 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:27.979066 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44e120-a457-4bd7-a929-53e2a23a2ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:28.018658 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-5c44e120-a457-4bd7-a929-53e2a23a2ab1 None None] MFA Rules not processed for user `c6ed7ee782974e199e6202aca7b6e9e3`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:24:28.020335 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-5c44e120-a457-4bd7-a929-53e2a23a2ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:24:28.133160 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 818/1645] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:24:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:24:28.147281 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7defc7-c1ec-4e49-86e5-c0d9b1bd1c17 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:28.147931 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7defc7-c1ec-4e49-86e5-c0d9b1bd1c17 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:28.148475 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7defc7-c1ec-4e49-86e5-c0d9b1bd1c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:28.191186 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-0a7defc7-c1ec-4e49-86e5-c0d9b1bd1c17 None None] MFA Rules not processed for user `c6ed7ee782974e199e6202aca7b6e9e3`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:24:28.197402 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-0a7defc7-c1ec-4e49-86e5-c0d9b1bd1c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:24:28.237971 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 828/1646] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:24:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:24:28.243805 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c44e120-a457-4bd7-a929-53e2a23a2ab1 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:28.245374 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-5c44e120-a457-4bd7-a929-53e2a23a2ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:24:28.274054 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c44e120-a457-4bd7-a929-53e2a23a2ab1 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:28.287665 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0d3a3b-bf15-4312-b853-6670e444f674 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb59440b21074d9da15679dc2d745f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:28.288352 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d3a3b-bf15-4312-b853-6670e444f674 service nova] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:28.288637 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d3a3b-bf15-4312-b853-6670e444f674 service nova] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:28.288910 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d3a3b-bf15-4312-b853-6670e444f674 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:28.302862 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0d3a3b-bf15-4312-b853-6670e444f674 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:28.304481 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0d3a3b-bf15-4312-b853-6670e444f674 service nova] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:28.329416 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 819/1647] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:24:28 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:24:28.411375 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c115fd95-f108-46de-afba-2fe50a47de8a None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:28.411711 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c115fd95-f108-46de-afba-2fe50a47de8a None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:28.411968 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c115fd95-f108-46de-afba-2fe50a47de8a None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:28.413636 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 829/1648] 10.222.0.44 () {54 vars in 912 bytes} [Mon May 9 20:24:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:24:28.420682 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78502f0-950b-4565-9914-ff7a9fc5f08a None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:28.420991 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78502f0-950b-4565-9914-ff7a9fc5f08a None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:28.421969 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78502f0-950b-4565-9914-ff7a9fc5f08a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:28.444446 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-d78502f0-950b-4565-9914-ff7a9fc5f08a None None] MFA Rules not processed for user `eb59440b21074d9da15679dc2d745f72`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:24:28.446793 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-d78502f0-950b-4565-9914-ff7a9fc5f08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:24:28.477352 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 820/1649] 10.222.0.44 () {58 vars in 1009 bytes} [Mon May 9 20:24:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:24:28.478575 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c115fd95-f108-46de-afba-2fe50a47de8a None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:28.480871 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-c115fd95-f108-46de-afba-2fe50a47de8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:24:28.666410 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c115fd95-f108-46de-afba-2fe50a47de8a None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:28.666628 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78502f0-950b-4565-9914-ff7a9fc5f08a None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:28.668326 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-d78502f0-950b-4565-9914-ff7a9fc5f08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:24:28.670736 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef42146-a099-4587-8ad8-831ef7b54d41 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65db5d9a86fd48acb5874df0165c0ef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:28.671482 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef42146-a099-4587-8ad8-831ef7b54d41 service glance] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:28.671712 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef42146-a099-4587-8ad8-831ef7b54d41 service glance] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:28.671987 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef42146-a099-4587-8ad8-831ef7b54d41 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:28.695476 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78502f0-950b-4565-9914-ff7a9fc5f08a None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:28.699989 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef42146-a099-4587-8ad8-831ef7b54d41 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:28.702416 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef42146-a099-4587-8ad8-831ef7b54d41 service glance] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:28.710096 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defd1d08-46f2-4dc8-8988-e94adc287088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:28.711386 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd1d08-46f2-4dc8-8988-e94adc287088 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:28.711857 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd1d08-46f2-4dc8-8988-e94adc287088 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:28.712278 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd1d08-46f2-4dc8-8988-e94adc287088 admin admin] PATH_INFO: `/v3/users/d2608eb3457640fc9858ce38ce943947` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:28.715993 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defd1d08-46f2-4dc8-8988-e94adc287088 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2608eb3457640fc9858ce38ce943947)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:28.726354 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 830/1650] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:24:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:24:28.726715 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defd1d08-46f2-4dc8-8988-e94adc287088 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:28.837414 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-defd1d08-46f2-4dc8-8988-e94adc287088 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2608eb3457640fc9858ce38ce943947'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:24:28.854650 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-defd1d08-46f2-4dc8-8988-e94adc287088 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2608eb3457640fc9858ce38ce943947'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:24:28.868604 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-defd1d08-46f2-4dc8-8988-e94adc287088 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2608eb3457640fc9858ce38ce943947'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:24:28.869738 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-defd1d08-46f2-4dc8-8988-e94adc287088 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2608eb3457640fc9858ce38ce943947'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:24:28.870490 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-defd1d08-46f2-4dc8-8988-e94adc287088 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2608eb3457640fc9858ce38ce943947'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:24:28.912706 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 821/1651] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:24:28 2022] DELETE /identity/v3/users/d2608eb3457640fc9858ce38ce943947 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:24:28.919530 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9265db-4eed-40bf-a05a-efbfd28d87fb None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:28.920121 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9265db-4eed-40bf-a05a-efbfd28d87fb None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:28.920121 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9265db-4eed-40bf-a05a-efbfd28d87fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:28.957919 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-5f9265db-4eed-40bf-a05a-efbfd28d87fb None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:24:28.958568 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-5f9265db-4eed-40bf-a05a-efbfd28d87fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:24:29.151020 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 831/1652] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:24:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:24:29.182900 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defd1d08-46f2-4dc8-8988-e94adc287088 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:29.184390 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-defd1d08-46f2-4dc8-8988-e94adc287088 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:24:29.384501 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defd1d08-46f2-4dc8-8988-e94adc287088 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:29.392181 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeea743-607b-4554-a8c3-129f5070eaa9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:29.392869 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeea743-607b-4554-a8c3-129f5070eaa9 service neutron] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:29.393208 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeea743-607b-4554-a8c3-129f5070eaa9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:29.393518 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeea743-607b-4554-a8c3-129f5070eaa9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:29.429587 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeea743-607b-4554-a8c3-129f5070eaa9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:29.431351 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeea743-607b-4554-a8c3-129f5070eaa9 service neutron] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:29.458255 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 822/1653] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:24:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:24:29.520056 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e0283-2f01-4786-8c90-f178b6efc756 None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:29.520547 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e0283-2f01-4786-8c90-f178b6efc756 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:29.524271 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e0283-2f01-4786-8c90-f178b6efc756 None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:29.529693 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 832/1654] 10.222.0.44 () {54 vars in 912 bytes} [Mon May 9 20:24:29 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:24:29.536031 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7325b9e-d45f-4071-8dd7-1d8e12d81c08 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:29.536377 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7325b9e-d45f-4071-8dd7-1d8e12d81c08 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:29.536902 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7325b9e-d45f-4071-8dd7-1d8e12d81c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:29.601379 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-a7325b9e-d45f-4071-8dd7-1d8e12d81c08 None None] MFA Rules not processed for user `b2a13ad25f27471792ba0758602b6e63`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:24:29.603577 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-a7325b9e-d45f-4071-8dd7-1d8e12d81c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:24:29.625796 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 823/1655] 10.222.0.44 () {58 vars in 1009 bytes} [Mon May 9 20:24:29 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:24:29.650009 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431e0283-2f01-4786-8c90-f178b6efc756 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:29.651837 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-431e0283-2f01-4786-8c90-f178b6efc756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:24:29.672914 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431e0283-2f01-4786-8c90-f178b6efc756 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:29.678076 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f8cb5f-ce4e-47e3-82d9-88e3a45ae5fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:29.678933 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f8cb5f-ce4e-47e3-82d9-88e3a45ae5fa service neutron] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:29.679574 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f8cb5f-ce4e-47e3-82d9-88e3a45ae5fa service neutron] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:29.680025 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f8cb5f-ce4e-47e3-82d9-88e3a45ae5fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:29.723787 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f8cb5f-ce4e-47e3-82d9-88e3a45ae5fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:29.725242 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f8cb5f-ce4e-47e3-82d9-88e3a45ae5fa service neutron] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:29.752411 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 833/1656] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:24:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:24:30.114890 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7325b9e-d45f-4071-8dd7-1d8e12d81c08 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:30.116696 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-a7325b9e-d45f-4071-8dd7-1d8e12d81c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:24:30.165678 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7325b9e-d45f-4071-8dd7-1d8e12d81c08 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:30.173097 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41999608-f664-4daf-bbd2-61160151b52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:30.174388 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41999608-f664-4daf-bbd2-61160151b52d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:30.174669 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41999608-f664-4daf-bbd2-61160151b52d admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:30.175738 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41999608-f664-4daf-bbd2-61160151b52d admin admin] PATH_INFO: `/v3/projects/3a1d51b40933485d8999170f0567705b` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:30.177950 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41999608-f664-4daf-bbd2-61160151b52d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a1d51b40933485d8999170f0567705b)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:30.184081 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41999608-f664-4daf-bbd2-61160151b52d admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:30.349232 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-41999608-f664-4daf-bbd2-61160151b52d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a1d51b40933485d8999170f0567705b', 'request_id': 'req-41999608-f664-4daf-bbd2-61160151b52d'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:24:30.368118 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-41999608-f664-4daf-bbd2-61160151b52d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a1d51b40933485d8999170f0567705b', 'request_id': 'req-41999608-f664-4daf-bbd2-61160151b52d'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:24:30.388567 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-41999608-f664-4daf-bbd2-61160151b52d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a1d51b40933485d8999170f0567705b', 'request_id': 'req-41999608-f664-4daf-bbd2-61160151b52d'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:24:30.418252 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-41999608-f664-4daf-bbd2-61160151b52d admin admin] The token cache is being invalidate because project 3a1d51b40933485d8999170f0567705b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:24:30.419582 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-41999608-f664-4daf-bbd2-61160151b52d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:24:30.422383 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-41999608-f664-4daf-bbd2-61160151b52d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:24:30.429753 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 824/1657] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:24:30 2022] DELETE /identity/v3/projects/3a1d51b40933485d8999170f0567705b => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:24:30.433491 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f8cb5f-ce4e-47e3-82d9-88e3a45ae5fa service neutron] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:30.460841 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f8cb5f-ce4e-47e3-82d9-88e3a45ae5fa service neutron] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:30.643786 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dbd9b6-f823-40eb-ad53-665a93df8432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:30.645100 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dbd9b6-f823-40eb-ad53-665a93df8432 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:30.646823 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dbd9b6-f823-40eb-ad53-665a93df8432 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:30.647277 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dbd9b6-f823-40eb-ad53-665a93df8432 admin admin] PATH_INFO: `/v3/users/ab8f26e277d34a7fa7c9541e2a68e704` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:30.649310 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dbd9b6-f823-40eb-ad53-665a93df8432 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab8f26e277d34a7fa7c9541e2a68e704)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:30.654423 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dbd9b6-f823-40eb-ad53-665a93df8432 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:30.770994 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-37dbd9b6-f823-40eb-ad53-665a93df8432 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab8f26e277d34a7fa7c9541e2a68e704'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:24:30.771768 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-37dbd9b6-f823-40eb-ad53-665a93df8432 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab8f26e277d34a7fa7c9541e2a68e704'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:24:30.788279 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-37dbd9b6-f823-40eb-ad53-665a93df8432 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab8f26e277d34a7fa7c9541e2a68e704'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:24:30.792123 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-37dbd9b6-f823-40eb-ad53-665a93df8432 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab8f26e277d34a7fa7c9541e2a68e704'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:24:30.840186 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-37dbd9b6-f823-40eb-ad53-665a93df8432 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab8f26e277d34a7fa7c9541e2a68e704'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:24:30.893066 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 834/1658] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:24:30 2022] DELETE /identity/v3/users/ab8f26e277d34a7fa7c9541e2a68e704 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:24:30.990317 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5e6342-3287-4707-a7f2-04a496539697 None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:30.990317 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5e6342-3287-4707-a7f2-04a496539697 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:30.990563 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5e6342-3287-4707-a7f2-04a496539697 None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:30.992553 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 825/1659] 10.222.0.44 () {54 vars in 960 bytes} [Mon May 9 20:24:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:24:31.000183 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880c607-eaf4-442e-b07f-2f360b846d34 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:31.000503 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880c607-eaf4-442e-b07f-2f360b846d34 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:31.000780 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880c607-eaf4-442e-b07f-2f360b846d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:31.042176 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-d880c607-eaf4-442e-b07f-2f360b846d34 None None] MFA Rules not processed for user `285198b50b50431f96f9225d106417a4`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:24:31.049947 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-d880c607-eaf4-442e-b07f-2f360b846d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:24:31.167739 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 835/1660] 10.222.0.44 () {58 vars in 1057 bytes} [Mon May 9 20:24:30 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:24:31.183370 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5e6342-3287-4707-a7f2-04a496539697 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:31.216102 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5e6342-3287-4707-a7f2-04a496539697 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:31.236132 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0fc603-427a-450a-83a9-a15873350ca9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '285198b50b50431f96f9225d106417a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:31.236878 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0fc603-427a-450a-83a9-a15873350ca9 service placement] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:31.237164 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0fc603-427a-450a-83a9-a15873350ca9 service placement] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:31.237614 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0fc603-427a-450a-83a9-a15873350ca9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:31.241795 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-2f0fc603-427a-450a-83a9-a15873350ca9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:24:31.277847 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0fc603-427a-450a-83a9-a15873350ca9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:31.280001 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0fc603-427a-450a-83a9-a15873350ca9 service placement] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:31.328379 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 826/1661] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:24:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:24:33.152351 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d880c607-eaf4-442e-b07f-2f360b846d34 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:33.153956 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-d880c607-eaf4-442e-b07f-2f360b846d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:24:33.351088 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d880c607-eaf4-442e-b07f-2f360b846d34 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:33.357588 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38507f25-f181-4346-8906-c710f8399562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:33.359595 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38507f25-f181-4346-8906-c710f8399562 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:33.360201 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38507f25-f181-4346-8906-c710f8399562 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:33.360836 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38507f25-f181-4346-8906-c710f8399562 admin admin] PATH_INFO: `/v3/projects/9f8f2db15f24407eb097c653027de016` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:33.362585 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38507f25-f181-4346-8906-c710f8399562 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f8f2db15f24407eb097c653027de016)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:33.364063 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: WARNING py.warnings [None req-38507f25-f181-4346-8906-c710f8399562 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 09 20:24:33.364063 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: warnings.warn(msg) May 09 20:24:33.364063 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: May 09 20:24:33.365901 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38507f25-f181-4346-8906-c710f8399562 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:33.450442 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0fc603-427a-450a-83a9-a15873350ca9 service placement] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:33.453472 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-2f0fc603-427a-450a-83a9-a15873350ca9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:24:33.487679 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0fc603-427a-450a-83a9-a15873350ca9 service placement] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:33.546767 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-38507f25-f181-4346-8906-c710f8399562 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f8f2db15f24407eb097c653027de016', 'request_id': 'req-38507f25-f181-4346-8906-c710f8399562'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:24:33.571382 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-38507f25-f181-4346-8906-c710f8399562 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f8f2db15f24407eb097c653027de016', 'request_id': 'req-38507f25-f181-4346-8906-c710f8399562'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:24:33.580113 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-38507f25-f181-4346-8906-c710f8399562 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f8f2db15f24407eb097c653027de016', 'request_id': 'req-38507f25-f181-4346-8906-c710f8399562'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:24:33.614052 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-38507f25-f181-4346-8906-c710f8399562 admin admin] The token cache is being invalidate because project 9f8f2db15f24407eb097c653027de016 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:24:33.615262 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-38507f25-f181-4346-8906-c710f8399562 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:24:33.616161 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-38507f25-f181-4346-8906-c710f8399562 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:24:33.624777 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 836/1662] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:24:33 2022] DELETE /identity/v3/projects/9f8f2db15f24407eb097c653027de016 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:24:33.628025 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b88ba-d378-4dce-b079-da0d97b80e05 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:33.630067 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b88ba-d378-4dce-b079-da0d97b80e05 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:33.630552 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b88ba-d378-4dce-b079-da0d97b80e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:33.662869 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb60ee0d-ce50-4f49-9ccc-504381546497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:33.664486 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb60ee0d-ce50-4f49-9ccc-504381546497 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:33.665228 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb60ee0d-ce50-4f49-9ccc-504381546497 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:33.665640 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb60ee0d-ce50-4f49-9ccc-504381546497 admin admin] PATH_INFO: `/v3/projects/4a703048ebbc44d497f95e1c5e221875` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:33.667152 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb60ee0d-ce50-4f49-9ccc-504381546497 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a703048ebbc44d497f95e1c5e221875)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:33.670166 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb60ee0d-ce50-4f49-9ccc-504381546497 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:33.675134 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-fb8b88ba-d378-4dce-b079-da0d97b80e05 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:24:33.678806 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-fb8b88ba-d378-4dce-b079-da0d97b80e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:24:33.696813 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 837/1663] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:24:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:24:33.705783 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb9e92-6214-41b2-b8c7-654e8f4c1767 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:33.706294 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb9e92-6214-41b2-b8c7-654e8f4c1767 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:33.706711 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb9e92-6214-41b2-b8c7-654e8f4c1767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:33.759429 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-cb60ee0d-ce50-4f49-9ccc-504381546497 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a703048ebbc44d497f95e1c5e221875', 'request_id': 'req-cb60ee0d-ce50-4f49-9ccc-504381546497'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:24:33.764091 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-9dbb9e92-6214-41b2-b8c7-654e8f4c1767 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:24:33.765327 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-9dbb9e92-6214-41b2-b8c7-654e8f4c1767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:24:33.791216 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-cb60ee0d-ce50-4f49-9ccc-504381546497 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a703048ebbc44d497f95e1c5e221875', 'request_id': 'req-cb60ee0d-ce50-4f49-9ccc-504381546497'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:24:33.803948 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-cb60ee0d-ce50-4f49-9ccc-504381546497 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a703048ebbc44d497f95e1c5e221875', 'request_id': 'req-cb60ee0d-ce50-4f49-9ccc-504381546497'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:24:33.826447 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-cb60ee0d-ce50-4f49-9ccc-504381546497 admin admin] The token cache is being invalidate because project 4a703048ebbc44d497f95e1c5e221875 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:24:33.827010 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-cb60ee0d-ce50-4f49-9ccc-504381546497 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:24:33.827977 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-cb60ee0d-ce50-4f49-9ccc-504381546497 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:24:33.830144 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 827/1664] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:24:33 2022] DELETE /identity/v3/projects/4a703048ebbc44d497f95e1c5e221875 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:24:33.844953 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cbd146-3a63-43b1-9781-d498f4d14068 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:33.847078 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cbd146-3a63-43b1-9781-d498f4d14068 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:33.848369 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cbd146-3a63-43b1-9781-d498f4d14068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:33.909626 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-18cbd146-3a63-43b1-9781-d498f4d14068 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:24:33.914957 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-18cbd146-3a63-43b1-9781-d498f4d14068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:24:33.977920 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 838/1665] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:24:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:24:33.984359 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbb9e92-6214-41b2-b8c7-654e8f4c1767 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:34.015138 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbb9e92-6214-41b2-b8c7-654e8f4c1767 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:34.025163 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 828/1666] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:24:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:24:34.029972 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee52753-1850-4960-9d38-d0394bbc444e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:34.034200 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba3aa9-ab0e-4def-9f20-64c6991341db None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:34.034486 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba3aa9-ab0e-4def-9f20-64c6991341db None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:34.034762 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba3aa9-ab0e-4def-9f20-64c6991341db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:34.036705 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee52753-1850-4960-9d38-d0394bbc444e admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:34.037243 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee52753-1850-4960-9d38-d0394bbc444e admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:34.037728 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee52753-1850-4960-9d38-d0394bbc444e admin admin] PATH_INFO: `/v3/domains` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:34.038668 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee52753-1850-4960-9d38-d0394bbc444e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:24:34.040388 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee52753-1850-4960-9d38-d0394bbc444e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:34.042254 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee52753-1850-4960-9d38-d0394bbc444e admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:34.092263 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 839/1667] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 9 20:24:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:24:34.093606 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee52753-1850-4960-9d38-d0394bbc444e admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:34.105323 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-59ba3aa9-ab0e-4def-9f20-64c6991341db None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:24:34.108119 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee52753-1850-4960-9d38-d0394bbc444e admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:34.112709 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-59ba3aa9-ab0e-4def-9f20-64c6991341db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:24:34.148660 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 829/1668] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:24:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:24:34.151186 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ba3aa9-ab0e-4def-9f20-64c6991341db None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:34.156100 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a64ca-e89d-4a7c-8fed-0bf83e672259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:34.157548 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a64ca-e89d-4a7c-8fed-0bf83e672259 admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:34.158030 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a64ca-e89d-4a7c-8fed-0bf83e672259 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:34.158513 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a64ca-e89d-4a7c-8fed-0bf83e672259 admin admin] PATH_INFO: `/v3/projects` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:34.159495 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189a64ca-e89d-4a7c-8fed-0bf83e672259 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:34.161682 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189a64ca-e89d-4a7c-8fed-0bf83e672259 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:34.174315 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ba3aa9-ab0e-4def-9f20-64c6991341db None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:34.191566 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd792ba7-f042-4fe3-9ee5-b6136ab963d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:34.193430 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd792ba7-f042-4fe3-9ee5-b6136ab963d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:34.194992 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd792ba7-f042-4fe3-9ee5-b6136ab963d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:34.195294 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd792ba7-f042-4fe3-9ee5-b6136ab963d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:34.197830 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd792ba7-f042-4fe3-9ee5-b6136ab963d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:24:34.198166 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd792ba7-f042-4fe3-9ee5-b6136ab963d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:34.201240 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 840/1669] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:24:34 2022] POST /identity/v3/projects => generated 365 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:24:34.202182 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd792ba7-f042-4fe3-9ee5-b6136ab963d7 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:34.206021 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a64ca-e89d-4a7c-8fed-0bf83e672259 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:34.232506 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 830/1670] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 9 20:24:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:24:34.236675 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd792ba7-f042-4fe3-9ee5-b6136ab963d7 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:34.263230 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd792ba7-f042-4fe3-9ee5-b6136ab963d7 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:34.325847 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a64ca-e89d-4a7c-8fed-0bf83e672259 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:34.332719 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098cd68e-8c35-4d4b-b16e-ba0e77406173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:34.333908 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098cd68e-8c35-4d4b-b16e-ba0e77406173 admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:34.334428 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098cd68e-8c35-4d4b-b16e-ba0e77406173 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:34.334825 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098cd68e-8c35-4d4b-b16e-ba0e77406173 admin admin] PATH_INFO: `/v3/users` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:34.335615 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098cd68e-8c35-4d4b-b16e-ba0e77406173 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:34.338660 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098cd68e-8c35-4d4b-b16e-ba0e77406173 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:34.348088 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2d2c79-5a36-41b1-91d4-7066a0f38cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:34.348871 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d2c79-5a36-41b1-91d4-7066a0f38cd9 admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:34.349254 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d2c79-5a36-41b1-91d4-7066a0f38cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:34.349687 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d2c79-5a36-41b1-91d4-7066a0f38cd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:34.350632 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2d2c79-5a36-41b1-91d4-7066a0f38cd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:34.358732 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2d2c79-5a36-41b1-91d4-7066a0f38cd9 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:34.379897 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 841/1671] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:24:34 2022] POST /identity/v3/users => generated 283 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:24:34.381133 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098cd68e-8c35-4d4b-b16e-ba0e77406173 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:34.406236 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098cd68e-8c35-4d4b-b16e-ba0e77406173 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:34.422579 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91770faf-a158-4685-991e-109a3510147d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:34.425051 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91770faf-a158-4685-991e-109a3510147d admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:34.426556 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91770faf-a158-4685-991e-109a3510147d admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:34.426952 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91770faf-a158-4685-991e-109a3510147d admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:34.427797 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91770faf-a158-4685-991e-109a3510147d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:34.430315 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 831/1672] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:24:34 2022] POST /identity/v3/projects => generated 371 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:24:34.431607 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91770faf-a158-4685-991e-109a3510147d admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:34.433336 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2d2c79-5a36-41b1-91d4-7066a0f38cd9 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:34.459747 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 842/1673] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:24:34 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:24:34.477306 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91770faf-a158-4685-991e-109a3510147d admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:34.518182 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91770faf-a158-4685-991e-109a3510147d admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:34.638362 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2d2c79-5a36-41b1-91d4-7066a0f38cd9 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:34.651019 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb5eba1-9c71-41a4-8fc4-467c35e6ed33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:34.651842 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083e7f05-8f6e-469d-bcfb-6094aefae912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:34.652339 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e7f05-8f6e-469d-bcfb-6094aefae912 admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:34.653656 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e7f05-8f6e-469d-bcfb-6094aefae912 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:34.654036 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e7f05-8f6e-469d-bcfb-6094aefae912 admin admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:34.656059 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083e7f05-8f6e-469d-bcfb-6094aefae912 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:34.656590 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5eba1-9c71-41a4-8fc4-467c35e6ed33 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:34.656941 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5eba1-9c71-41a4-8fc4-467c35e6ed33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:34.657223 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5eba1-9c71-41a4-8fc4-467c35e6ed33 admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:34.658017 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb5eba1-9c71-41a4-8fc4-467c35e6ed33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:34.658115 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083e7f05-8f6e-469d-bcfb-6094aefae912 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:34.659779 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb5eba1-9c71-41a4-8fc4-467c35e6ed33 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:34.686477 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 843/1674] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:24:34 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:24:34.689848 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb5eba1-9c71-41a4-8fc4-467c35e6ed33 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:34.714202 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 832/1675] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:24:34 2022] POST /identity/v3/users => generated 286 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:24:34.716463 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083e7f05-8f6e-469d-bcfb-6094aefae912 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:34.737718 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083e7f05-8f6e-469d-bcfb-6094aefae912 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:34.742368 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb5eba1-9c71-41a4-8fc4-467c35e6ed33 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:34.753954 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fa5092-b259-4e14-b8de-eb17d8164b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:34.756285 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa5092-b259-4e14-b8de-eb17d8164b67 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:34.757528 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa5092-b259-4e14-b8de-eb17d8164b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:34.757806 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa5092-b259-4e14-b8de-eb17d8164b67 admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:34.761032 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6a76b1-3a37-4bc9-a457-96e5e6cb9b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:34.762516 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fa5092-b259-4e14-b8de-eb17d8164b67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:34.763473 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a76b1-3a37-4bc9-a457-96e5e6cb9b72 admin admin] REQUEST_METHOD: `PUT` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:34.763771 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a76b1-3a37-4bc9-a457-96e5e6cb9b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:34.764050 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a76b1-3a37-4bc9-a457-96e5e6cb9b72 admin admin] PATH_INFO: `/v3/projects/fda8d05547b54fed9a24ad50d05410e3/users/e97a748c810a4bab992edd6b86c0931a/roles/79f90a0bf6ea43d0b3c434e31556253a` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:34.766047 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fa5092-b259-4e14-b8de-eb17d8164b67 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:34.782659 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6a76b1-3a37-4bc9-a457-96e5e6cb9b72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fda8d05547b54fed9a24ad50d05410e3, user_id=e97a748c810a4bab992edd6b86c0931a, role_id=79f90a0bf6ea43d0b3c434e31556253a)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:34.785576 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6a76b1-3a37-4bc9-a457-96e5e6cb9b72 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:34.815213 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 844/1676] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:24:34 2022] PUT /identity/v3/projects/fda8d05547b54fed9a24ad50d05410e3/users/e97a748c810a4bab992edd6b86c0931a/roles/79f90a0bf6ea43d0b3c434e31556253a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:24:34.815213 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13d4c1-b82f-409f-a2c1-0bb3d3ab9850 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:34.815651 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 833/1677] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:24:34 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:24:34.815747 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13d4c1-b82f-409f-a2c1-0bb3d3ab9850 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:34.815747 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13d4c1-b82f-409f-a2c1-0bb3d3ab9850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:34.815891 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fa5092-b259-4e14-b8de-eb17d8164b67 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:34.832933 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-bd13d4c1-b82f-409f-a2c1-0bb3d3ab9850 None None] MFA Rules not processed for user `0227b2954e61426388214e96e1741eb2`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:24:34.834267 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-bd13d4c1-b82f-409f-a2c1-0bb3d3ab9850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:24:34.835771 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fa5092-b259-4e14-b8de-eb17d8164b67 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:34.941070 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 845/1678] 10.222.0.44 () {58 vars in 1009 bytes} [Mon May 9 20:24:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:24:34.943192 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb4105-11db-4edb-915d-944af3da2350 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:34.943506 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb4105-11db-4edb-915d-944af3da2350 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:34.943783 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb4105-11db-4edb-915d-944af3da2350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:34.986605 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb131c5-3f79-4c48-bb54-580128caff99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:34.990338 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb131c5-3f79-4c48-bb54-580128caff99 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:34.990653 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb131c5-3f79-4c48-bb54-580128caff99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:34.991963 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb131c5-3f79-4c48-bb54-580128caff99 admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:34.994359 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb131c5-3f79-4c48-bb54-580128caff99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:34.999033 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb131c5-3f79-4c48-bb54-580128caff99 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:35.010829 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-85cb4105-11db-4edb-915d-944af3da2350 None None] MFA Rules not processed for user `e97a748c810a4bab992edd6b86c0931a`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:24:35.015994 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-85cb4105-11db-4edb-915d-944af3da2350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:24:35.027084 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 834/1679] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:24:34 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:24:35.028158 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb131c5-3f79-4c48-bb54-580128caff99 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:35.052885 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb131c5-3f79-4c48-bb54-580128caff99 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:35.072992 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f678a29-6869-470c-8717-1cd13e01c9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:35.076778 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f678a29-6869-470c-8717-1cd13e01c9d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:35.077156 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f678a29-6869-470c-8717-1cd13e01c9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:35.079775 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f678a29-6869-470c-8717-1cd13e01c9d2 admin admin] PATH_INFO: `/v3/projects/8c44f4b5b22d407f9f7c3a06f1ecd5b2/users/60cda2b0c2d847349815e0ba1bf3a1df/roles/79f90a0bf6ea43d0b3c434e31556253a` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:35.162264 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f678a29-6869-470c-8717-1cd13e01c9d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c44f4b5b22d407f9f7c3a06f1ecd5b2, user_id=60cda2b0c2d847349815e0ba1bf3a1df, role_id=79f90a0bf6ea43d0b3c434e31556253a)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:35.167911 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f678a29-6869-470c-8717-1cd13e01c9d2 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:35.204079 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 835/1680] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:24:35 2022] PUT /identity/v3/projects/8c44f4b5b22d407f9f7c3a06f1ecd5b2/users/60cda2b0c2d847349815e0ba1bf3a1df/roles/79f90a0bf6ea43d0b3c434e31556253a => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:24:35.216071 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ec319-831f-405d-9681-74816eaeab28 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:35.216350 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ec319-831f-405d-9681-74816eaeab28 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:35.216627 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ec319-831f-405d-9681-74816eaeab28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:35.233159 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 846/1681] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:24:34 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:24:35.237861 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb4105-11db-4edb-915d-944af3da2350 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:35.275255 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-e94ec319-831f-405d-9681-74816eaeab28 None None] MFA Rules not processed for user `60cda2b0c2d847349815e0ba1bf3a1df`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:24:35.277298 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-e94ec319-831f-405d-9681-74816eaeab28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:24:35.300104 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb4105-11db-4edb-915d-944af3da2350 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:35.445790 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 836/1682] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:24:35 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:24:35.449065 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ec319-831f-405d-9681-74816eaeab28 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:35.452084 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-e94ec319-831f-405d-9681-74816eaeab28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:24:35.484489 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276dab97-830a-4205-9734-7358f0ed4e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:35.499223 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276dab97-830a-4205-9734-7358f0ed4e56 admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:35.499826 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276dab97-830a-4205-9734-7358f0ed4e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:35.501094 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276dab97-830a-4205-9734-7358f0ed4e56 admin admin] PATH_INFO: `/v3/projects` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:35.502492 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276dab97-830a-4205-9734-7358f0ed4e56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:35.508817 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276dab97-830a-4205-9734-7358f0ed4e56 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:35.581906 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 847/1683] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:24:35 2022] POST /identity/v3/projects => generated 365 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:24:35.582747 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276dab97-830a-4205-9734-7358f0ed4e56 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:35.671066 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ec319-831f-405d-9681-74816eaeab28 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:35.842098 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1661f0b-2d84-48b0-b3c3-8b1fe2d5af40 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965089f1a92f49bd883b337d6042c69f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:35.842826 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1661f0b-2d84-48b0-b3c3-8b1fe2d5af40 service swift] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:35.843046 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1661f0b-2d84-48b0-b3c3-8b1fe2d5af40 service swift] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:35.843314 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1661f0b-2d84-48b0-b3c3-8b1fe2d5af40 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:35.989586 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1661f0b-2d84-48b0-b3c3-8b1fe2d5af40 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:35.991632 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1661f0b-2d84-48b0-b3c3-8b1fe2d5af40 service swift] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:36.003330 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 837/1684] 10.222.0.44 () {60 vars in 1384 bytes} [Mon May 9 20:24:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 09 20:24:36.004443 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1661f0b-2d84-48b0-b3c3-8b1fe2d5af40 service swift] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:36.017790 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1661f0b-2d84-48b0-b3c3-8b1fe2d5af40 service swift] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:36.024305 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1184b27b-6ab8-4ea9-827f-b794c5b9f32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:36.025229 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1184b27b-6ab8-4ea9-827f-b794c5b9f32d admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:36.025588 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1184b27b-6ab8-4ea9-827f-b794c5b9f32d admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:36.026037 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1184b27b-6ab8-4ea9-827f-b794c5b9f32d admin admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:36.027040 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1184b27b-6ab8-4ea9-827f-b794c5b9f32d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:36.027871 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276dab97-830a-4205-9734-7358f0ed4e56 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:36.030593 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1184b27b-6ab8-4ea9-827f-b794c5b9f32d admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:36.038362 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d97a63f-4e7a-4eee-81c5-f852e59ff584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:36.039024 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97a63f-4e7a-4eee-81c5-f852e59ff584 admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:36.039297 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97a63f-4e7a-4eee-81c5-f852e59ff584 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:36.039611 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97a63f-4e7a-4eee-81c5-f852e59ff584 admin admin] PATH_INFO: `/v3/projects` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:36.040857 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d97a63f-4e7a-4eee-81c5-f852e59ff584 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:36.043022 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d97a63f-4e7a-4eee-81c5-f852e59ff584 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:36.061916 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 838/1685] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:24:36 2022] POST /identity/v3/users => generated 289 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:24:36.066490 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1184b27b-6ab8-4ea9-827f-b794c5b9f32d admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:36.082434 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1184b27b-6ab8-4ea9-827f-b794c5b9f32d admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:36.090257 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2603c4b0-14a4-46af-a841-0244256312b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:36.092166 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2603c4b0-14a4-46af-a841-0244256312b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:36.092610 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2603c4b0-14a4-46af-a841-0244256312b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:36.093048 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2603c4b0-14a4-46af-a841-0244256312b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:36.094445 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2603c4b0-14a4-46af-a841-0244256312b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:36.097168 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2603c4b0-14a4-46af-a841-0244256312b2 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:36.104465 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 848/1686] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:24:35 2022] POST /identity/v3/projects => generated 373 bytes in 522 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:24:36.105376 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d97a63f-4e7a-4eee-81c5-f852e59ff584 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:36.114365 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 839/1687] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:24:36 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:24:36.118529 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2603c4b0-14a4-46af-a841-0244256312b2 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:36.140862 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2603c4b0-14a4-46af-a841-0244256312b2 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:36.364368 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6f6524-e0ca-41d5-889f-24ded65e1d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:36.365188 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f6524-e0ca-41d5-889f-24ded65e1d9b admin admin] REQUEST_METHOD: `PUT` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:36.366125 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f6524-e0ca-41d5-889f-24ded65e1d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:36.366125 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f6524-e0ca-41d5-889f-24ded65e1d9b admin admin] PATH_INFO: `/v3/projects/c210a719a8e34777a2fbfbe70501ef11/users/9e8cf3f57a8d4ad89cfac5aedbc5c8d0/roles/274130b78e304bb88789c1b349263f3c` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:36.374962 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d97a63f-4e7a-4eee-81c5-f852e59ff584 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:36.407841 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e16557-b7de-4d96-a061-e09cf26fd6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:36.408537 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e16557-b7de-4d96-a061-e09cf26fd6b8 admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:36.408813 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e16557-b7de-4d96-a061-e09cf26fd6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:36.409088 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e16557-b7de-4d96-a061-e09cf26fd6b8 admin admin] PATH_INFO: `/v3/users` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:36.409791 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e16557-b7de-4d96-a061-e09cf26fd6b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:36.411780 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e16557-b7de-4d96-a061-e09cf26fd6b8 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:36.437485 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6f6524-e0ca-41d5-889f-24ded65e1d9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c210a719a8e34777a2fbfbe70501ef11, user_id=9e8cf3f57a8d4ad89cfac5aedbc5c8d0, role_id=274130b78e304bb88789c1b349263f3c)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:36.462052 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6f6524-e0ca-41d5-889f-24ded65e1d9b admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:36.491665 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 849/1688] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:24:36 2022] POST /identity/v3/users => generated 293 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:24:36.493664 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e16557-b7de-4d96-a061-e09cf26fd6b8 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:36.499846 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 840/1689] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:24:36 2022] PUT /identity/v3/projects/c210a719a8e34777a2fbfbe70501ef11/users/9e8cf3f57a8d4ad89cfac5aedbc5c8d0/roles/274130b78e304bb88789c1b349263f3c => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:24:36.503940 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6f6524-e0ca-41d5-889f-24ded65e1d9b admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:36.521689 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e16557-b7de-4d96-a061-e09cf26fd6b8 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:36.713923 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6f6524-e0ca-41d5-889f-24ded65e1d9b admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:36.736672 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b5e61-c375-4b0f-bbe9-3af4c74fdf4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:36.737769 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b5e61-c375-4b0f-bbe9-3af4c74fdf4c admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:36.738160 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b5e61-c375-4b0f-bbe9-3af4c74fdf4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:36.738522 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b5e61-c375-4b0f-bbe9-3af4c74fdf4c admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:36.739764 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729b5e61-c375-4b0f-bbe9-3af4c74fdf4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:36.741186 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729b5e61-c375-4b0f-bbe9-3af4c74fdf4c admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:36.751555 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9c65a-5000-4929-ac41-da8f3a266021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:36.752248 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9c65a-5000-4929-ac41-da8f3a266021 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:36.752530 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9c65a-5000-4929-ac41-da8f3a266021 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:36.752804 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9c65a-5000-4929-ac41-da8f3a266021 admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:36.753533 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a9c65a-5000-4929-ac41-da8f3a266021 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:36.755269 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a9c65a-5000-4929-ac41-da8f3a266021 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:36.781321 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 850/1690] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:24:36 2022] GET /identity/v3/roles => generated 1420 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:24:36.782400 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b5e61-c375-4b0f-bbe9-3af4c74fdf4c admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:36.800182 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 841/1691] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:24:36 2022] GET /identity/v3/roles => generated 1420 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:24:36.805951 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9c65a-5000-4929-ac41-da8f3a266021 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:36.809953 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b5e61-c375-4b0f-bbe9-3af4c74fdf4c admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:36.835917 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e628f6-6362-46b6-8aff-269e687f2671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:36.836930 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e628f6-6362-46b6-8aff-269e687f2671 admin admin] REQUEST_METHOD: `PUT` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:36.837309 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e628f6-6362-46b6-8aff-269e687f2671 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:36.837687 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e628f6-6362-46b6-8aff-269e687f2671 admin admin] PATH_INFO: `/v3/projects/eeb11f3e5b6a44f097cef2c5cbae7b9a/users/a54cd3b291c04896903944bc0cbe3c76/roles/274130b78e304bb88789c1b349263f3c` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:36.856081 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9c65a-5000-4929-ac41-da8f3a266021 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:36.872122 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b7e6ec-9aaf-4da5-ab30-7dd4b6ea6f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:36.873331 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b7e6ec-9aaf-4da5-ab30-7dd4b6ea6f84 admin admin] REQUEST_METHOD: `PUT` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:36.873782 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b7e6ec-9aaf-4da5-ab30-7dd4b6ea6f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:36.874228 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b7e6ec-9aaf-4da5-ab30-7dd4b6ea6f84 admin admin] PATH_INFO: `/v3/projects/c210a719a8e34777a2fbfbe70501ef11/users/9e8cf3f57a8d4ad89cfac5aedbc5c8d0/roles/274130b78e304bb88789c1b349263f3c` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:36.879539 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e628f6-6362-46b6-8aff-269e687f2671 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eeb11f3e5b6a44f097cef2c5cbae7b9a, user_id=a54cd3b291c04896903944bc0cbe3c76, role_id=274130b78e304bb88789c1b349263f3c)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:36.880995 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b7e6ec-9aaf-4da5-ab30-7dd4b6ea6f84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c210a719a8e34777a2fbfbe70501ef11, user_id=9e8cf3f57a8d4ad89cfac5aedbc5c8d0, role_id=274130b78e304bb88789c1b349263f3c)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:36.886305 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b7e6ec-9aaf-4da5-ab30-7dd4b6ea6f84 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:36.888904 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e628f6-6362-46b6-8aff-269e687f2671 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:36.917155 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 851/1692] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:24:36 2022] PUT /identity/v3/projects/eeb11f3e5b6a44f097cef2c5cbae7b9a/users/a54cd3b291c04896903944bc0cbe3c76/roles/274130b78e304bb88789c1b349263f3c => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:24:36.918188 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e628f6-6362-46b6-8aff-269e687f2671 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:36.930473 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 842/1693] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:24:36 2022] PUT /identity/v3/projects/c210a719a8e34777a2fbfbe70501ef11/users/9e8cf3f57a8d4ad89cfac5aedbc5c8d0/roles/274130b78e304bb88789c1b349263f3c => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:24:36.944477 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9334ccf-7b0a-4dc1-860b-92e06692f621 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:36.944978 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9334ccf-7b0a-4dc1-860b-92e06692f621 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:36.945312 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9334ccf-7b0a-4dc1-860b-92e06692f621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:37.033331 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-d9334ccf-7b0a-4dc1-860b-92e06692f621 None None] MFA Rules not processed for user `9e8cf3f57a8d4ad89cfac5aedbc5c8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:24:37.034893 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-d9334ccf-7b0a-4dc1-860b-92e06692f621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:24:37.132103 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 843/1694] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:24:36 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:24:37.132215 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e628f6-6362-46b6-8aff-269e687f2671 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:37.134163 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f6727-4189-4600-a8ca-9c32b5ed08d8 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:37.134760 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f6727-4189-4600-a8ca-9c32b5ed08d8 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:37.135443 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f6727-4189-4600-a8ca-9c32b5ed08d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:37.154180 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c46073-cc23-4c2e-a052-09271ef619b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:37.155095 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c46073-cc23-4c2e-a052-09271ef619b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:37.155411 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c46073-cc23-4c2e-a052-09271ef619b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:37.155786 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c46073-cc23-4c2e-a052-09271ef619b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:37.156601 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c46073-cc23-4c2e-a052-09271ef619b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:37.158329 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c46073-cc23-4c2e-a052-09271ef619b0 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:37.196468 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 852/1695] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:24:36 2022] GET /identity/v3/roles => generated 1420 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:24:37.196999 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c46073-cc23-4c2e-a052-09271ef619b0 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:37.200902 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-ca3f6727-4189-4600-a8ca-9c32b5ed08d8 None None] MFA Rules not processed for user `797d7c0dfda747549456236e9e639466`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:24:37.203665 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-12c46073-cc23-4c2e-a052-09271ef619b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:24:37.205219 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-ca3f6727-4189-4600-a8ca-9c32b5ed08d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:24:37.395017 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c46073-cc23-4c2e-a052-09271ef619b0 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:37.408513 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19411d0c-837d-43e3-9b59-71d2eedfb4f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d65e731386d44948dcc1ecd40cbda65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:37.409941 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19411d0c-837d-43e3-9b59-71d2eedfb4f5 service cinder] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:37.410248 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19411d0c-837d-43e3-9b59-71d2eedfb4f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:37.410573 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19411d0c-837d-43e3-9b59-71d2eedfb4f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:37.425048 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 844/1696] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:24:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:24:37.426150 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3f6727-4189-4600-a8ca-9c32b5ed08d8 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:37.432905 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19411d0c-837d-43e3-9b59-71d2eedfb4f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:37.436063 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19411d0c-837d-43e3-9b59-71d2eedfb4f5 service cinder] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:37.484567 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3f6727-4189-4600-a8ca-9c32b5ed08d8 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:37.505319 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf56259-c05f-4784-9d20-1a16105dd50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:37.507984 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf56259-c05f-4784-9d20-1a16105dd50b admin admin] REQUEST_METHOD: `PUT` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:37.522183 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf56259-c05f-4784-9d20-1a16105dd50b admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:37.530071 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf56259-c05f-4784-9d20-1a16105dd50b admin admin] PATH_INFO: `/v3/projects/eeb11f3e5b6a44f097cef2c5cbae7b9a/users/a54cd3b291c04896903944bc0cbe3c76/roles/274130b78e304bb88789c1b349263f3c` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:37.534253 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf56259-c05f-4784-9d20-1a16105dd50b admin admin] RBAC: Authorizing `identity:create_grant(project_id=eeb11f3e5b6a44f097cef2c5cbae7b9a, user_id=a54cd3b291c04896903944bc0cbe3c76, role_id=274130b78e304bb88789c1b349263f3c)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:37.542710 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf56259-c05f-4784-9d20-1a16105dd50b admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:37.543943 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 853/1697] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:24:37 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:24:37.548067 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d006a65-9085-455d-85e8-4f2955703783 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:37.549432 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d006a65-9085-455d-85e8-4f2955703783 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:37.550051 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d006a65-9085-455d-85e8-4f2955703783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:37.593151 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 845/1698] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:24:37 2022] PUT /identity/v3/projects/eeb11f3e5b6a44f097cef2c5cbae7b9a/users/a54cd3b291c04896903944bc0cbe3c76/roles/274130b78e304bb88789c1b349263f3c => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:24:37.612329 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37fef07-253b-4ea6-b05c-7a29015a0fd3 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:37.614400 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37fef07-253b-4ea6-b05c-7a29015a0fd3 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:37.617051 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37fef07-253b-4ea6-b05c-7a29015a0fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:37.624904 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-1d006a65-9085-455d-85e8-4f2955703783 None None] MFA Rules not processed for user `797d7c0dfda747549456236e9e639466`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:24:37.626747 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-1d006a65-9085-455d-85e8-4f2955703783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:24:37.708140 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-c37fef07-253b-4ea6-b05c-7a29015a0fd3 None None] MFA Rules not processed for user `a54cd3b291c04896903944bc0cbe3c76`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:24:37.713274 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-c37fef07-253b-4ea6-b05c-7a29015a0fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:24:37.798043 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 854/1699] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:24:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:24:37.803903 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d006a65-9085-455d-85e8-4f2955703783 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:37.894446 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 846/1700] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:24:37 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:24:37.896173 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37fef07-253b-4ea6-b05c-7a29015a0fd3 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:37.899723 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-c37fef07-253b-4ea6-b05c-7a29015a0fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:24:37.926841 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d006a65-9085-455d-85e8-4f2955703783 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:37.939724 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b0d2ad-8385-47ce-9f16-0641cc166159 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d65e731386d44948dcc1ecd40cbda65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:37.940929 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b0d2ad-8385-47ce-9f16-0641cc166159 service cinder] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:37.942910 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b0d2ad-8385-47ce-9f16-0641cc166159 service cinder] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:37.943510 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b0d2ad-8385-47ce-9f16-0641cc166159 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:38.058264 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37fef07-253b-4ea6-b05c-7a29015a0fd3 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:38.073455 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b0d2ad-8385-47ce-9f16-0641cc166159 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:38.082940 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b0d2ad-8385-47ce-9f16-0641cc166159 service cinder] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:38.084014 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132d9bf6-314c-475a-8107-4567a5e23df1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb59440b21074d9da15679dc2d745f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:38.084701 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d9bf6-314c-475a-8107-4567a5e23df1 service nova] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:38.084973 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d9bf6-314c-475a-8107-4567a5e23df1 service nova] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:38.087768 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d9bf6-314c-475a-8107-4567a5e23df1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:38.104257 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132d9bf6-314c-475a-8107-4567a5e23df1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:38.105372 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 855/1701] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:24:37 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:24:38.105559 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b0d2ad-8385-47ce-9f16-0641cc166159 service cinder] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:38.108825 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132d9bf6-314c-475a-8107-4567a5e23df1 service nova] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:38.109844 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-b6b0d2ad-8385-47ce-9f16-0641cc166159 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:24:38.132034 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 847/1702] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:24:37 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:24:38.135927 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b0d2ad-8385-47ce-9f16-0641cc166159 service cinder] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:38.149769 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca19d7c-c64c-4175-82ec-291b6c0d1b26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d65e731386d44948dcc1ecd40cbda65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:38.151328 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca19d7c-c64c-4175-82ec-291b6c0d1b26 service cinder] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:38.152627 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca19d7c-c64c-4175-82ec-291b6c0d1b26 service cinder] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:38.153460 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca19d7c-c64c-4175-82ec-291b6c0d1b26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:38.212795 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca19d7c-c64c-4175-82ec-291b6c0d1b26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:38.218207 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca19d7c-c64c-4175-82ec-291b6c0d1b26 service cinder] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:38.279626 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 856/1703] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:24:38 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:24:38.590063 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132d9bf6-314c-475a-8107-4567a5e23df1 service nova] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:38.618885 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132d9bf6-314c-475a-8107-4567a5e23df1 service nova] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:38.678921 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a6aad1-482c-4fce-87fe-4accfbfd3c86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d65e731386d44948dcc1ecd40cbda65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:38.683035 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a6aad1-482c-4fce-87fe-4accfbfd3c86 service cinder] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:38.683035 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a6aad1-482c-4fce-87fe-4accfbfd3c86 service cinder] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:38.683344 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a6aad1-482c-4fce-87fe-4accfbfd3c86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:38.882945 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a6aad1-482c-4fce-87fe-4accfbfd3c86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:38.884726 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a6aad1-482c-4fce-87fe-4accfbfd3c86 service cinder] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:38.924774 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 848/1704] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:24:38 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:24:40.021849 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6df588-c460-4add-a804-d21fdb1012b1 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:40.022900 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6df588-c460-4add-a804-d21fdb1012b1 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:40.023604 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6df588-c460-4add-a804-d21fdb1012b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:40.085960 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-7f6df588-c460-4add-a804-d21fdb1012b1 None None] MFA Rules not processed for user `dee809a4a41f4d2c91edb83c1f4d224c`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:24:40.087547 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-7f6df588-c460-4add-a804-d21fdb1012b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:24:40.239522 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 857/1705] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:24:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:24:40.258464 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a6aad1-482c-4fce-87fe-4accfbfd3c86 service cinder] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:40.260095 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-d3a6aad1-482c-4fce-87fe-4accfbfd3c86 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:24:40.294465 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a6aad1-482c-4fce-87fe-4accfbfd3c86 service cinder] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:40.329300 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12763f66-1f6b-4dd9-bec8-5069e327d952 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb59440b21074d9da15679dc2d745f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:40.330814 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12763f66-1f6b-4dd9-bec8-5069e327d952 service nova] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:40.331949 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12763f66-1f6b-4dd9-bec8-5069e327d952 service nova] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:40.332271 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12763f66-1f6b-4dd9-bec8-5069e327d952 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:40.366430 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12763f66-1f6b-4dd9-bec8-5069e327d952 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:40.369683 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12763f66-1f6b-4dd9-bec8-5069e327d952 service nova] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:40.391673 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 849/1706] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:24:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:24:41.271745 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d81bf-08f2-49ab-aa68-eb56874c25eb None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:41.272630 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d81bf-08f2-49ab-aa68-eb56874c25eb None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:41.273141 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d81bf-08f2-49ab-aa68-eb56874c25eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:41.317565 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-c52d81bf-08f2-49ab-aa68-eb56874c25eb None None] MFA Rules not processed for user `b2a13ad25f27471792ba0758602b6e63`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:24:41.318895 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-c52d81bf-08f2-49ab-aa68-eb56874c25eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:24:41.394071 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df43239-c9c8-48c7-9c67-e6235dd28248 None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:41.394703 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df43239-c9c8-48c7-9c67-e6235dd28248 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:41.394703 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df43239-c9c8-48c7-9c67-e6235dd28248 None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:41.396077 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 850/1707] 10.222.0.44 () {54 vars in 912 bytes} [Mon May 9 20:24:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:24:41.411207 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9cfc7-bd1c-49a6-a190-71bdc8523c94 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:41.411741 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9cfc7-bd1c-49a6-a190-71bdc8523c94 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:41.411945 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9cfc7-bd1c-49a6-a190-71bdc8523c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:41.486049 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-19d9cfc7-bd1c-49a6-a190-71bdc8523c94 None None] MFA Rules not processed for user `b2a13ad25f27471792ba0758602b6e63`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:24:41.487751 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-19d9cfc7-bd1c-49a6-a190-71bdc8523c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:24:41.617223 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 858/1708] 10.222.0.48 () {58 vars in 1015 bytes} [Mon May 9 20:24:41 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:24:41.712526 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52d81bf-08f2-49ab-aa68-eb56874c25eb None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:41.715959 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-c52d81bf-08f2-49ab-aa68-eb56874c25eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:24:41.733452 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52d81bf-08f2-49ab-aa68-eb56874c25eb None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:41.761230 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7835866-0d0f-42d7-849a-910ceb7b55aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:41.764229 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7835866-0d0f-42d7-849a-910ceb7b55aa service neutron] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:41.768478 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7835866-0d0f-42d7-849a-910ceb7b55aa service neutron] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:41.768963 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7835866-0d0f-42d7-849a-910ceb7b55aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:41.783761 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 851/1709] 10.222.0.44 () {58 vars in 1009 bytes} [Mon May 9 20:24:41 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) May 09 20:24:41.803867 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7835866-0d0f-42d7-849a-910ceb7b55aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:41.806130 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7835866-0d0f-42d7-849a-910ceb7b55aa service neutron] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:41.833856 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 859/1710] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:24:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:24:41.853089 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d9cfc7-bd1c-49a6-a190-71bdc8523c94 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:41.866893 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d9cfc7-bd1c-49a6-a190-71bdc8523c94 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:41.878647 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffcee6f-4671-4668-bfb3-64c99aaea596 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:41.881256 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffcee6f-4671-4668-bfb3-64c99aaea596 service neutron] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:41.881778 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffcee6f-4671-4668-bfb3-64c99aaea596 service neutron] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:41.885623 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffcee6f-4671-4668-bfb3-64c99aaea596 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:41.917518 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffcee6f-4671-4668-bfb3-64c99aaea596 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:41.923905 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffcee6f-4671-4668-bfb3-64c99aaea596 service neutron] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:41.959952 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 852/1711] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:24:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:24:45.638888 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d99e88-5861-4935-ae16-9dfd6603df66 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:45.639362 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d99e88-5861-4935-ae16-9dfd6603df66 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:45.639547 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d99e88-5861-4935-ae16-9dfd6603df66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:45.696826 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-a5d99e88-5861-4935-ae16-9dfd6603df66 None None] MFA Rules not processed for user `797d7c0dfda747549456236e9e639466`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:24:45.706817 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-a5d99e88-5861-4935-ae16-9dfd6603df66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:24:45.733893 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 860/1712] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:24:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:24:47.266667 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10bb41-34f7-481f-b74b-dcd4a89e4db8 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:47.267242 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10bb41-34f7-481f-b74b-dcd4a89e4db8 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:47.267242 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10bb41-34f7-481f-b74b-dcd4a89e4db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:47.308078 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-1e10bb41-34f7-481f-b74b-dcd4a89e4db8 None None] MFA Rules not processed for user `dee809a4a41f4d2c91edb83c1f4d224c`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:24:47.309527 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-1e10bb41-34f7-481f-b74b-dcd4a89e4db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:24:47.350420 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 853/1713] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:24:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:24:47.711645 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a82fa-da83-46f5-86dd-05e64c3e3ad7 None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:47.712225 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a82fa-da83-46f5-86dd-05e64c3e3ad7 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:47.712225 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a82fa-da83-46f5-86dd-05e64c3e3ad7 None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:47.713796 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 861/1714] 10.222.0.44 () {54 vars in 921 bytes} [Mon May 9 20:24:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:24:47.770567 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbdc055-d787-4652-9100-4c51eeee05af None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:47.770852 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbdc055-d787-4652-9100-4c51eeee05af None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:47.771127 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbdc055-d787-4652-9100-4c51eeee05af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:47.841874 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-3bbdc055-d787-4652-9100-4c51eeee05af None None] MFA Rules not processed for user `eb59440b21074d9da15679dc2d745f72`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:24:47.859565 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-3bbdc055-d787-4652-9100-4c51eeee05af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:24:47.909402 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 854/1715] 10.222.0.44 () {58 vars in 1018 bytes} [Mon May 9 20:24:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:24:48.411551 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0a82fa-da83-46f5-86dd-05e64c3e3ad7 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:48.444877 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0a82fa-da83-46f5-86dd-05e64c3e3ad7 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:48.461072 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13499b5e-44ca-4545-97de-6f4a0cf35b81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb59440b21074d9da15679dc2d745f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:48.461772 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13499b5e-44ca-4545-97de-6f4a0cf35b81 service nova] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:48.462051 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13499b5e-44ca-4545-97de-6f4a0cf35b81 service nova] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:48.462323 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13499b5e-44ca-4545-97de-6f4a0cf35b81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:48.493455 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13499b5e-44ca-4545-97de-6f4a0cf35b81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:48.498004 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13499b5e-44ca-4545-97de-6f4a0cf35b81 service nova] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:48.532326 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 862/1716] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:24:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:24:49.696740 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c10066-3743-4f5b-976a-cb462704267b None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:49.697595 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c10066-3743-4f5b-976a-cb462704267b None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:49.698294 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c10066-3743-4f5b-976a-cb462704267b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:49.738705 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-08c10066-3743-4f5b-976a-cb462704267b None None] MFA Rules not processed for user `d9342c8759514113aeec13ce910e4a21`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:24:49.741037 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-08c10066-3743-4f5b-976a-cb462704267b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:24:49.880276 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 855/1717] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:24:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:24:49.896672 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13499b5e-44ca-4545-97de-6f4a0cf35b81 service nova] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:49.916222 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13499b5e-44ca-4545-97de-6f4a0cf35b81 service nova] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:49.940427 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9285f787-5d25-4e0f-868f-ffbc1397589f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb59440b21074d9da15679dc2d745f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:49.941963 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9285f787-5d25-4e0f-868f-ffbc1397589f service nova] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:49.942967 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9285f787-5d25-4e0f-868f-ffbc1397589f service nova] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:49.944942 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9285f787-5d25-4e0f-868f-ffbc1397589f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:49.960088 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9285f787-5d25-4e0f-868f-ffbc1397589f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:49.963229 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9285f787-5d25-4e0f-868f-ffbc1397589f service nova] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:49.977802 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 863/1718] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:24:49 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:24:50.966539 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf71bd-374f-41d2-b866-c20068c39f24 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:50.967167 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf71bd-374f-41d2-b866-c20068c39f24 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:50.967167 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf71bd-374f-41d2-b866-c20068c39f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:51.034714 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-55cf71bd-374f-41d2-b866-c20068c39f24 None None] MFA Rules not processed for user `38716aefb55246079de2658159fd5ca4`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:24:51.036004 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-55cf71bd-374f-41d2-b866-c20068c39f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:24:51.214557 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 856/1719] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:24:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:24:51.221752 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9285f787-5d25-4e0f-868f-ffbc1397589f service nova] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:24:51.237080 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9285f787-5d25-4e0f-868f-ffbc1397589f service nova] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:24:51.253454 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfeb091-6930-4c03-b831-fa6d529360fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb59440b21074d9da15679dc2d745f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:24:51.254112 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfeb091-6930-4c03-b831-fa6d529360fb service nova] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:51.254389 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfeb091-6930-4c03-b831-fa6d529360fb service nova] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:51.254653 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfeb091-6930-4c03-b831-fa6d529360fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:51.281785 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfeb091-6930-4c03-b831-fa6d529360fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:24:51.284354 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfeb091-6930-4c03-b831-fa6d529360fb service nova] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:24:51.308325 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 864/1720] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:24:51 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:24:53.475964 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff8eb9-c40e-4275-933c-d46ecd7c81b3 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:53.476452 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff8eb9-c40e-4275-933c-d46ecd7c81b3 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:53.482206 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff8eb9-c40e-4275-933c-d46ecd7c81b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:53.517157 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-deff8eb9-c40e-4275-933c-d46ecd7c81b3 None None] MFA Rules not processed for user `d9342c8759514113aeec13ce910e4a21`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:24:53.518741 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-deff8eb9-c40e-4275-933c-d46ecd7c81b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:24:53.526680 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 857/1721] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:24:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:24:54.154328 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af0d46-5e7b-4a98-b831-6476be8e7ffc None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:24:54.155244 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af0d46-5e7b-4a98-b831-6476be8e7ffc None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:24:54.155708 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af0d46-5e7b-4a98-b831-6476be8e7ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:24:54.204556 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-56af0d46-5e7b-4a98-b831-6476be8e7ffc None None] MFA Rules not processed for user `38716aefb55246079de2658159fd5ca4`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:24:54.206073 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-56af0d46-5e7b-4a98-b831-6476be8e7ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:24:54.221353 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 865/1722] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:24:54 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:25:00.722186 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064953ef-0795-4999-8c9b-7161bb10a3fb None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:00.722658 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064953ef-0795-4999-8c9b-7161bb10a3fb None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:00.722728 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064953ef-0795-4999-8c9b-7161bb10a3fb None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:00.728710 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 858/1723] 10.222.0.44 () {54 vars in 921 bytes} [Mon May 9 20:25:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:25:00.738014 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd84dd5-2e55-4cac-98a7-e823a4542556 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:00.738526 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd84dd5-2e55-4cac-98a7-e823a4542556 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:00.738598 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd84dd5-2e55-4cac-98a7-e823a4542556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:00.747906 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064953ef-0795-4999-8c9b-7161bb10a3fb None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:00.786171 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-fcd84dd5-2e55-4cac-98a7-e823a4542556 None None] MFA Rules not processed for user `eb59440b21074d9da15679dc2d745f72`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:25:00.794144 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-fcd84dd5-2e55-4cac-98a7-e823a4542556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:00.828071 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 866/1724] 10.222.0.44 () {58 vars in 1018 bytes} [Mon May 9 20:25:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:25:00.844445 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd84dd5-2e55-4cac-98a7-e823a4542556 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:00.859965 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd84dd5-2e55-4cac-98a7-e823a4542556 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:00.865728 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a719d379-1fe7-435b-824b-4881a543ffcb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb59440b21074d9da15679dc2d745f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:00.866388 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a719d379-1fe7-435b-824b-4881a543ffcb service nova] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:00.866666 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a719d379-1fe7-435b-824b-4881a543ffcb service nova] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:00.866931 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a719d379-1fe7-435b-824b-4881a543ffcb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:00.893305 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064953ef-0795-4999-8c9b-7161bb10a3fb None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:00.896373 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a719d379-1fe7-435b-824b-4881a543ffcb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:00.899621 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dbb3a5-9075-4c4a-9163-a49694017b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:00.899752 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a719d379-1fe7-435b-824b-4881a543ffcb service nova] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:00.900630 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dbb3a5-9075-4c4a-9163-a49694017b8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:00.900917 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dbb3a5-9075-4c4a-9163-a49694017b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:00.901195 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dbb3a5-9075-4c4a-9163-a49694017b8b admin admin] PATH_INFO: `/v3/users/e97a748c810a4bab992edd6b86c0931a` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:00.903198 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dbb3a5-9075-4c4a-9163-a49694017b8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e97a748c810a4bab992edd6b86c0931a)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:00.905451 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dbb3a5-9075-4c4a-9163-a49694017b8b admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:00.917121 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 867/1725] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:25:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:25:00.970729 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-f6dbb3a5-9075-4c4a-9163-a49694017b8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e97a748c810a4bab992edd6b86c0931a'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:00.977738 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-f6dbb3a5-9075-4c4a-9163-a49694017b8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e97a748c810a4bab992edd6b86c0931a'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:00.986842 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-f6dbb3a5-9075-4c4a-9163-a49694017b8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e97a748c810a4bab992edd6b86c0931a'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:00.987592 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-f6dbb3a5-9075-4c4a-9163-a49694017b8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e97a748c810a4bab992edd6b86c0931a'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:00.988504 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-f6dbb3a5-9075-4c4a-9163-a49694017b8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e97a748c810a4bab992edd6b86c0931a'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:01.017261 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 859/1726] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:25:00 2022] DELETE /identity/v3/users/e97a748c810a4bab992edd6b86c0931a => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:25:01.021740 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65410eeb-96f3-4bd8-884d-324f95abb501 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:01.022166 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65410eeb-96f3-4bd8-884d-324f95abb501 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:01.022531 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65410eeb-96f3-4bd8-884d-324f95abb501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:01.040992 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-65410eeb-96f3-4bd8-884d-324f95abb501 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:25:01.042315 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-65410eeb-96f3-4bd8-884d-324f95abb501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:01.102086 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 868/1727] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:25:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:25:01.112919 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dbb3a5-9075-4c4a-9163-a49694017b8b admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:01.114579 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-f6dbb3a5-9075-4c4a-9163-a49694017b8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:01.176113 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dbb3a5-9075-4c4a-9163-a49694017b8b admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:01.180017 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ad1c5d-66ab-4a06-94d7-4aeffb3424aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:01.180670 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad1c5d-66ab-4a06-94d7-4aeffb3424aa service neutron] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:01.180963 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad1c5d-66ab-4a06-94d7-4aeffb3424aa service neutron] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:01.181249 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad1c5d-66ab-4a06-94d7-4aeffb3424aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:01.192153 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ad1c5d-66ab-4a06-94d7-4aeffb3424aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:01.193785 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ad1c5d-66ab-4a06-94d7-4aeffb3424aa service neutron] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:01.217325 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 860/1728] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:25:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:25:02.332692 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65410eeb-96f3-4bd8-884d-324f95abb501 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:02.334146 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-65410eeb-96f3-4bd8-884d-324f95abb501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:02.346747 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65410eeb-96f3-4bd8-884d-324f95abb501 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:02.352015 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73901d7b-4b65-4a70-832a-2c4a1d535cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:02.353156 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73901d7b-4b65-4a70-832a-2c4a1d535cd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:02.353635 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73901d7b-4b65-4a70-832a-2c4a1d535cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:02.354101 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73901d7b-4b65-4a70-832a-2c4a1d535cd2 admin admin] PATH_INFO: `/v3/users/a269ec312d224e1bb8dde565d24f4f71` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:02.355563 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73901d7b-4b65-4a70-832a-2c4a1d535cd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a269ec312d224e1bb8dde565d24f4f71)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:02.357693 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73901d7b-4b65-4a70-832a-2c4a1d535cd2 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:02.414256 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-73901d7b-4b65-4a70-832a-2c4a1d535cd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a269ec312d224e1bb8dde565d24f4f71'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:02.414972 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-73901d7b-4b65-4a70-832a-2c4a1d535cd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a269ec312d224e1bb8dde565d24f4f71'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:02.423874 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-73901d7b-4b65-4a70-832a-2c4a1d535cd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a269ec312d224e1bb8dde565d24f4f71'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:02.424561 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-73901d7b-4b65-4a70-832a-2c4a1d535cd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a269ec312d224e1bb8dde565d24f4f71'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:02.435699 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-73901d7b-4b65-4a70-832a-2c4a1d535cd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a269ec312d224e1bb8dde565d24f4f71'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:02.460067 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 869/1729] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:25:02 2022] DELETE /identity/v3/users/a269ec312d224e1bb8dde565d24f4f71 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:25:02.466061 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab0538-27d8-4aba-8ad9-b7ffd21ed7fb None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:02.466632 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab0538-27d8-4aba-8ad9-b7ffd21ed7fb None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:02.466971 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab0538-27d8-4aba-8ad9-b7ffd21ed7fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:02.496676 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-00ab0538-27d8-4aba-8ad9-b7ffd21ed7fb None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:25:02.509522 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-00ab0538-27d8-4aba-8ad9-b7ffd21ed7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:02.626333 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 861/1730] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:25:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:25:02.674877 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73901d7b-4b65-4a70-832a-2c4a1d535cd2 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:02.680543 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-73901d7b-4b65-4a70-832a-2c4a1d535cd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:02.789612 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73901d7b-4b65-4a70-832a-2c4a1d535cd2 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:02.797939 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20597e6c-9cc3-4a35-93bd-2dc53fc1d2ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:02.800164 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20597e6c-9cc3-4a35-93bd-2dc53fc1d2ca service neutron] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:02.800939 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20597e6c-9cc3-4a35-93bd-2dc53fc1d2ca service neutron] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:02.801528 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20597e6c-9cc3-4a35-93bd-2dc53fc1d2ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:02.819613 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20597e6c-9cc3-4a35-93bd-2dc53fc1d2ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:02.822143 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20597e6c-9cc3-4a35-93bd-2dc53fc1d2ca service neutron] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:02.838435 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 870/1731] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:25:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:25:03.340838 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ab0538-27d8-4aba-8ad9-b7ffd21ed7fb None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:03.343244 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-00ab0538-27d8-4aba-8ad9-b7ffd21ed7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:03.377898 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ab0538-27d8-4aba-8ad9-b7ffd21ed7fb None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:03.387723 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a4a7b9-a9d7-4e90-bf0b-587930c2ca22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:03.389128 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a4a7b9-a9d7-4e90-bf0b-587930c2ca22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:03.389799 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a4a7b9-a9d7-4e90-bf0b-587930c2ca22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:03.390254 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a4a7b9-a9d7-4e90-bf0b-587930c2ca22 admin admin] PATH_INFO: `/v3/projects/fda8d05547b54fed9a24ad50d05410e3` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:03.392053 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a4a7b9-a9d7-4e90-bf0b-587930c2ca22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fda8d05547b54fed9a24ad50d05410e3)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:03.395248 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a4a7b9-a9d7-4e90-bf0b-587930c2ca22 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:03.527094 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-09a4a7b9-a9d7-4e90-bf0b-587930c2ca22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fda8d05547b54fed9a24ad50d05410e3', 'request_id': 'req-09a4a7b9-a9d7-4e90-bf0b-587930c2ca22'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:03.534412 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-09a4a7b9-a9d7-4e90-bf0b-587930c2ca22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fda8d05547b54fed9a24ad50d05410e3', 'request_id': 'req-09a4a7b9-a9d7-4e90-bf0b-587930c2ca22'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:03.559775 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-09a4a7b9-a9d7-4e90-bf0b-587930c2ca22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fda8d05547b54fed9a24ad50d05410e3', 'request_id': 'req-09a4a7b9-a9d7-4e90-bf0b-587930c2ca22'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:03.588495 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-09a4a7b9-a9d7-4e90-bf0b-587930c2ca22 admin admin] The token cache is being invalidate because project fda8d05547b54fed9a24ad50d05410e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:25:03.589841 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-09a4a7b9-a9d7-4e90-bf0b-587930c2ca22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:03.590527 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-09a4a7b9-a9d7-4e90-bf0b-587930c2ca22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:03.592474 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 862/1732] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:25:03 2022] DELETE /identity/v3/projects/fda8d05547b54fed9a24ad50d05410e3 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:25:03.596640 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20597e6c-9cc3-4a35-93bd-2dc53fc1d2ca service neutron] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:03.611108 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20597e6c-9cc3-4a35-93bd-2dc53fc1d2ca service neutron] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:03.711174 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd31b42c-4e54-4549-b9d1-a3b8b1ddf389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:03.712768 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd31b42c-4e54-4549-b9d1-a3b8b1ddf389 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:03.713055 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd31b42c-4e54-4549-b9d1-a3b8b1ddf389 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:03.713322 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd31b42c-4e54-4549-b9d1-a3b8b1ddf389 admin admin] PATH_INFO: `/v3/users/9e8cf3f57a8d4ad89cfac5aedbc5c8d0` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:03.730075 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd31b42c-4e54-4549-b9d1-a3b8b1ddf389 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e8cf3f57a8d4ad89cfac5aedbc5c8d0)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:03.735376 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd31b42c-4e54-4549-b9d1-a3b8b1ddf389 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:03.818057 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-bd31b42c-4e54-4549-b9d1-a3b8b1ddf389 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e8cf3f57a8d4ad89cfac5aedbc5c8d0'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:03.819081 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-bd31b42c-4e54-4549-b9d1-a3b8b1ddf389 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e8cf3f57a8d4ad89cfac5aedbc5c8d0'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:03.829557 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-bd31b42c-4e54-4549-b9d1-a3b8b1ddf389 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e8cf3f57a8d4ad89cfac5aedbc5c8d0'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:03.831626 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-bd31b42c-4e54-4549-b9d1-a3b8b1ddf389 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e8cf3f57a8d4ad89cfac5aedbc5c8d0'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:03.848317 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-bd31b42c-4e54-4549-b9d1-a3b8b1ddf389 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e8cf3f57a8d4ad89cfac5aedbc5c8d0'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:03.887820 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 871/1733] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:25:03 2022] DELETE /identity/v3/users/9e8cf3f57a8d4ad89cfac5aedbc5c8d0 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:25:04.104234 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a4a7b9-a9d7-4e90-bf0b-587930c2ca22 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:04.113510 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-09a4a7b9-a9d7-4e90-bf0b-587930c2ca22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:04.137890 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a4a7b9-a9d7-4e90-bf0b-587930c2ca22 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:04.272370 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab59b0f-6e23-47bb-8b38-d3312187b125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:04.274857 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab59b0f-6e23-47bb-8b38-d3312187b125 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:04.275593 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab59b0f-6e23-47bb-8b38-d3312187b125 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:04.276056 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab59b0f-6e23-47bb-8b38-d3312187b125 admin admin] PATH_INFO: `/v3/projects/cbc55eab146c40fe9aa70847ab9406c4` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:04.278524 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab59b0f-6e23-47bb-8b38-d3312187b125 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbc55eab146c40fe9aa70847ab9406c4)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:04.280960 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab59b0f-6e23-47bb-8b38-d3312187b125 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:04.397702 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-6ab59b0f-6e23-47bb-8b38-d3312187b125 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbc55eab146c40fe9aa70847ab9406c4', 'request_id': 'req-6ab59b0f-6e23-47bb-8b38-d3312187b125'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:04.419900 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-6ab59b0f-6e23-47bb-8b38-d3312187b125 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbc55eab146c40fe9aa70847ab9406c4', 'request_id': 'req-6ab59b0f-6e23-47bb-8b38-d3312187b125'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:04.431293 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-6ab59b0f-6e23-47bb-8b38-d3312187b125 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbc55eab146c40fe9aa70847ab9406c4', 'request_id': 'req-6ab59b0f-6e23-47bb-8b38-d3312187b125'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:04.458908 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-6ab59b0f-6e23-47bb-8b38-d3312187b125 admin admin] The token cache is being invalidate because project cbc55eab146c40fe9aa70847ab9406c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:25:04.459514 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-6ab59b0f-6e23-47bb-8b38-d3312187b125 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:04.460839 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-6ab59b0f-6e23-47bb-8b38-d3312187b125 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:04.465498 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 863/1734] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:25:04 2022] DELETE /identity/v3/projects/cbc55eab146c40fe9aa70847ab9406c4 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:25:04.469724 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd31b42c-4e54-4549-b9d1-a3b8b1ddf389 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:04.471316 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-bd31b42c-4e54-4549-b9d1-a3b8b1ddf389 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:04.490374 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd31b42c-4e54-4549-b9d1-a3b8b1ddf389 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:04.513760 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab59b0f-6e23-47bb-8b38-d3312187b125 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:04.515736 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-6ab59b0f-6e23-47bb-8b38-d3312187b125 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:04.670906 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b1c88f-e327-440c-b4b3-00049a748090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:04.671905 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b1c88f-e327-440c-b4b3-00049a748090 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:04.672863 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b1c88f-e327-440c-b4b3-00049a748090 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:04.673672 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b1c88f-e327-440c-b4b3-00049a748090 admin admin] PATH_INFO: `/v3/users/3cc050c3efa84c51a2449831b75255e8` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:04.678309 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b1c88f-e327-440c-b4b3-00049a748090 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cc050c3efa84c51a2449831b75255e8)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:04.680363 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b1c88f-e327-440c-b4b3-00049a748090 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:04.691444 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab59b0f-6e23-47bb-8b38-d3312187b125 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:04.697030 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1507b6e1-1d86-4c33-8d8e-17568da77810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:04.698102 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1507b6e1-1d86-4c33-8d8e-17568da77810 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:04.698530 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1507b6e1-1d86-4c33-8d8e-17568da77810 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:04.698955 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1507b6e1-1d86-4c33-8d8e-17568da77810 admin admin] PATH_INFO: `/v3/projects/c210a719a8e34777a2fbfbe70501ef11` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:04.700652 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1507b6e1-1d86-4c33-8d8e-17568da77810 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c210a719a8e34777a2fbfbe70501ef11)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:04.702815 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1507b6e1-1d86-4c33-8d8e-17568da77810 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:04.793032 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-b0b1c88f-e327-440c-b4b3-00049a748090 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cc050c3efa84c51a2449831b75255e8'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:04.794369 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-b0b1c88f-e327-440c-b4b3-00049a748090 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cc050c3efa84c51a2449831b75255e8'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:04.808876 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-1507b6e1-1d86-4c33-8d8e-17568da77810 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c210a719a8e34777a2fbfbe70501ef11', 'request_id': 'req-1507b6e1-1d86-4c33-8d8e-17568da77810'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:04.821725 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-1507b6e1-1d86-4c33-8d8e-17568da77810 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c210a719a8e34777a2fbfbe70501ef11', 'request_id': 'req-1507b6e1-1d86-4c33-8d8e-17568da77810'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:04.822693 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-b0b1c88f-e327-440c-b4b3-00049a748090 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cc050c3efa84c51a2449831b75255e8'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:04.823726 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-b0b1c88f-e327-440c-b4b3-00049a748090 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cc050c3efa84c51a2449831b75255e8'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:04.840348 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-1507b6e1-1d86-4c33-8d8e-17568da77810 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c210a719a8e34777a2fbfbe70501ef11', 'request_id': 'req-1507b6e1-1d86-4c33-8d8e-17568da77810'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:04.845160 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-b0b1c88f-e327-440c-b4b3-00049a748090 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cc050c3efa84c51a2449831b75255e8'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:04.868518 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-1507b6e1-1d86-4c33-8d8e-17568da77810 admin admin] The token cache is being invalidate because project c210a719a8e34777a2fbfbe70501ef11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:25:04.868949 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-1507b6e1-1d86-4c33-8d8e-17568da77810 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:04.871482 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-1507b6e1-1d86-4c33-8d8e-17568da77810 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:04.874103 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 864/1735] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:25:04 2022] DELETE /identity/v3/projects/c210a719a8e34777a2fbfbe70501ef11 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:25:04.880385 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee7c4a-40e9-4bc3-a0cc-2c0fada148c5 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:04.884099 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee7c4a-40e9-4bc3-a0cc-2c0fada148c5 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:04.884745 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee7c4a-40e9-4bc3-a0cc-2c0fada148c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:04.893285 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 872/1736] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:25:04 2022] DELETE /identity/v3/users/3cc050c3efa84c51a2449831b75255e8 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:25:04.908955 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-27ee7c4a-40e9-4bc3-a0cc-2c0fada148c5 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:25:04.911130 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-27ee7c4a-40e9-4bc3-a0cc-2c0fada148c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:05.014697 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 865/1737] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:25:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:25:05.023468 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df4afb-cd33-44a4-977a-7ca116238ce0 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:05.024012 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df4afb-cd33-44a4-977a-7ca116238ce0 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:05.024314 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df4afb-cd33-44a4-977a-7ca116238ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:05.048061 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-40df4afb-cd33-44a4-977a-7ca116238ce0 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:25:05.049385 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-40df4afb-cd33-44a4-977a-7ca116238ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:05.058291 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 873/1738] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:25:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:25:05.062931 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ee7c4a-40e9-4bc3-a0cc-2c0fada148c5 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:05.073477 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ee7c4a-40e9-4bc3-a0cc-2c0fada148c5 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:05.079350 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47d6dab-ddaf-42e0-ae75-c9ebf2c8dd88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:05.080321 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d6dab-ddaf-42e0-ae75-c9ebf2c8dd88 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:05.080606 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d6dab-ddaf-42e0-ae75-c9ebf2c8dd88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:05.080878 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d6dab-ddaf-42e0-ae75-c9ebf2c8dd88 admin admin] PATH_INFO: `/v3/domains` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:05.081616 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47d6dab-ddaf-42e0-ae75-c9ebf2c8dd88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:25:05.081922 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47d6dab-ddaf-42e0-ae75-c9ebf2c8dd88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:05.083577 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47d6dab-ddaf-42e0-ae75-c9ebf2c8dd88 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:05.096332 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 866/1739] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 9 20:25:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:25:05.100707 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40df4afb-cd33-44a4-977a-7ca116238ce0 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:05.112347 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40df4afb-cd33-44a4-977a-7ca116238ce0 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:05.138041 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d098e4-74cb-41c1-9505-8652b5c34f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:05.138916 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d098e4-74cb-41c1-9505-8652b5c34f7a admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:05.139340 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d098e4-74cb-41c1-9505-8652b5c34f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:05.139767 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d098e4-74cb-41c1-9505-8652b5c34f7a admin admin] PATH_INFO: `/v3/projects` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:05.140586 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d098e4-74cb-41c1-9505-8652b5c34f7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:05.142605 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d098e4-74cb-41c1-9505-8652b5c34f7a admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:05.161110 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66965280-35d0-4d7d-bfb1-4910ccc66095 None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:05.161562 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66965280-35d0-4d7d-bfb1-4910ccc66095 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:05.161979 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66965280-35d0-4d7d-bfb1-4910ccc66095 None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:05.163801 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 867/1740] 10.222.0.44 () {54 vars in 921 bytes} [Mon May 9 20:25:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 20:25:05.173857 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aec5ff-0901-4540-a55c-a2a5e069e5d8 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:05.174182 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aec5ff-0901-4540-a55c-a2a5e069e5d8 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:05.174515 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aec5ff-0901-4540-a55c-a2a5e069e5d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:05.189600 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 874/1741] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:25:05 2022] POST /identity/v3/projects => generated 369 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:25:05.195876 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d098e4-74cb-41c1-9505-8652b5c34f7a admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:05.209585 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-90aec5ff-0901-4540-a55c-a2a5e069e5d8 None None] MFA Rules not processed for user `eb59440b21074d9da15679dc2d745f72`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:25:05.211333 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-90aec5ff-0901-4540-a55c-a2a5e069e5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:05.286575 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d098e4-74cb-41c1-9505-8652b5c34f7a admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:05.301298 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6956bace-da15-4c38-83e8-62b31ef0c088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:05.302001 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956bace-da15-4c38-83e8-62b31ef0c088 admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:05.303115 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956bace-da15-4c38-83e8-62b31ef0c088 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:05.303467 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956bace-da15-4c38-83e8-62b31ef0c088 admin admin] PATH_INFO: `/v3/users` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:05.304686 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6956bace-da15-4c38-83e8-62b31ef0c088 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:05.309391 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 868/1742] 10.222.0.44 () {58 vars in 1018 bytes} [Mon May 9 20:25:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:25:05.311910 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6956bace-da15-4c38-83e8-62b31ef0c088 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:05.348941 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 875/1743] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:25:05 2022] POST /identity/v3/users => generated 285 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:25:05.349338 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aec5ff-0901-4540-a55c-a2a5e069e5d8 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:05.360215 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6956bace-da15-4c38-83e8-62b31ef0c088 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:05.364022 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-6956bace-da15-4c38-83e8-62b31ef0c088 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:05.389047 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6956bace-da15-4c38-83e8-62b31ef0c088 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:05.392468 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aec5ff-0901-4540-a55c-a2a5e069e5d8 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:05.396704 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b73902b-c688-4355-ac85-61cd4cdba9f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb59440b21074d9da15679dc2d745f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:05.397462 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b73902b-c688-4355-ac85-61cd4cdba9f6 service nova] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:05.397741 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b73902b-c688-4355-ac85-61cd4cdba9f6 service nova] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:05.398008 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b73902b-c688-4355-ac85-61cd4cdba9f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:05.398388 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b602743b-91ba-4c5d-bdaa-8337657d7d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:05.399782 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b602743b-91ba-4c5d-bdaa-8337657d7d32 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:05.400148 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b602743b-91ba-4c5d-bdaa-8337657d7d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:05.400498 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b602743b-91ba-4c5d-bdaa-8337657d7d32 admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:05.401303 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b602743b-91ba-4c5d-bdaa-8337657d7d32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:05.403653 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b602743b-91ba-4c5d-bdaa-8337657d7d32 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:05.408565 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b73902b-c688-4355-ac85-61cd4cdba9f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:05.410598 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b73902b-c688-4355-ac85-61cd4cdba9f6 service nova] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:05.416407 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 869/1744] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:25:05.420948 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b602743b-91ba-4c5d-bdaa-8337657d7d32 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:05.429250 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 876/1745] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:25:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:25:05.443708 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b73902b-c688-4355-ac85-61cd4cdba9f6 service nova] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:05.445930 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-4b73902b-c688-4355-ac85-61cd4cdba9f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:05.473501 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b602743b-91ba-4c5d-bdaa-8337657d7d32 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:05.496721 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05708c81-f537-420c-81d0-beafcc0ed4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:05.497408 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05708c81-f537-420c-81d0-beafcc0ed4ce admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:05.497694 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05708c81-f537-420c-81d0-beafcc0ed4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:05.498185 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05708c81-f537-420c-81d0-beafcc0ed4ce admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:05.498918 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05708c81-f537-420c-81d0-beafcc0ed4ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:05.499790 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b73902b-c688-4355-ac85-61cd4cdba9f6 service nova] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:05.500613 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05708c81-f537-420c-81d0-beafcc0ed4ce admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:05.515255 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494f3fc1-ee89-4bd3-9dac-47259a99e103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:05.516232 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f3fc1-ee89-4bd3-9dac-47259a99e103 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:05.516512 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f3fc1-ee89-4bd3-9dac-47259a99e103 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:05.516836 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f3fc1-ee89-4bd3-9dac-47259a99e103 admin admin] PATH_INFO: `/v3/projects/8449a3c0d42644b9a71f3b44527357ae` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:05.518286 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494f3fc1-ee89-4bd3-9dac-47259a99e103 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8449a3c0d42644b9a71f3b44527357ae)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:05.520272 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494f3fc1-ee89-4bd3-9dac-47259a99e103 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:05.526493 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 870/1746] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:25:05.532469 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05708c81-f537-420c-81d0-beafcc0ed4ce admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:05.555221 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05708c81-f537-420c-81d0-beafcc0ed4ce admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:05.561169 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6dbf31-458f-4a23-8f8f-a0aec0ebdb44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:05.562428 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6dbf31-458f-4a23-8f8f-a0aec0ebdb44 admin admin] REQUEST_METHOD: `PUT` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:05.563114 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6dbf31-458f-4a23-8f8f-a0aec0ebdb44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:05.563621 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6dbf31-458f-4a23-8f8f-a0aec0ebdb44 admin admin] PATH_INFO: `/v3/projects/09d1a32f43e1401da50a8571a3385338/users/2a3e6bc4efd744668cf077d38e84f35e/roles/79f90a0bf6ea43d0b3c434e31556253a` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:05.577635 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-494f3fc1-ee89-4bd3-9dac-47259a99e103 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8449a3c0d42644b9a71f3b44527357ae', 'request_id': 'req-494f3fc1-ee89-4bd3-9dac-47259a99e103'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:05.582242 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6dbf31-458f-4a23-8f8f-a0aec0ebdb44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09d1a32f43e1401da50a8571a3385338, user_id=2a3e6bc4efd744668cf077d38e84f35e, role_id=79f90a0bf6ea43d0b3c434e31556253a)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:05.586001 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-494f3fc1-ee89-4bd3-9dac-47259a99e103 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8449a3c0d42644b9a71f3b44527357ae', 'request_id': 'req-494f3fc1-ee89-4bd3-9dac-47259a99e103'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:05.586458 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6dbf31-458f-4a23-8f8f-a0aec0ebdb44 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:05.593974 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-494f3fc1-ee89-4bd3-9dac-47259a99e103 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8449a3c0d42644b9a71f3b44527357ae', 'request_id': 'req-494f3fc1-ee89-4bd3-9dac-47259a99e103'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:05.606227 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 871/1747] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:25:05 2022] PUT /identity/v3/projects/09d1a32f43e1401da50a8571a3385338/users/2a3e6bc4efd744668cf077d38e84f35e/roles/79f90a0bf6ea43d0b3c434e31556253a => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:25:05.617242 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d4e2b-5fa7-4f91-8fbe-711f6c7095cc None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:05.617412 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-494f3fc1-ee89-4bd3-9dac-47259a99e103 admin admin] The token cache is being invalidate because project 8449a3c0d42644b9a71f3b44527357ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:25:05.617755 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-494f3fc1-ee89-4bd3-9dac-47259a99e103 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:05.618502 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-494f3fc1-ee89-4bd3-9dac-47259a99e103 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:05.620232 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d4e2b-5fa7-4f91-8fbe-711f6c7095cc None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:05.620624 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 877/1748] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:25:05 2022] DELETE /identity/v3/projects/8449a3c0d42644b9a71f3b44527357ae => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:25:05.620728 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d4e2b-5fa7-4f91-8fbe-711f6c7095cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:05.625256 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12efed68-36eb-4142-bc53-3f3dc18a2cd9 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:05.625542 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12efed68-36eb-4142-bc53-3f3dc18a2cd9 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:05.625832 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12efed68-36eb-4142-bc53-3f3dc18a2cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:05.651412 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-12efed68-36eb-4142-bc53-3f3dc18a2cd9 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:25:05.653733 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-12efed68-36eb-4142-bc53-3f3dc18a2cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:05.681751 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-662d4e2b-5fa7-4f91-8fbe-711f6c7095cc None None] MFA Rules not processed for user `2a3e6bc4efd744668cf077d38e84f35e`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:25:05.683458 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-662d4e2b-5fa7-4f91-8fbe-711f6c7095cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:05.751074 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 878/1749] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:25:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:25:05.752961 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957bf892-6b55-461a-a7c4-06507c4900d6 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:05.753260 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957bf892-6b55-461a-a7c4-06507c4900d6 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:05.753517 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957bf892-6b55-461a-a7c4-06507c4900d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:05.787614 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-957bf892-6b55-461a-a7c4-06507c4900d6 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:25:05.791877 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-957bf892-6b55-461a-a7c4-06507c4900d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:05.807388 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 879/1750] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:25:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:25:05.808768 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957bf892-6b55-461a-a7c4-06507c4900d6 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:05.820909 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957bf892-6b55-461a-a7c4-06507c4900d6 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:05.827853 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bff6fe0-f764-45f0-b5bf-743d925a6248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:05.828535 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff6fe0-f764-45f0-b5bf-743d925a6248 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:05.828821 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff6fe0-f764-45f0-b5bf-743d925a6248 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:05.829172 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff6fe0-f764-45f0-b5bf-743d925a6248 admin admin] PATH_INFO: `/v3/domains` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:05.830046 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bff6fe0-f764-45f0-b5bf-743d925a6248 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:25:05.830362 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bff6fe0-f764-45f0-b5bf-743d925a6248 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:05.832505 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bff6fe0-f764-45f0-b5bf-743d925a6248 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:05.834301 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 872/1751] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:25:05 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:25:05.838776 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662d4e2b-5fa7-4f91-8fbe-711f6c7095cc None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:05.844032 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-662d4e2b-5fa7-4f91-8fbe-711f6c7095cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:05.863872 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 880/1752] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 9 20:25:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:25:05.865176 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bff6fe0-f764-45f0-b5bf-743d925a6248 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:05.872605 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662d4e2b-5fa7-4f91-8fbe-711f6c7095cc None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:05.891321 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbde2d37-13ec-430f-a7fa-d1f128542113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:05.892072 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde2d37-13ec-430f-a7fa-d1f128542113 admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:05.892502 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde2d37-13ec-430f-a7fa-d1f128542113 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:05.892780 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde2d37-13ec-430f-a7fa-d1f128542113 admin admin] PATH_INFO: `/v3/projects` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:05.893518 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbde2d37-13ec-430f-a7fa-d1f128542113 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:05.897596 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bff6fe0-f764-45f0-b5bf-743d925a6248 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:05.908930 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbde2d37-13ec-430f-a7fa-d1f128542113 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:05.914517 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2efdc9-46d1-4f03-a1a5-ab5c65c577e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:05.915196 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2efdc9-46d1-4f03-a1a5-ab5c65c577e5 admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:05.915502 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2efdc9-46d1-4f03-a1a5-ab5c65c577e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:05.915778 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2efdc9-46d1-4f03-a1a5-ab5c65c577e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:05.916482 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2efdc9-46d1-4f03-a1a5-ab5c65c577e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:05.930531 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2efdc9-46d1-4f03-a1a5-ab5c65c577e5 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:05.964331 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 873/1753] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:25:05 2022] POST /identity/v3/projects => generated 369 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 20:25:05.966874 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbde2d37-13ec-430f-a7fa-d1f128542113 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:06.026695 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 881/1754] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:25:05 2022] POST /identity/v3/projects => generated 387 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:25:06.032488 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2efdc9-46d1-4f03-a1a5-ab5c65c577e5 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:06.131880 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbde2d37-13ec-430f-a7fa-d1f128542113 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:06.214142 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2efdc9-46d1-4f03-a1a5-ab5c65c577e5 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:06.232590 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02875047-e8ff-4d95-affc-4e2b6764a5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:06.234369 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02875047-e8ff-4d95-affc-4e2b6764a5d4 admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:06.234756 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02875047-e8ff-4d95-affc-4e2b6764a5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:06.235132 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02875047-e8ff-4d95-affc-4e2b6764a5d4 admin admin] PATH_INFO: `/v3/users` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:06.236256 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02875047-e8ff-4d95-affc-4e2b6764a5d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:06.239454 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02875047-e8ff-4d95-affc-4e2b6764a5d4 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:06.267794 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d344d878-805c-4485-8048-fd0285687e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:06.269542 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344d878-805c-4485-8048-fd0285687e7e admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:06.269542 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344d878-805c-4485-8048-fd0285687e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:06.269542 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344d878-805c-4485-8048-fd0285687e7e admin admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:06.270300 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d344d878-805c-4485-8048-fd0285687e7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:06.272942 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d344d878-805c-4485-8048-fd0285687e7e admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:06.286655 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 882/1755] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:25:06 2022] POST /identity/v3/users => generated 294 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:25:06.291282 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02875047-e8ff-4d95-affc-4e2b6764a5d4 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:06.309173 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02875047-e8ff-4d95-affc-4e2b6764a5d4 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:06.314950 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d532100b-5263-49c4-be82-3191b0bd2400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:06.315957 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d532100b-5263-49c4-be82-3191b0bd2400 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:06.316439 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d532100b-5263-49c4-be82-3191b0bd2400 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:06.318325 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 874/1756] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:25:05 2022] POST /identity/v3/users => generated 291 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:25:06.320129 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d344d878-805c-4485-8048-fd0285687e7e admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:06.325329 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d532100b-5263-49c4-be82-3191b0bd2400 admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:06.326396 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d532100b-5263-49c4-be82-3191b0bd2400 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:06.330787 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d532100b-5263-49c4-be82-3191b0bd2400 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:06.335388 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d344d878-805c-4485-8048-fd0285687e7e admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:06.344351 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae3045e-f892-4369-b385-feb8d07257ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:06.345031 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae3045e-f892-4369-b385-feb8d07257ec admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:06.346550 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae3045e-f892-4369-b385-feb8d07257ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:06.346836 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae3045e-f892-4369-b385-feb8d07257ec admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:06.347720 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae3045e-f892-4369-b385-feb8d07257ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:06.349421 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae3045e-f892-4369-b385-feb8d07257ec admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:06.368524 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 883/1757] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:25:06 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 09 20:25:06.368801 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 875/1758] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:25:06 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:25:06.370260 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d532100b-5263-49c4-be82-3191b0bd2400 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:06.375840 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae3045e-f892-4369-b385-feb8d07257ec admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:06.397850 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d532100b-5263-49c4-be82-3191b0bd2400 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:06.406192 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae3045e-f892-4369-b385-feb8d07257ec admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:06.406354 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e3454-27dc-499b-8dcb-0af11a48d11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:06.413719 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e3454-27dc-499b-8dcb-0af11a48d11a admin admin] REQUEST_METHOD: `PUT` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:06.414165 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e3454-27dc-499b-8dcb-0af11a48d11a admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:06.414467 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e3454-27dc-499b-8dcb-0af11a48d11a admin admin] PATH_INFO: `/v3/projects/cd2cafeaeea74086986cf579a9513da0/users/6b6c3f7f4d2747a38fc03d8b9e3587ee/roles/274130b78e304bb88789c1b349263f3c` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:06.421886 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f665ce-32e0-42c5-9607-1a4dbb6916cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:06.423435 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f665ce-32e0-42c5-9607-1a4dbb6916cc admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:06.423738 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f665ce-32e0-42c5-9607-1a4dbb6916cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:06.424085 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f665ce-32e0-42c5-9607-1a4dbb6916cc admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:06.424734 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f665ce-32e0-42c5-9607-1a4dbb6916cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:06.428985 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f665ce-32e0-42c5-9607-1a4dbb6916cc admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:06.441953 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4e3454-27dc-499b-8dcb-0af11a48d11a admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd2cafeaeea74086986cf579a9513da0, user_id=6b6c3f7f4d2747a38fc03d8b9e3587ee, role_id=274130b78e304bb88789c1b349263f3c)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:06.445362 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4e3454-27dc-499b-8dcb-0af11a48d11a admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:06.461928 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 876/1759] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:25:06 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:25:06.462850 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f665ce-32e0-42c5-9607-1a4dbb6916cc admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:06.468446 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 884/1760] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:25:06 2022] PUT /identity/v3/projects/cd2cafeaeea74086986cf579a9513da0/users/6b6c3f7f4d2747a38fc03d8b9e3587ee/roles/274130b78e304bb88789c1b349263f3c => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:25:06.472711 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e3454-27dc-499b-8dcb-0af11a48d11a admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:06.491014 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f665ce-32e0-42c5-9607-1a4dbb6916cc admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:06.601181 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e3454-27dc-499b-8dcb-0af11a48d11a admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:06.609365 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcba775-f347-44bc-afad-a0e55840929b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:06.610378 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcba775-f347-44bc-afad-a0e55840929b admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:06.610378 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcba775-f347-44bc-afad-a0e55840929b admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:06.610706 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcba775-f347-44bc-afad-a0e55840929b admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:06.611482 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcba775-f347-44bc-afad-a0e55840929b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:06.612140 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bfdae4-38f7-409e-9714-0d7c325b90f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:06.613020 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bfdae4-38f7-409e-9714-0d7c325b90f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:06.613189 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcba775-f347-44bc-afad-a0e55840929b admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:06.613280 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bfdae4-38f7-409e-9714-0d7c325b90f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:06.613557 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bfdae4-38f7-409e-9714-0d7c325b90f2 admin admin] PATH_INFO: `/v3/projects/3723d019c6c04357869be5c7d7a56cbf/users/07f56baf1cb64a53901f6cc1e9832567/roles/79f90a0bf6ea43d0b3c434e31556253a` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:06.629981 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 885/1761] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:25:06 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:25:06.631070 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcba775-f347-44bc-afad-a0e55840929b admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:06.637866 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bfdae4-38f7-409e-9714-0d7c325b90f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3723d019c6c04357869be5c7d7a56cbf, user_id=07f56baf1cb64a53901f6cc1e9832567, role_id=79f90a0bf6ea43d0b3c434e31556253a)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:06.640508 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bfdae4-38f7-409e-9714-0d7c325b90f2 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:06.642455 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcba775-f347-44bc-afad-a0e55840929b admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:06.649514 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49342fb0-63e9-46b5-9a11-9c8d6c02dd15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:06.651249 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49342fb0-63e9-46b5-9a11-9c8d6c02dd15 admin admin] REQUEST_METHOD: `PUT` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:06.651618 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49342fb0-63e9-46b5-9a11-9c8d6c02dd15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:06.651935 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49342fb0-63e9-46b5-9a11-9c8d6c02dd15 admin admin] PATH_INFO: `/v3/projects/cd2cafeaeea74086986cf579a9513da0/users/6b6c3f7f4d2747a38fc03d8b9e3587ee/roles/274130b78e304bb88789c1b349263f3c` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:06.654210 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49342fb0-63e9-46b5-9a11-9c8d6c02dd15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd2cafeaeea74086986cf579a9513da0, user_id=6b6c3f7f4d2747a38fc03d8b9e3587ee, role_id=274130b78e304bb88789c1b349263f3c)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:06.657254 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49342fb0-63e9-46b5-9a11-9c8d6c02dd15 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:06.674171 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 886/1763] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:25:06 2022] PUT /identity/v3/projects/cd2cafeaeea74086986cf579a9513da0/users/6b6c3f7f4d2747a38fc03d8b9e3587ee/roles/274130b78e304bb88789c1b349263f3c => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:25:06.674328 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 877/1763] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:25:06 2022] PUT /identity/v3/projects/3723d019c6c04357869be5c7d7a56cbf/users/07f56baf1cb64a53901f6cc1e9832567/roles/79f90a0bf6ea43d0b3c434e31556253a => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:25:06.686720 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e22cf-0676-4a84-a8ff-637cec14e5cc None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:06.686937 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e22cf-0676-4a84-a8ff-637cec14e5cc None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:06.687033 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b307f4-5d46-41f0-8696-64ce9d7b623b None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:06.687201 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e22cf-0676-4a84-a8ff-637cec14e5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:06.687294 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b307f4-5d46-41f0-8696-64ce9d7b623b None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:06.687509 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b307f4-5d46-41f0-8696-64ce9d7b623b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:06.725086 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-a19e22cf-0676-4a84-a8ff-637cec14e5cc None None] MFA Rules not processed for user `07f56baf1cb64a53901f6cc1e9832567`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:25:06.726642 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-a19e22cf-0676-4a84-a8ff-637cec14e5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:06.737665 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-67b307f4-5d46-41f0-8696-64ce9d7b623b None None] MFA Rules not processed for user `6b6c3f7f4d2747a38fc03d8b9e3587ee`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:25:06.739089 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-67b307f4-5d46-41f0-8696-64ce9d7b623b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:06.831848 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 878/1764] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:25:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:25:06.836357 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e22cf-0676-4a84-a8ff-637cec14e5cc None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:06.852255 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 887/1765] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:25:06 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:25:06.864233 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b307f4-5d46-41f0-8696-64ce9d7b623b None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:06.865969 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-67b307f4-5d46-41f0-8696-64ce9d7b623b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:06.903895 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e22cf-0676-4a84-a8ff-637cec14e5cc None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:06.908566 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a113c172-a95d-4367-9477-2cf85454bf12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:06.909239 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a113c172-a95d-4367-9477-2cf85454bf12 admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:06.909519 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a113c172-a95d-4367-9477-2cf85454bf12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:06.909788 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a113c172-a95d-4367-9477-2cf85454bf12 admin admin] PATH_INFO: `/v3/projects` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:06.910480 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a113c172-a95d-4367-9477-2cf85454bf12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:06.912476 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a113c172-a95d-4367-9477-2cf85454bf12 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:06.927847 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b307f4-5d46-41f0-8696-64ce9d7b623b None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:06.932555 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4c858d-1043-435d-aa44-67278603932e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d65e731386d44948dcc1ecd40cbda65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:06.934145 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c858d-1043-435d-aa44-67278603932e service cinder] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:06.934399 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c858d-1043-435d-aa44-67278603932e service cinder] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:06.935270 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c858d-1043-435d-aa44-67278603932e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:06.948218 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 879/1766] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:25:06 2022] POST /identity/v3/projects => generated 389 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:25:06.953036 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a113c172-a95d-4367-9477-2cf85454bf12 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:06.960934 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4c858d-1043-435d-aa44-67278603932e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:06.964582 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4c858d-1043-435d-aa44-67278603932e service cinder] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:06.978446 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 888/1767] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:25:06 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 09 20:25:07.038520 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4c858d-1043-435d-aa44-67278603932e service cinder] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:07.040601 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-bc4c858d-1043-435d-aa44-67278603932e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:07.047123 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a113c172-a95d-4367-9477-2cf85454bf12 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:07.054462 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbdd549-2f9e-4c11-8fec-bc0cd07728a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:07.055412 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbdd549-2f9e-4c11-8fec-bc0cd07728a9 admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:07.055570 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4c858d-1043-435d-aa44-67278603932e service cinder] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:07.056046 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbdd549-2f9e-4c11-8fec-bc0cd07728a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:07.056464 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbdd549-2f9e-4c11-8fec-bc0cd07728a9 admin admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:07.057289 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbdd549-2f9e-4c11-8fec-bc0cd07728a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:07.060702 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbdd549-2f9e-4c11-8fec-bc0cd07728a9 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:07.088415 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 880/1768] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:25:06 2022] POST /identity/v3/users => generated 301 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 20:25:07.090595 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbdd549-2f9e-4c11-8fec-bc0cd07728a9 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:07.107907 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbdd549-2f9e-4c11-8fec-bc0cd07728a9 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:07.112926 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd1f5d3-373d-4a2c-8b9b-e39011aba290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:07.113667 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd1f5d3-373d-4a2c-8b9b-e39011aba290 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:07.114022 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd1f5d3-373d-4a2c-8b9b-e39011aba290 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:07.114366 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd1f5d3-373d-4a2c-8b9b-e39011aba290 admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:07.115503 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd1f5d3-373d-4a2c-8b9b-e39011aba290 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:07.117018 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd1f5d3-373d-4a2c-8b9b-e39011aba290 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:07.121711 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1879ca-a5bf-4378-b424-f9b8a24ff375 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d65e731386d44948dcc1ecd40cbda65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:07.123916 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1879ca-a5bf-4378-b424-f9b8a24ff375 service cinder] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:07.124659 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1879ca-a5bf-4378-b424-f9b8a24ff375 service cinder] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:07.125079 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1879ca-a5bf-4378-b424-f9b8a24ff375 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:07.129640 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 881/1769] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:25:07 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 09 20:25:07.133719 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd1f5d3-373d-4a2c-8b9b-e39011aba290 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:07.145751 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd1f5d3-373d-4a2c-8b9b-e39011aba290 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:07.151531 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d1f6fa-9133-4da1-9ad1-74fac0157fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:07.153550 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d1f6fa-9133-4da1-9ad1-74fac0157fbf admin admin] REQUEST_METHOD: `PUT` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:07.154185 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d1f6fa-9133-4da1-9ad1-74fac0157fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:07.154696 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d1f6fa-9133-4da1-9ad1-74fac0157fbf admin admin] PATH_INFO: `/v3/projects/b82c63d96d1244b8a8dfd7558228c298/users/85b33b6d235c41e3a2a6a24beeb4ed9f/roles/274130b78e304bb88789c1b349263f3c` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:07.177094 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d1f6fa-9133-4da1-9ad1-74fac0157fbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=b82c63d96d1244b8a8dfd7558228c298, user_id=85b33b6d235c41e3a2a6a24beeb4ed9f, role_id=274130b78e304bb88789c1b349263f3c)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:07.182675 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d1f6fa-9133-4da1-9ad1-74fac0157fbf admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:07.200804 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 882/1770] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:25:07 2022] PUT /identity/v3/projects/b82c63d96d1244b8a8dfd7558228c298/users/85b33b6d235c41e3a2a6a24beeb4ed9f/roles/274130b78e304bb88789c1b349263f3c => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:25:07.204512 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d1f6fa-9133-4da1-9ad1-74fac0157fbf admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:07.212269 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1879ca-a5bf-4378-b424-f9b8a24ff375 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:07.213934 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1879ca-a5bf-4378-b424-f9b8a24ff375 service cinder] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:07.224603 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 889/1771] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:25:07 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 09 20:25:07.404600 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d1f6fa-9133-4da1-9ad1-74fac0157fbf admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:07.410314 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca56817-6ada-4a2c-a67e-11aac93174f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:07.411028 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca56817-6ada-4a2c-a67e-11aac93174f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:07.411312 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca56817-6ada-4a2c-a67e-11aac93174f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:07.411601 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca56817-6ada-4a2c-a67e-11aac93174f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:07.412321 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca56817-6ada-4a2c-a67e-11aac93174f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:07.413961 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca56817-6ada-4a2c-a67e-11aac93174f4 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:07.434633 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 883/1772] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:25:07 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 09 20:25:07.436131 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1879ca-a5bf-4378-b424-f9b8a24ff375 service cinder] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:07.447804 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1879ca-a5bf-4378-b424-f9b8a24ff375 service cinder] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:07.452894 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7004afe-1b27-40ba-8d9b-11a235848c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:07.454055 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7004afe-1b27-40ba-8d9b-11a235848c14 admin admin] REQUEST_METHOD: `PUT` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:07.454363 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7004afe-1b27-40ba-8d9b-11a235848c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:07.454634 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7004afe-1b27-40ba-8d9b-11a235848c14 admin admin] PATH_INFO: `/v3/projects/b82c63d96d1244b8a8dfd7558228c298/users/85b33b6d235c41e3a2a6a24beeb4ed9f/roles/274130b78e304bb88789c1b349263f3c` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:07.456775 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7004afe-1b27-40ba-8d9b-11a235848c14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b82c63d96d1244b8a8dfd7558228c298, user_id=85b33b6d235c41e3a2a6a24beeb4ed9f, role_id=274130b78e304bb88789c1b349263f3c)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:07.459434 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7004afe-1b27-40ba-8d9b-11a235848c14 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:07.491682 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 890/1773] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:25:07 2022] PUT /identity/v3/projects/b82c63d96d1244b8a8dfd7558228c298/users/85b33b6d235c41e3a2a6a24beeb4ed9f/roles/274130b78e304bb88789c1b349263f3c => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:25:07.503342 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38c82d-dcb9-4ef0-a6de-11916c7b6fae None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:07.503670 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38c82d-dcb9-4ef0-a6de-11916c7b6fae None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:07.503935 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38c82d-dcb9-4ef0-a6de-11916c7b6fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:07.539778 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-bf38c82d-dcb9-4ef0-a6de-11916c7b6fae None None] MFA Rules not processed for user `85b33b6d235c41e3a2a6a24beeb4ed9f`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:25:07.541145 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-bf38c82d-dcb9-4ef0-a6de-11916c7b6fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:07.635656 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 884/1774] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:25:07 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:25:07.646806 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7004afe-1b27-40ba-8d9b-11a235848c14 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:07.706311 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7004afe-1b27-40ba-8d9b-11a235848c14 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:07.711003 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f8fe6e-57e7-429d-8e1e-484105565065 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d65e731386d44948dcc1ecd40cbda65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:07.712620 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f8fe6e-57e7-429d-8e1e-484105565065 service cinder] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:07.713225 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f8fe6e-57e7-429d-8e1e-484105565065 service cinder] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:07.713650 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f8fe6e-57e7-429d-8e1e-484105565065 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:07.727665 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f8fe6e-57e7-429d-8e1e-484105565065 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:07.729489 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f8fe6e-57e7-429d-8e1e-484105565065 service cinder] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:07.743671 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 891/1775] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:25:07 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:25:07.882908 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf38c82d-dcb9-4ef0-a6de-11916c7b6fae None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:07.945208 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf38c82d-dcb9-4ef0-a6de-11916c7b6fae None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:07.950363 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d54b375-929f-4829-91f3-ffa01d24feb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:07.951231 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d54b375-929f-4829-91f3-ffa01d24feb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:07.951542 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d54b375-929f-4829-91f3-ffa01d24feb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:07.951805 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d54b375-929f-4829-91f3-ffa01d24feb5 admin admin] PATH_INFO: `/v3/users/07f56baf1cb64a53901f6cc1e9832567` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:07.953019 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d54b375-929f-4829-91f3-ffa01d24feb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07f56baf1cb64a53901f6cc1e9832567)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:07.954940 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d54b375-929f-4829-91f3-ffa01d24feb5 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:08.004327 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-3d54b375-929f-4829-91f3-ffa01d24feb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07f56baf1cb64a53901f6cc1e9832567'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:08.012458 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-3d54b375-929f-4829-91f3-ffa01d24feb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07f56baf1cb64a53901f6cc1e9832567'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:08.021452 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-3d54b375-929f-4829-91f3-ffa01d24feb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07f56baf1cb64a53901f6cc1e9832567'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:08.022120 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-3d54b375-929f-4829-91f3-ffa01d24feb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07f56baf1cb64a53901f6cc1e9832567'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:08.022773 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-3d54b375-929f-4829-91f3-ffa01d24feb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07f56baf1cb64a53901f6cc1e9832567'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:08.039959 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 885/1776] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:25:07 2022] DELETE /identity/v3/users/07f56baf1cb64a53901f6cc1e9832567 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:25:08.045076 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03aa63-1224-4427-aa0d-0aa6da4b7f42 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:08.045829 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03aa63-1224-4427-aa0d-0aa6da4b7f42 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:08.045829 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03aa63-1224-4427-aa0d-0aa6da4b7f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:08.063483 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-7a03aa63-1224-4427-aa0d-0aa6da4b7f42 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:25:08.064704 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-7a03aa63-1224-4427-aa0d-0aa6da4b7f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:08.125709 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 892/1777] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:25:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:25:08.135703 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d54b375-929f-4829-91f3-ffa01d24feb5 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:08.138063 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-3d54b375-929f-4829-91f3-ffa01d24feb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:08.192117 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d54b375-929f-4829-91f3-ffa01d24feb5 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:08.195750 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608b2997-126f-4e7f-9b22-af3ec5cf1421 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:08.196156 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b2997-126f-4e7f-9b22-af3ec5cf1421 service neutron] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:08.196430 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b2997-126f-4e7f-9b22-af3ec5cf1421 service neutron] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:08.196696 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b2997-126f-4e7f-9b22-af3ec5cf1421 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:08.205886 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608b2997-126f-4e7f-9b22-af3ec5cf1421 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:08.207389 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608b2997-126f-4e7f-9b22-af3ec5cf1421 service neutron] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:08.216662 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 886/1778] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:25:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:25:08.564467 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03aa63-1224-4427-aa0d-0aa6da4b7f42 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:08.566372 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-7a03aa63-1224-4427-aa0d-0aa6da4b7f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:08.584568 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03aa63-1224-4427-aa0d-0aa6da4b7f42 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:08.590435 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff239a-baa9-4f40-98e3-e29dedc6cd72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:08.591928 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff239a-baa9-4f40-98e3-e29dedc6cd72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:08.592215 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff239a-baa9-4f40-98e3-e29dedc6cd72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:08.592494 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff239a-baa9-4f40-98e3-e29dedc6cd72 admin admin] PATH_INFO: `/v3/projects/3723d019c6c04357869be5c7d7a56cbf` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:08.593725 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccff239a-baa9-4f40-98e3-e29dedc6cd72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3723d019c6c04357869be5c7d7a56cbf)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:08.595662 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccff239a-baa9-4f40-98e3-e29dedc6cd72 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:08.656311 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-ccff239a-baa9-4f40-98e3-e29dedc6cd72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3723d019c6c04357869be5c7d7a56cbf', 'request_id': 'req-ccff239a-baa9-4f40-98e3-e29dedc6cd72'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:08.663921 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-ccff239a-baa9-4f40-98e3-e29dedc6cd72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3723d019c6c04357869be5c7d7a56cbf', 'request_id': 'req-ccff239a-baa9-4f40-98e3-e29dedc6cd72'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:08.671484 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-ccff239a-baa9-4f40-98e3-e29dedc6cd72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3723d019c6c04357869be5c7d7a56cbf', 'request_id': 'req-ccff239a-baa9-4f40-98e3-e29dedc6cd72'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:08.691263 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-ccff239a-baa9-4f40-98e3-e29dedc6cd72 admin admin] The token cache is being invalidate because project 3723d019c6c04357869be5c7d7a56cbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:25:08.691703 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-ccff239a-baa9-4f40-98e3-e29dedc6cd72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:08.692343 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-ccff239a-baa9-4f40-98e3-e29dedc6cd72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:08.695613 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 893/1779] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:25:08 2022] DELETE /identity/v3/projects/3723d019c6c04357869be5c7d7a56cbf => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:25:08.697901 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608b2997-126f-4e7f-9b22-af3ec5cf1421 service neutron] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:08.712351 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608b2997-126f-4e7f-9b22-af3ec5cf1421 service neutron] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:08.786175 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe802acf-0be2-4478-96ff-48814b5b9d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:08.787051 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe802acf-0be2-4478-96ff-48814b5b9d97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:08.787819 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe802acf-0be2-4478-96ff-48814b5b9d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:08.787819 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe802acf-0be2-4478-96ff-48814b5b9d97 admin admin] PATH_INFO: `/v3/users/85b33b6d235c41e3a2a6a24beeb4ed9f` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:08.789097 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe802acf-0be2-4478-96ff-48814b5b9d97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85b33b6d235c41e3a2a6a24beeb4ed9f)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:08.791786 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe802acf-0be2-4478-96ff-48814b5b9d97 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:08.864628 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-fe802acf-0be2-4478-96ff-48814b5b9d97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85b33b6d235c41e3a2a6a24beeb4ed9f'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:08.878356 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-fe802acf-0be2-4478-96ff-48814b5b9d97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85b33b6d235c41e3a2a6a24beeb4ed9f'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:08.887274 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-fe802acf-0be2-4478-96ff-48814b5b9d97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85b33b6d235c41e3a2a6a24beeb4ed9f'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:08.888616 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-fe802acf-0be2-4478-96ff-48814b5b9d97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85b33b6d235c41e3a2a6a24beeb4ed9f'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:08.889181 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-fe802acf-0be2-4478-96ff-48814b5b9d97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85b33b6d235c41e3a2a6a24beeb4ed9f'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:08.910867 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 887/1780] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:25:08 2022] DELETE /identity/v3/users/85b33b6d235c41e3a2a6a24beeb4ed9f => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:25:09.379476 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff239a-baa9-4f40-98e3-e29dedc6cd72 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:09.380916 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-ccff239a-baa9-4f40-98e3-e29dedc6cd72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:09.393969 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff239a-baa9-4f40-98e3-e29dedc6cd72 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:09.473828 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9340814-59ce-49e3-a76a-03789d055766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:09.474687 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9340814-59ce-49e3-a76a-03789d055766 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:09.474965 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9340814-59ce-49e3-a76a-03789d055766 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:09.475263 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9340814-59ce-49e3-a76a-03789d055766 admin admin] PATH_INFO: `/v3/projects/b82c63d96d1244b8a8dfd7558228c298` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:09.476567 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9340814-59ce-49e3-a76a-03789d055766 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b82c63d96d1244b8a8dfd7558228c298)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:09.478406 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9340814-59ce-49e3-a76a-03789d055766 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:09.524298 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-c9340814-59ce-49e3-a76a-03789d055766 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b82c63d96d1244b8a8dfd7558228c298', 'request_id': 'req-c9340814-59ce-49e3-a76a-03789d055766'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:09.530348 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-c9340814-59ce-49e3-a76a-03789d055766 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b82c63d96d1244b8a8dfd7558228c298', 'request_id': 'req-c9340814-59ce-49e3-a76a-03789d055766'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:09.536427 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-c9340814-59ce-49e3-a76a-03789d055766 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b82c63d96d1244b8a8dfd7558228c298', 'request_id': 'req-c9340814-59ce-49e3-a76a-03789d055766'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:09.549840 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-c9340814-59ce-49e3-a76a-03789d055766 admin admin] The token cache is being invalidate because project b82c63d96d1244b8a8dfd7558228c298 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:25:09.550495 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-c9340814-59ce-49e3-a76a-03789d055766 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:09.550980 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-c9340814-59ce-49e3-a76a-03789d055766 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:09.552587 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 894/1781] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:25:09 2022] DELETE /identity/v3/projects/b82c63d96d1244b8a8dfd7558228c298 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:25:09.564394 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a88ea-2a58-40ed-80c2-1ac2e0f80666 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:09.564981 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a88ea-2a58-40ed-80c2-1ac2e0f80666 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:09.565375 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a88ea-2a58-40ed-80c2-1ac2e0f80666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:09.585869 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-5f6a88ea-2a58-40ed-80c2-1ac2e0f80666 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:25:09.587063 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-5f6a88ea-2a58-40ed-80c2-1ac2e0f80666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:09.643059 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 888/1782] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:25:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:25:09.650660 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207ae30-ad93-45c4-bde0-1c7dafa6fbdf None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:09.650946 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207ae30-ad93-45c4-bde0-1c7dafa6fbdf None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:09.651212 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207ae30-ad93-45c4-bde0-1c7dafa6fbdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:09.669647 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-3207ae30-ad93-45c4-bde0-1c7dafa6fbdf None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:25:09.670822 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-3207ae30-ad93-45c4-bde0-1c7dafa6fbdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:09.678697 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 895/1783] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:25:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:25:09.682706 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6a88ea-2a58-40ed-80c2-1ac2e0f80666 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:09.692253 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6a88ea-2a58-40ed-80c2-1ac2e0f80666 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:09.696646 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4218e48-8ac4-4f4d-bb3e-5b9e46b835f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:09.697281 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4218e48-8ac4-4f4d-bb3e-5b9e46b835f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:09.697556 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4218e48-8ac4-4f4d-bb3e-5b9e46b835f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:09.697826 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4218e48-8ac4-4f4d-bb3e-5b9e46b835f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:09.698537 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4218e48-8ac4-4f4d-bb3e-5b9e46b835f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:25:09.699372 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4218e48-8ac4-4f4d-bb3e-5b9e46b835f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:09.701001 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4218e48-8ac4-4f4d-bb3e-5b9e46b835f8 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:09.711945 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 889/1784] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 9 20:25:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:25:09.716760 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3207ae30-ad93-45c4-bde0-1c7dafa6fbdf None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:09.725797 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3207ae30-ad93-45c4-bde0-1c7dafa6fbdf None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:09.730495 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f9a52e-f87d-42ad-a098-1edf4f2eefe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:09.731109 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9a52e-f87d-42ad-a098-1edf4f2eefe8 admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:09.731386 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9a52e-f87d-42ad-a098-1edf4f2eefe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:09.731685 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9a52e-f87d-42ad-a098-1edf4f2eefe8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:09.732370 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f9a52e-f87d-42ad-a098-1edf4f2eefe8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:09.734270 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f9a52e-f87d-42ad-a098-1edf4f2eefe8 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:09.764038 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 896/1785] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:25:09 2022] POST /identity/v3/projects => generated 379 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:25:09.765603 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4218e48-8ac4-4f4d-bb3e-5b9e46b835f8 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:09.777929 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4218e48-8ac4-4f4d-bb3e-5b9e46b835f8 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:09.833099 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfcd197-5871-4e2c-a693-7b57bd7b6dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:09.833769 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfcd197-5871-4e2c-a693-7b57bd7b6dda admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:09.834049 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfcd197-5871-4e2c-a693-7b57bd7b6dda admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:09.834350 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfcd197-5871-4e2c-a693-7b57bd7b6dda admin admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:09.835041 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfcd197-5871-4e2c-a693-7b57bd7b6dda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:09.837001 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfcd197-5871-4e2c-a693-7b57bd7b6dda admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:09.863548 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 890/1786] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:25:09 2022] POST /identity/v3/users => generated 290 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 20:25:09.864815 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f9a52e-f87d-42ad-a098-1edf4f2eefe8 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:09.875534 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f9a52e-f87d-42ad-a098-1edf4f2eefe8 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:09.881101 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab98aa3-94a3-44ea-b749-31a4d4ea77b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:09.881771 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab98aa3-94a3-44ea-b749-31a4d4ea77b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:09.882085 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab98aa3-94a3-44ea-b749-31a4d4ea77b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:09.882516 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab98aa3-94a3-44ea-b749-31a4d4ea77b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:09.883280 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab98aa3-94a3-44ea-b749-31a4d4ea77b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:09.884939 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab98aa3-94a3-44ea-b749-31a4d4ea77b4 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:09.896018 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 897/1787] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:25:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:25:09.900213 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfcd197-5871-4e2c-a693-7b57bd7b6dda admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:09.911061 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfcd197-5871-4e2c-a693-7b57bd7b6dda admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:09.920736 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090f5f5f-820a-4438-8657-bbe754839fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:09.921394 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f5f5f-820a-4438-8657-bbe754839fbd admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:09.921668 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f5f5f-820a-4438-8657-bbe754839fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:09.921935 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f5f5f-820a-4438-8657-bbe754839fbd admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:09.926556 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090f5f5f-820a-4438-8657-bbe754839fbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:09.928793 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090f5f5f-820a-4438-8657-bbe754839fbd admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:09.941183 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 891/1788] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:25:09 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:25:09.949653 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab98aa3-94a3-44ea-b749-31a4d4ea77b4 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:09.959611 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab98aa3-94a3-44ea-b749-31a4d4ea77b4 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:09.964382 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9668f0-9218-4aa5-9dc0-2eaca2aa365d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:09.966018 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9668f0-9218-4aa5-9dc0-2eaca2aa365d admin admin] REQUEST_METHOD: `PUT` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:09.966376 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9668f0-9218-4aa5-9dc0-2eaca2aa365d admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:09.966865 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9668f0-9218-4aa5-9dc0-2eaca2aa365d admin admin] PATH_INFO: `/v3/projects/e7be8e231d9f4835a72ed445cf56e066/users/c5273c312b1c49678d3da66d299377d3/roles/79f90a0bf6ea43d0b3c434e31556253a` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:09.983452 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9668f0-9218-4aa5-9dc0-2eaca2aa365d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7be8e231d9f4835a72ed445cf56e066, user_id=c5273c312b1c49678d3da66d299377d3, role_id=79f90a0bf6ea43d0b3c434e31556253a)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:09.986004 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9668f0-9218-4aa5-9dc0-2eaca2aa365d admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:09.999907 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 898/1789] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:25:09 2022] PUT /identity/v3/projects/e7be8e231d9f4835a72ed445cf56e066/users/c5273c312b1c49678d3da66d299377d3/roles/79f90a0bf6ea43d0b3c434e31556253a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:25:10.012539 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd563213-48e6-4dcf-b664-c25da750d6e8 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:10.012947 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd563213-48e6-4dcf-b664-c25da750d6e8 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:10.013286 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd563213-48e6-4dcf-b664-c25da750d6e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:10.039801 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-dd563213-48e6-4dcf-b664-c25da750d6e8 None None] MFA Rules not processed for user `c5273c312b1c49678d3da66d299377d3`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:25:10.041048 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-dd563213-48e6-4dcf-b664-c25da750d6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:10.102659 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 892/1790] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:25:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:25:10.107612 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9668f0-9218-4aa5-9dc0-2eaca2aa365d admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:10.166641 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9668f0-9218-4aa5-9dc0-2eaca2aa365d admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:10.171473 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d66a5ca-6aa9-4451-ac9d-1dd7e3cf9091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:10.172126 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66a5ca-6aa9-4451-ac9d-1dd7e3cf9091 admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:10.172404 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66a5ca-6aa9-4451-ac9d-1dd7e3cf9091 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:10.172675 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66a5ca-6aa9-4451-ac9d-1dd7e3cf9091 admin admin] PATH_INFO: `/v3/projects` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:10.173362 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d66a5ca-6aa9-4451-ac9d-1dd7e3cf9091 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:10.175223 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d66a5ca-6aa9-4451-ac9d-1dd7e3cf9091 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:10.201775 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 899/1791] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:25:10 2022] POST /identity/v3/projects => generated 379 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 20:25:10.205612 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd563213-48e6-4dcf-b664-c25da750d6e8 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:10.217278 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd563213-48e6-4dcf-b664-c25da750d6e8 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:10.279060 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f9182d-da35-4ee4-a013-b5dbd5d06ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:10.279767 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9182d-da35-4ee4-a013-b5dbd5d06ab6 admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:10.280088 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9182d-da35-4ee4-a013-b5dbd5d06ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:10.280362 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9182d-da35-4ee4-a013-b5dbd5d06ab6 admin admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:10.281055 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f9182d-da35-4ee4-a013-b5dbd5d06ab6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:10.283498 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f9182d-da35-4ee4-a013-b5dbd5d06ab6 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:10.309061 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 893/1792] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:25:10 2022] POST /identity/v3/users => generated 290 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:25:10.313447 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d66a5ca-6aa9-4451-ac9d-1dd7e3cf9091 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:10.326380 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d66a5ca-6aa9-4451-ac9d-1dd7e3cf9091 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:10.332694 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ab6b9-c27a-492c-9795-4e2bf21a8d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:10.333565 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ab6b9-c27a-492c-9795-4e2bf21a8d4b admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:10.334323 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ab6b9-c27a-492c-9795-4e2bf21a8d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:10.334608 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ab6b9-c27a-492c-9795-4e2bf21a8d4b admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:10.335337 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148ab6b9-c27a-492c-9795-4e2bf21a8d4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:10.337191 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148ab6b9-c27a-492c-9795-4e2bf21a8d4b admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:10.349436 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 900/1793] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:25:10 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:25:10.353173 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f9182d-da35-4ee4-a013-b5dbd5d06ab6 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:10.365441 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f9182d-da35-4ee4-a013-b5dbd5d06ab6 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:10.372034 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed33bf3-26fb-4fd6-9866-65e40bb7aef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:10.372969 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed33bf3-26fb-4fd6-9866-65e40bb7aef4 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:10.373797 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed33bf3-26fb-4fd6-9866-65e40bb7aef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:10.374357 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed33bf3-26fb-4fd6-9866-65e40bb7aef4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:10.375978 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed33bf3-26fb-4fd6-9866-65e40bb7aef4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:10.377938 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed33bf3-26fb-4fd6-9866-65e40bb7aef4 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:10.392269 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 894/1794] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:25:10 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:25:10.396400 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ab6b9-c27a-492c-9795-4e2bf21a8d4b admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:10.422001 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ab6b9-c27a-492c-9795-4e2bf21a8d4b admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:10.429068 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9305c7c6-314a-48db-a1f9-459b151fb9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:10.430020 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305c7c6-314a-48db-a1f9-459b151fb9c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:10.430322 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305c7c6-314a-48db-a1f9-459b151fb9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:10.430572 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305c7c6-314a-48db-a1f9-459b151fb9c8 admin admin] PATH_INFO: `/v3/projects/c59f068d08af4da9a58ba6420f9edef9/users/16d47c455b8f472284bf6dc232b114ba/roles/79f90a0bf6ea43d0b3c434e31556253a` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:10.452162 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9305c7c6-314a-48db-a1f9-459b151fb9c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c59f068d08af4da9a58ba6420f9edef9, user_id=16d47c455b8f472284bf6dc232b114ba, role_id=79f90a0bf6ea43d0b3c434e31556253a)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:10.454194 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9305c7c6-314a-48db-a1f9-459b151fb9c8 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:10.475246 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 901/1795] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:25:10 2022] PUT /identity/v3/projects/c59f068d08af4da9a58ba6420f9edef9/users/16d47c455b8f472284bf6dc232b114ba/roles/79f90a0bf6ea43d0b3c434e31556253a => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:25:10.486144 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831aab45-1e2e-44d0-b7cb-49bdebb4bcfb None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:10.487379 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831aab45-1e2e-44d0-b7cb-49bdebb4bcfb None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:10.493459 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831aab45-1e2e-44d0-b7cb-49bdebb4bcfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:10.530648 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-831aab45-1e2e-44d0-b7cb-49bdebb4bcfb None None] MFA Rules not processed for user `16d47c455b8f472284bf6dc232b114ba`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:25:10.532006 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-831aab45-1e2e-44d0-b7cb-49bdebb4bcfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:10.637815 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 895/1796] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:25:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:25:10.639705 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9305c7c6-314a-48db-a1f9-459b151fb9c8 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:10.710166 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9305c7c6-314a-48db-a1f9-459b151fb9c8 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:10.723188 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33118e9d-408b-46cb-8e55-bc4c6f7d4ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:10.723897 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33118e9d-408b-46cb-8e55-bc4c6f7d4ecc admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:10.724175 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33118e9d-408b-46cb-8e55-bc4c6f7d4ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:10.729316 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33118e9d-408b-46cb-8e55-bc4c6f7d4ecc admin admin] PATH_INFO: `/v3/projects` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:10.730122 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33118e9d-408b-46cb-8e55-bc4c6f7d4ecc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:10.732642 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33118e9d-408b-46cb-8e55-bc4c6f7d4ecc admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:10.760948 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 902/1797] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:25:10 2022] POST /identity/v3/projects => generated 377 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 20:25:10.765204 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831aab45-1e2e-44d0-b7cb-49bdebb4bcfb None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:10.778441 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831aab45-1e2e-44d0-b7cb-49bdebb4bcfb None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:10.818299 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33118e9d-408b-46cb-8e55-bc4c6f7d4ecc admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:10.820014 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-33118e9d-408b-46cb-8e55-bc4c6f7d4ecc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:10.838232 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1940bb-2e4a-4506-aa31-1d71103ad6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:10.838919 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1940bb-2e4a-4506-aa31-1d71103ad6b5 admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:10.839197 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1940bb-2e4a-4506-aa31-1d71103ad6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:10.839555 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1940bb-2e4a-4506-aa31-1d71103ad6b5 admin admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:10.840234 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1940bb-2e4a-4506-aa31-1d71103ad6b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:10.842214 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1940bb-2e4a-4506-aa31-1d71103ad6b5 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:10.864635 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 896/1798] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:25:10 2022] POST /identity/v3/users => generated 295 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:25:10.865706 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1940bb-2e4a-4506-aa31-1d71103ad6b5 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:10.880965 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1940bb-2e4a-4506-aa31-1d71103ad6b5 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:10.883679 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33118e9d-408b-46cb-8e55-bc4c6f7d4ecc admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:10.888908 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b4875b-5325-4689-b6e5-0cac9bea4d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:10.889603 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b4875b-5325-4689-b6e5-0cac9bea4d8e admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:10.889884 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b4875b-5325-4689-b6e5-0cac9bea4d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:10.890146 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b4875b-5325-4689-b6e5-0cac9bea4d8e admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:10.890951 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b4875b-5325-4689-b6e5-0cac9bea4d8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:10.892118 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fab552-8a96-4b4b-9326-69ec6010d8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:10.892934 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b4875b-5325-4689-b6e5-0cac9bea4d8e admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:10.893066 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fab552-8a96-4b4b-9326-69ec6010d8af admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:10.893263 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fab552-8a96-4b4b-9326-69ec6010d8af admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:10.893536 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fab552-8a96-4b4b-9326-69ec6010d8af admin admin] PATH_INFO: `/v3/users/2a3e6bc4efd744668cf077d38e84f35e` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:10.894753 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fab552-8a96-4b4b-9326-69ec6010d8af admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a3e6bc4efd744668cf077d38e84f35e)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:10.896710 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fab552-8a96-4b4b-9326-69ec6010d8af admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:10.904269 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 897/1799] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:25:10 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:25:10.908332 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b4875b-5325-4689-b6e5-0cac9bea4d8e admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:10.917799 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b4875b-5325-4689-b6e5-0cac9bea4d8e admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:10.923199 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcd7e62-3c32-48d4-8e19-ce4cbaee8bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:10.924224 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd7e62-3c32-48d4-8e19-ce4cbaee8bb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:10.924610 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd7e62-3c32-48d4-8e19-ce4cbaee8bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:10.924886 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd7e62-3c32-48d4-8e19-ce4cbaee8bb1 admin admin] PATH_INFO: `/v3/projects/a5fe080fb6554d65a26bfa6af2683261/users/3ed385792d314759bea1741bd61a0312/roles/274130b78e304bb88789c1b349263f3c` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:10.941477 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcd7e62-3c32-48d4-8e19-ce4cbaee8bb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5fe080fb6554d65a26bfa6af2683261, user_id=3ed385792d314759bea1741bd61a0312, role_id=274130b78e304bb88789c1b349263f3c)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:10.944260 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcd7e62-3c32-48d4-8e19-ce4cbaee8bb1 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:10.950606 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-f7fab552-8a96-4b4b-9326-69ec6010d8af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a3e6bc4efd744668cf077d38e84f35e'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:10.951337 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-f7fab552-8a96-4b4b-9326-69ec6010d8af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a3e6bc4efd744668cf077d38e84f35e'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:10.959347 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-f7fab552-8a96-4b4b-9326-69ec6010d8af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a3e6bc4efd744668cf077d38e84f35e'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:10.960340 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-f7fab552-8a96-4b4b-9326-69ec6010d8af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a3e6bc4efd744668cf077d38e84f35e'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:10.961252 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 898/1800] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:25:10 2022] PUT /identity/v3/projects/a5fe080fb6554d65a26bfa6af2683261/users/3ed385792d314759bea1741bd61a0312/roles/274130b78e304bb88789c1b349263f3c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:25:10.965862 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcd7e62-3c32-48d4-8e19-ce4cbaee8bb1 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:10.969505 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-ddcd7e62-3c32-48d4-8e19-ce4cbaee8bb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:10.977749 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-f7fab552-8a96-4b4b-9326-69ec6010d8af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a3e6bc4efd744668cf077d38e84f35e'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:11.009675 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 903/1801] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:25:10 2022] DELETE /identity/v3/users/2a3e6bc4efd744668cf077d38e84f35e => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:25:11.016047 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8083d1d-2fb2-4715-b6e4-3efda97b2966 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:11.016340 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8083d1d-2fb2-4715-b6e4-3efda97b2966 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:11.016910 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8083d1d-2fb2-4715-b6e4-3efda97b2966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:11.048376 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-c8083d1d-2fb2-4715-b6e4-3efda97b2966 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:25:11.049613 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-c8083d1d-2fb2-4715-b6e4-3efda97b2966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:11.074750 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcd7e62-3c32-48d4-8e19-ce4cbaee8bb1 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:11.121493 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 904/1802] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:25:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:25:11.133557 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8083d1d-2fb2-4715-b6e4-3efda97b2966 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:11.136014 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-c8083d1d-2fb2-4715-b6e4-3efda97b2966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:11.169998 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9836a78c-d6b7-401b-89b7-6ad8a1503d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:11.170855 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9836a78c-d6b7-401b-89b7-6ad8a1503d3b admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:11.171563 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9836a78c-d6b7-401b-89b7-6ad8a1503d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:11.171912 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9836a78c-d6b7-401b-89b7-6ad8a1503d3b admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:11.172932 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9836a78c-d6b7-401b-89b7-6ad8a1503d3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:11.174811 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9836a78c-d6b7-401b-89b7-6ad8a1503d3b admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:11.188157 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 899/1803] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:25:10 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:25:11.193434 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9836a78c-d6b7-401b-89b7-6ad8a1503d3b admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:11.205285 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9836a78c-d6b7-401b-89b7-6ad8a1503d3b admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:11.209887 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c6b38-123a-4208-ae2d-0c9a940630c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:11.210770 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c6b38-123a-4208-ae2d-0c9a940630c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:11.211049 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c6b38-123a-4208-ae2d-0c9a940630c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:11.211359 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c6b38-123a-4208-ae2d-0c9a940630c7 admin admin] PATH_INFO: `/v3/projects/a5fe080fb6554d65a26bfa6af2683261/users/3ed385792d314759bea1741bd61a0312/roles/274130b78e304bb88789c1b349263f3c` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:11.213184 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8083d1d-2fb2-4715-b6e4-3efda97b2966 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:11.216305 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87c6b38-123a-4208-ae2d-0c9a940630c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5fe080fb6554d65a26bfa6af2683261, user_id=3ed385792d314759bea1741bd61a0312, role_id=274130b78e304bb88789c1b349263f3c)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:11.217300 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3b8b3c-fe59-4fe9-abbb-b5c943fe7c5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:11.217949 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b8b3c-fe59-4fe9-abbb-b5c943fe7c5b service neutron] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:11.218230 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b8b3c-fe59-4fe9-abbb-b5c943fe7c5b service neutron] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:11.218504 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b8b3c-fe59-4fe9-abbb-b5c943fe7c5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:11.220127 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87c6b38-123a-4208-ae2d-0c9a940630c7 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:11.229070 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3b8b3c-fe59-4fe9-abbb-b5c943fe7c5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:11.231844 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3b8b3c-fe59-4fe9-abbb-b5c943fe7c5b service neutron] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:11.238387 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 900/1804] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:25:11 2022] PUT /identity/v3/projects/a5fe080fb6554d65a26bfa6af2683261/users/3ed385792d314759bea1741bd61a0312/roles/274130b78e304bb88789c1b349263f3c => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:25:11.243128 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 905/1805] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:25:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:25:11.243838 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6406971a-fb39-47b1-884b-9e10617c065f None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:11.244300 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6406971a-fb39-47b1-884b-9e10617c065f None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:11.244575 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6406971a-fb39-47b1-884b-9e10617c065f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:11.278955 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-6406971a-fb39-47b1-884b-9e10617c065f None None] MFA Rules not processed for user `3ed385792d314759bea1741bd61a0312`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:25:11.280837 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-6406971a-fb39-47b1-884b-9e10617c065f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:11.354587 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 901/1806] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:25:11 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:25:11.364692 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3b8b3c-fe59-4fe9-abbb-b5c943fe7c5b service neutron] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:11.366309 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-bd3b8b3c-fe59-4fe9-abbb-b5c943fe7c5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:11.462735 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3b8b3c-fe59-4fe9-abbb-b5c943fe7c5b service neutron] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:11.519501 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f18d80-563a-4a69-8c4f-fa476eee4b36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d65e731386d44948dcc1ecd40cbda65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:11.520178 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f18d80-563a-4a69-8c4f-fa476eee4b36 service cinder] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:11.520570 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f18d80-563a-4a69-8c4f-fa476eee4b36 service cinder] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:11.520911 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f18d80-563a-4a69-8c4f-fa476eee4b36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:11.531952 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f18d80-563a-4a69-8c4f-fa476eee4b36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:11.533517 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f18d80-563a-4a69-8c4f-fa476eee4b36 service cinder] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:11.546925 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 906/1807] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:25:11 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:25:11.601228 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6406971a-fb39-47b1-884b-9e10617c065f None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:11.604442 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-6406971a-fb39-47b1-884b-9e10617c065f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:11.636758 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6406971a-fb39-47b1-884b-9e10617c065f None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:11.648087 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a57a3c-9e50-49b5-8147-423dcd736e0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d65e731386d44948dcc1ecd40cbda65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:11.648991 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a57a3c-9e50-49b5-8147-423dcd736e0d service cinder] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:11.649426 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a57a3c-9e50-49b5-8147-423dcd736e0d service cinder] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:11.649791 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a57a3c-9e50-49b5-8147-423dcd736e0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:11.653408 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-11a57a3c-9e50-49b5-8147-423dcd736e0d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:11.677311 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f18d80-563a-4a69-8c4f-fa476eee4b36 service cinder] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:11.679299 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-56f18d80-563a-4a69-8c4f-fa476eee4b36 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:11.755417 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a57a3c-9e50-49b5-8147-423dcd736e0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:11.757112 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a57a3c-9e50-49b5-8147-423dcd736e0d service cinder] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:11.774064 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 902/1808] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:25:11 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:25:11.808286 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f18d80-563a-4a69-8c4f-fa476eee4b36 service cinder] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:11.813940 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889ca813-5ce6-4169-bec8-ea97cef94512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:11.819980 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ca813-5ce6-4169-bec8-ea97cef94512 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:11.820273 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ca813-5ce6-4169-bec8-ea97cef94512 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:11.820572 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ca813-5ce6-4169-bec8-ea97cef94512 admin admin] PATH_INFO: `/v3/projects/09d1a32f43e1401da50a8571a3385338` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:11.822207 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889ca813-5ce6-4169-bec8-ea97cef94512 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09d1a32f43e1401da50a8571a3385338)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:11.827946 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889ca813-5ce6-4169-bec8-ea97cef94512 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:11.919502 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-889ca813-5ce6-4169-bec8-ea97cef94512 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09d1a32f43e1401da50a8571a3385338', 'request_id': 'req-889ca813-5ce6-4169-bec8-ea97cef94512'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:11.928755 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-889ca813-5ce6-4169-bec8-ea97cef94512 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09d1a32f43e1401da50a8571a3385338', 'request_id': 'req-889ca813-5ce6-4169-bec8-ea97cef94512'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:11.947676 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-889ca813-5ce6-4169-bec8-ea97cef94512 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09d1a32f43e1401da50a8571a3385338', 'request_id': 'req-889ca813-5ce6-4169-bec8-ea97cef94512'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:11.983167 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-889ca813-5ce6-4169-bec8-ea97cef94512 admin admin] The token cache is being invalidate because project 09d1a32f43e1401da50a8571a3385338 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:25:11.983476 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-889ca813-5ce6-4169-bec8-ea97cef94512 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:11.984659 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-889ca813-5ce6-4169-bec8-ea97cef94512 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:11.987622 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 907/1809] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:25:11 2022] DELETE /identity/v3/projects/09d1a32f43e1401da50a8571a3385338 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:25:11.991303 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a57a3c-9e50-49b5-8147-423dcd736e0d service cinder] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:12.012278 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a57a3c-9e50-49b5-8147-423dcd736e0d service cinder] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:12.129384 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ce6030-f83e-4f23-8dbd-96bea20ccdfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:12.130291 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce6030-f83e-4f23-8dbd-96bea20ccdfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:12.130575 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce6030-f83e-4f23-8dbd-96bea20ccdfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:12.130893 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce6030-f83e-4f23-8dbd-96bea20ccdfc admin admin] PATH_INFO: `/v3/users/6b6c3f7f4d2747a38fc03d8b9e3587ee` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:12.135850 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ce6030-f83e-4f23-8dbd-96bea20ccdfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b6c3f7f4d2747a38fc03d8b9e3587ee)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:12.140881 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ce6030-f83e-4f23-8dbd-96bea20ccdfc admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:12.256133 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-48ce6030-f83e-4f23-8dbd-96bea20ccdfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b6c3f7f4d2747a38fc03d8b9e3587ee'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:12.275646 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-48ce6030-f83e-4f23-8dbd-96bea20ccdfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b6c3f7f4d2747a38fc03d8b9e3587ee'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:12.292164 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-48ce6030-f83e-4f23-8dbd-96bea20ccdfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b6c3f7f4d2747a38fc03d8b9e3587ee'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:12.294354 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-48ce6030-f83e-4f23-8dbd-96bea20ccdfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b6c3f7f4d2747a38fc03d8b9e3587ee'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:12.297365 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-48ce6030-f83e-4f23-8dbd-96bea20ccdfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b6c3f7f4d2747a38fc03d8b9e3587ee'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:12.344381 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 903/1810] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:25:11 2022] DELETE /identity/v3/users/6b6c3f7f4d2747a38fc03d8b9e3587ee => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:25:12.736609 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889ca813-5ce6-4169-bec8-ea97cef94512 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:12.739003 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-889ca813-5ce6-4169-bec8-ea97cef94512 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:12.766323 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889ca813-5ce6-4169-bec8-ea97cef94512 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:12.865950 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35e9082-a2e7-4389-9144-211e798282b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:12.866907 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e9082-a2e7-4389-9144-211e798282b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:12.867230 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e9082-a2e7-4389-9144-211e798282b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:12.867697 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e9082-a2e7-4389-9144-211e798282b6 admin admin] PATH_INFO: `/v3/projects/cd2cafeaeea74086986cf579a9513da0` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:12.869386 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35e9082-a2e7-4389-9144-211e798282b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd2cafeaeea74086986cf579a9513da0)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:12.873037 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35e9082-a2e7-4389-9144-211e798282b6 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:12.925076 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-c35e9082-a2e7-4389-9144-211e798282b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd2cafeaeea74086986cf579a9513da0', 'request_id': 'req-c35e9082-a2e7-4389-9144-211e798282b6'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:12.931726 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-c35e9082-a2e7-4389-9144-211e798282b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd2cafeaeea74086986cf579a9513da0', 'request_id': 'req-c35e9082-a2e7-4389-9144-211e798282b6'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:12.937479 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-c35e9082-a2e7-4389-9144-211e798282b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd2cafeaeea74086986cf579a9513da0', 'request_id': 'req-c35e9082-a2e7-4389-9144-211e798282b6'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:12.951422 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-c35e9082-a2e7-4389-9144-211e798282b6 admin admin] The token cache is being invalidate because project cd2cafeaeea74086986cf579a9513da0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:25:12.951715 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-c35e9082-a2e7-4389-9144-211e798282b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:12.952338 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-c35e9082-a2e7-4389-9144-211e798282b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:12.953881 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 908/1811] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:25:12 2022] DELETE /identity/v3/projects/cd2cafeaeea74086986cf579a9513da0 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:25:12.958797 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36e01a-4c17-4c53-a781-f74a5a539254 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:12.959114 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36e01a-4c17-4c53-a781-f74a5a539254 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:12.959418 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36e01a-4c17-4c53-a781-f74a5a539254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:12.978229 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-2c36e01a-4c17-4c53-a781-f74a5a539254 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:25:12.979778 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-2c36e01a-4c17-4c53-a781-f74a5a539254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:13.040060 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 904/1812] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:25:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:25:13.048799 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6982cd9-6475-4b25-a4fc-290492ce6855 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:13.049086 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6982cd9-6475-4b25-a4fc-290492ce6855 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:13.049364 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6982cd9-6475-4b25-a4fc-290492ce6855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:13.067943 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-f6982cd9-6475-4b25-a4fc-290492ce6855 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:25:13.069498 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-f6982cd9-6475-4b25-a4fc-290492ce6855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:13.078726 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 909/1813] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:25:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:25:13.083111 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c36e01a-4c17-4c53-a781-f74a5a539254 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:13.094559 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c36e01a-4c17-4c53-a781-f74a5a539254 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:13.100776 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6668e83c-fe30-412b-802d-126f90386f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:13.101596 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668e83c-fe30-412b-802d-126f90386f71 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:13.102047 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668e83c-fe30-412b-802d-126f90386f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:13.102498 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668e83c-fe30-412b-802d-126f90386f71 admin admin] PATH_INFO: `/v3/domains` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:13.103313 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6668e83c-fe30-412b-802d-126f90386f71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:25:13.103688 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6668e83c-fe30-412b-802d-126f90386f71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:13.105836 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6668e83c-fe30-412b-802d-126f90386f71 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:13.121908 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 905/1814] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 9 20:25:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:25:13.123503 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6982cd9-6475-4b25-a4fc-290492ce6855 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:13.134473 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6982cd9-6475-4b25-a4fc-290492ce6855 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:13.140259 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a026749d-ea6c-4879-a0d1-d38bae475865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:13.140998 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a026749d-ea6c-4879-a0d1-d38bae475865 admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:13.141352 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a026749d-ea6c-4879-a0d1-d38bae475865 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:13.141696 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a026749d-ea6c-4879-a0d1-d38bae475865 admin admin] PATH_INFO: `/v3/projects` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:13.142463 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a026749d-ea6c-4879-a0d1-d38bae475865 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:13.144611 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a026749d-ea6c-4879-a0d1-d38bae475865 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:13.175047 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 910/1815] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:25:13 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:25:13.179026 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6668e83c-fe30-412b-802d-126f90386f71 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:13.190915 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6668e83c-fe30-412b-802d-126f90386f71 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:13.251806 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649546bb-9369-4e74-a959-da65348bfcac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:13.252648 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649546bb-9369-4e74-a959-da65348bfcac admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:13.253025 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649546bb-9369-4e74-a959-da65348bfcac admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:13.253394 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649546bb-9369-4e74-a959-da65348bfcac admin admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:13.254272 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649546bb-9369-4e74-a959-da65348bfcac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:13.256326 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649546bb-9369-4e74-a959-da65348bfcac admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:13.281049 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 906/1816] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:25:13 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:25:13.285324 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a026749d-ea6c-4879-a0d1-d38bae475865 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:13.297611 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a026749d-ea6c-4879-a0d1-d38bae475865 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:13.304025 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc3e146-0ab5-4139-b1bd-778a9a0ee976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:13.305122 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc3e146-0ab5-4139-b1bd-778a9a0ee976 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:13.305480 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc3e146-0ab5-4139-b1bd-778a9a0ee976 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:13.305825 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc3e146-0ab5-4139-b1bd-778a9a0ee976 admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:13.306938 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc3e146-0ab5-4139-b1bd-778a9a0ee976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:13.308924 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc3e146-0ab5-4139-b1bd-778a9a0ee976 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:13.324761 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 911/1817] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:25:13 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:25:13.328421 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649546bb-9369-4e74-a959-da65348bfcac admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:13.338557 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649546bb-9369-4e74-a959-da65348bfcac admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:13.346464 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14695f9-4f86-4da6-880a-6d179a522597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:13.346464 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14695f9-4f86-4da6-880a-6d179a522597 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:13.346464 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14695f9-4f86-4da6-880a-6d179a522597 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:13.346464 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14695f9-4f86-4da6-880a-6d179a522597 admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:13.346934 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14695f9-4f86-4da6-880a-6d179a522597 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:13.348013 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14695f9-4f86-4da6-880a-6d179a522597 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:13.361141 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 907/1818] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:25:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 09 20:25:13.365168 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc3e146-0ab5-4139-b1bd-778a9a0ee976 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:13.387674 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc3e146-0ab5-4139-b1bd-778a9a0ee976 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:13.394811 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7da3191-3968-41e3-8d29-cc8a8874869d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:13.395804 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7da3191-3968-41e3-8d29-cc8a8874869d admin admin] REQUEST_METHOD: `PUT` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:13.396205 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7da3191-3968-41e3-8d29-cc8a8874869d admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:13.396330 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7da3191-3968-41e3-8d29-cc8a8874869d admin admin] PATH_INFO: `/v3/projects/798b82aa0c734a5b9e58e314de427480/users/cacf77dd9da84a7b82111f9514b47057/roles/79f90a0bf6ea43d0b3c434e31556253a` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:13.437888 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7da3191-3968-41e3-8d29-cc8a8874869d admin admin] RBAC: Authorizing `identity:create_grant(project_id=798b82aa0c734a5b9e58e314de427480, user_id=cacf77dd9da84a7b82111f9514b47057, role_id=79f90a0bf6ea43d0b3c434e31556253a)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:13.440834 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7da3191-3968-41e3-8d29-cc8a8874869d admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:13.460684 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 912/1819] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:25:13 2022] PUT /identity/v3/projects/798b82aa0c734a5b9e58e314de427480/users/cacf77dd9da84a7b82111f9514b47057/roles/79f90a0bf6ea43d0b3c434e31556253a => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:25:13.471904 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad31f87-a69b-42b8-8bda-fcaa3e5a0f90 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:13.472189 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad31f87-a69b-42b8-8bda-fcaa3e5a0f90 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:13.474197 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad31f87-a69b-42b8-8bda-fcaa3e5a0f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:13.505105 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-fad31f87-a69b-42b8-8bda-fcaa3e5a0f90 None None] MFA Rules not processed for user `cacf77dd9da84a7b82111f9514b47057`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:25:13.505105 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-fad31f87-a69b-42b8-8bda-fcaa3e5a0f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:13.594199 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 908/1820] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:25:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:25:13.607763 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7da3191-3968-41e3-8d29-cc8a8874869d admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:13.609468 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-b7da3191-3968-41e3-8d29-cc8a8874869d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:13.672031 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7da3191-3968-41e3-8d29-cc8a8874869d admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:13.675858 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a923ad59-3d4d-459e-9d1f-4d8f71e70716 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d65e731386d44948dcc1ecd40cbda65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:13.676530 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a923ad59-3d4d-459e-9d1f-4d8f71e70716 service cinder] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:13.676838 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a923ad59-3d4d-459e-9d1f-4d8f71e70716 service cinder] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:13.677115 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a923ad59-3d4d-459e-9d1f-4d8f71e70716 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:13.687443 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a923ad59-3d4d-459e-9d1f-4d8f71e70716 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:13.689092 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a923ad59-3d4d-459e-9d1f-4d8f71e70716 service cinder] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:13.699978 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 913/1821] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:25:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:25:13.720153 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad31f87-a69b-42b8-8bda-fcaa3e5a0f90 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:13.795290 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad31f87-a69b-42b8-8bda-fcaa3e5a0f90 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:13.799967 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff609662-6988-4a3a-91a8-7908a6fb7b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:13.800826 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff609662-6988-4a3a-91a8-7908a6fb7b53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:13.801107 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff609662-6988-4a3a-91a8-7908a6fb7b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:13.806319 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff609662-6988-4a3a-91a8-7908a6fb7b53 admin admin] PATH_INFO: `/v3/users/cacf77dd9da84a7b82111f9514b47057` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:13.807178 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff609662-6988-4a3a-91a8-7908a6fb7b53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cacf77dd9da84a7b82111f9514b47057)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:13.809835 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff609662-6988-4a3a-91a8-7908a6fb7b53 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:13.866620 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-ff609662-6988-4a3a-91a8-7908a6fb7b53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cacf77dd9da84a7b82111f9514b47057'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:13.881204 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-ff609662-6988-4a3a-91a8-7908a6fb7b53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cacf77dd9da84a7b82111f9514b47057'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:13.890947 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-ff609662-6988-4a3a-91a8-7908a6fb7b53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cacf77dd9da84a7b82111f9514b47057'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:13.891906 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-ff609662-6988-4a3a-91a8-7908a6fb7b53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cacf77dd9da84a7b82111f9514b47057'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:13.893005 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-ff609662-6988-4a3a-91a8-7908a6fb7b53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cacf77dd9da84a7b82111f9514b47057'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:13.914768 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 909/1822] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:25:13 2022] DELETE /identity/v3/users/cacf77dd9da84a7b82111f9514b47057 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:25:13.916773 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f203a23-bb72-4c11-b52d-b5c617ac1d60 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:13.917246 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f203a23-bb72-4c11-b52d-b5c617ac1d60 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:13.918790 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f203a23-bb72-4c11-b52d-b5c617ac1d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:13.941535 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-2f203a23-bb72-4c11-b52d-b5c617ac1d60 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:25:13.942769 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-2f203a23-bb72-4c11-b52d-b5c617ac1d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:14.027724 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 914/1823] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:25:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:25:14.037694 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff609662-6988-4a3a-91a8-7908a6fb7b53 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:14.039287 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-ff609662-6988-4a3a-91a8-7908a6fb7b53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:14.122647 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff609662-6988-4a3a-91a8-7908a6fb7b53 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:14.126445 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34c0913-d217-4400-8ca5-13a68d03d16b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:14.127087 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c0913-d217-4400-8ca5-13a68d03d16b service neutron] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:14.127364 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c0913-d217-4400-8ca5-13a68d03d16b service neutron] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:14.127674 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c0913-d217-4400-8ca5-13a68d03d16b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:14.137728 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34c0913-d217-4400-8ca5-13a68d03d16b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:14.139148 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34c0913-d217-4400-8ca5-13a68d03d16b service neutron] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:14.148734 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 910/1824] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:25:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:25:14.428423 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f203a23-bb72-4c11-b52d-b5c617ac1d60 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:14.429841 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-2f203a23-bb72-4c11-b52d-b5c617ac1d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:14.444102 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f203a23-bb72-4c11-b52d-b5c617ac1d60 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:14.450066 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43dfa2b-aa12-4b92-969a-1ac0582ea9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:14.450942 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43dfa2b-aa12-4b92-969a-1ac0582ea9a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:14.451224 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43dfa2b-aa12-4b92-969a-1ac0582ea9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:14.451521 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43dfa2b-aa12-4b92-969a-1ac0582ea9a9 admin admin] PATH_INFO: `/v3/projects/798b82aa0c734a5b9e58e314de427480` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:14.452992 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43dfa2b-aa12-4b92-969a-1ac0582ea9a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=798b82aa0c734a5b9e58e314de427480)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:14.454890 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43dfa2b-aa12-4b92-969a-1ac0582ea9a9 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:14.500192 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-e43dfa2b-aa12-4b92-969a-1ac0582ea9a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '798b82aa0c734a5b9e58e314de427480', 'request_id': 'req-e43dfa2b-aa12-4b92-969a-1ac0582ea9a9'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:14.505969 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-e43dfa2b-aa12-4b92-969a-1ac0582ea9a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '798b82aa0c734a5b9e58e314de427480', 'request_id': 'req-e43dfa2b-aa12-4b92-969a-1ac0582ea9a9'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:14.510986 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-e43dfa2b-aa12-4b92-969a-1ac0582ea9a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '798b82aa0c734a5b9e58e314de427480', 'request_id': 'req-e43dfa2b-aa12-4b92-969a-1ac0582ea9a9'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:14.523339 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-e43dfa2b-aa12-4b92-969a-1ac0582ea9a9 admin admin] The token cache is being invalidate because project 798b82aa0c734a5b9e58e314de427480 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:25:14.523639 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-e43dfa2b-aa12-4b92-969a-1ac0582ea9a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:14.524238 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-e43dfa2b-aa12-4b92-969a-1ac0582ea9a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:14.525738 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 915/1825] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:25:14 2022] DELETE /identity/v3/projects/798b82aa0c734a5b9e58e314de427480 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:25:14.530643 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaacd1a-6cf9-49a7-b030-178ccaf09532 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:14.530924 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaacd1a-6cf9-49a7-b030-178ccaf09532 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:14.531193 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaacd1a-6cf9-49a7-b030-178ccaf09532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:14.548414 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-3eaacd1a-6cf9-49a7-b030-178ccaf09532 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:25:14.549586 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-3eaacd1a-6cf9-49a7-b030-178ccaf09532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:14.614315 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 911/1826] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:25:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:25:14.622799 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07ed92a-39a7-4d6c-987c-bb3eb1a460af None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:14.623082 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07ed92a-39a7-4d6c-987c-bb3eb1a460af None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:14.623358 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07ed92a-39a7-4d6c-987c-bb3eb1a460af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:14.641621 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-d07ed92a-39a7-4d6c-987c-bb3eb1a460af None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:25:14.642814 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-d07ed92a-39a7-4d6c-987c-bb3eb1a460af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:14.651218 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 916/1827] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:25:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:25:14.656206 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaacd1a-6cf9-49a7-b030-178ccaf09532 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:14.665593 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaacd1a-6cf9-49a7-b030-178ccaf09532 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:14.670177 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b626d5d9-20b6-4d3e-8b54-a047cf2e6a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:14.670820 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626d5d9-20b6-4d3e-8b54-a047cf2e6a96 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:14.671096 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626d5d9-20b6-4d3e-8b54-a047cf2e6a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:14.671369 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626d5d9-20b6-4d3e-8b54-a047cf2e6a96 admin admin] PATH_INFO: `/v3/domains` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:14.672115 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b626d5d9-20b6-4d3e-8b54-a047cf2e6a96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:25:14.672416 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b626d5d9-20b6-4d3e-8b54-a047cf2e6a96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:14.674000 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b626d5d9-20b6-4d3e-8b54-a047cf2e6a96 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:14.686192 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 912/1828] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 9 20:25:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:25:14.690814 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07ed92a-39a7-4d6c-987c-bb3eb1a460af None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:14.700341 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07ed92a-39a7-4d6c-987c-bb3eb1a460af None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:14.708236 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e85630f-399b-491e-9ee9-7f3b8083fa0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:14.709076 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e85630f-399b-491e-9ee9-7f3b8083fa0c admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:14.709337 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e85630f-399b-491e-9ee9-7f3b8083fa0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:14.709671 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e85630f-399b-491e-9ee9-7f3b8083fa0c admin admin] PATH_INFO: `/v3/projects` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:14.710556 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e85630f-399b-491e-9ee9-7f3b8083fa0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:14.712984 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e85630f-399b-491e-9ee9-7f3b8083fa0c admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:14.742938 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 917/1829] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:25:14 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 20:25:14.744180 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b626d5d9-20b6-4d3e-8b54-a047cf2e6a96 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:14.754062 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b626d5d9-20b6-4d3e-8b54-a047cf2e6a96 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:14.811801 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce8d561-db7d-4835-8d10-34f1a204a5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:14.812464 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce8d561-db7d-4835-8d10-34f1a204a5d3 admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:14.812745 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce8d561-db7d-4835-8d10-34f1a204a5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:14.813014 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce8d561-db7d-4835-8d10-34f1a204a5d3 admin admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:14.813685 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce8d561-db7d-4835-8d10-34f1a204a5d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:14.815614 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce8d561-db7d-4835-8d10-34f1a204a5d3 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:14.834587 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 913/1830] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:25:14 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:25:14.838686 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e85630f-399b-491e-9ee9-7f3b8083fa0c admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:14.848786 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e85630f-399b-491e-9ee9-7f3b8083fa0c admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:14.853316 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9264149-3049-4a4e-8f9f-22b8aab8b33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:14.853964 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9264149-3049-4a4e-8f9f-22b8aab8b33f admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:14.854247 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9264149-3049-4a4e-8f9f-22b8aab8b33f admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:14.854519 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9264149-3049-4a4e-8f9f-22b8aab8b33f admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:14.855840 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9264149-3049-4a4e-8f9f-22b8aab8b33f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:14.857563 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9264149-3049-4a4e-8f9f-22b8aab8b33f admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:14.867982 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 918/1831] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:25:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:25:14.872481 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce8d561-db7d-4835-8d10-34f1a204a5d3 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:14.882167 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce8d561-db7d-4835-8d10-34f1a204a5d3 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:14.890731 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba346b0-2f7e-425c-9171-467c02576103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:14.891253 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba346b0-2f7e-425c-9171-467c02576103 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:14.891599 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba346b0-2f7e-425c-9171-467c02576103 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:14.891843 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba346b0-2f7e-425c-9171-467c02576103 admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:14.892577 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba346b0-2f7e-425c-9171-467c02576103 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:14.894160 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba346b0-2f7e-425c-9171-467c02576103 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:14.904328 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 914/1832] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:25:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:25:14.908269 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9264149-3049-4a4e-8f9f-22b8aab8b33f admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:14.918918 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9264149-3049-4a4e-8f9f-22b8aab8b33f admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:14.924224 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db47b15f-dcae-40e5-b70f-4dd1f5d16ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:14.925083 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db47b15f-dcae-40e5-b70f-4dd1f5d16ea7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:14.925364 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db47b15f-dcae-40e5-b70f-4dd1f5d16ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:14.925639 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db47b15f-dcae-40e5-b70f-4dd1f5d16ea7 admin admin] PATH_INFO: `/v3/projects/436cfcdd20fb4bf18c766db742c49634/users/9d6c0128de3b4073b8e281d892f9fd78/roles/79f90a0bf6ea43d0b3c434e31556253a` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:14.940511 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db47b15f-dcae-40e5-b70f-4dd1f5d16ea7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=436cfcdd20fb4bf18c766db742c49634, user_id=9d6c0128de3b4073b8e281d892f9fd78, role_id=79f90a0bf6ea43d0b3c434e31556253a)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:14.943735 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db47b15f-dcae-40e5-b70f-4dd1f5d16ea7 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:14.956452 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 919/1833] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:25:14 2022] PUT /identity/v3/projects/436cfcdd20fb4bf18c766db742c49634/users/9d6c0128de3b4073b8e281d892f9fd78/roles/79f90a0bf6ea43d0b3c434e31556253a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:25:14.967049 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1873ff-7c1a-4c90-9034-7ca7e5835b02 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:14.967334 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1873ff-7c1a-4c90-9034-7ca7e5835b02 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:14.967638 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1873ff-7c1a-4c90-9034-7ca7e5835b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:14.994453 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-fb1873ff-7c1a-4c90-9034-7ca7e5835b02 None None] MFA Rules not processed for user `9d6c0128de3b4073b8e281d892f9fd78`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:25:14.996613 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-fb1873ff-7c1a-4c90-9034-7ca7e5835b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:15.062472 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 915/1834] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:25:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:25:15.073884 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db47b15f-dcae-40e5-b70f-4dd1f5d16ea7 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:15.075632 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-db47b15f-dcae-40e5-b70f-4dd1f5d16ea7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:15.132468 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db47b15f-dcae-40e5-b70f-4dd1f5d16ea7 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:15.137637 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f1b223-f0c3-453f-a209-8bf01ffd09a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d65e731386d44948dcc1ecd40cbda65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:15.142960 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f1b223-f0c3-453f-a209-8bf01ffd09a9 service cinder] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:15.143484 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f1b223-f0c3-453f-a209-8bf01ffd09a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:15.143851 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f1b223-f0c3-453f-a209-8bf01ffd09a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:15.167182 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f1b223-f0c3-453f-a209-8bf01ffd09a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:15.169267 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f1b223-f0c3-453f-a209-8bf01ffd09a9 service cinder] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:15.178761 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 920/1835] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:25:15 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:25:15.198287 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1873ff-7c1a-4c90-9034-7ca7e5835b02 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:15.261325 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1873ff-7c1a-4c90-9034-7ca7e5835b02 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:15.267108 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08fe7c8-cfe7-4b9e-b902-8eb8e5d2bd4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:15.268087 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08fe7c8-cfe7-4b9e-b902-8eb8e5d2bd4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:15.268500 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08fe7c8-cfe7-4b9e-b902-8eb8e5d2bd4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:15.275879 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08fe7c8-cfe7-4b9e-b902-8eb8e5d2bd4f admin admin] PATH_INFO: `/v3/users/9d6c0128de3b4073b8e281d892f9fd78` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:15.276436 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08fe7c8-cfe7-4b9e-b902-8eb8e5d2bd4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d6c0128de3b4073b8e281d892f9fd78)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:15.278976 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08fe7c8-cfe7-4b9e-b902-8eb8e5d2bd4f admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:15.325246 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-b08fe7c8-cfe7-4b9e-b902-8eb8e5d2bd4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d6c0128de3b4073b8e281d892f9fd78'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:15.332199 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-b08fe7c8-cfe7-4b9e-b902-8eb8e5d2bd4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d6c0128de3b4073b8e281d892f9fd78'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:15.340053 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-b08fe7c8-cfe7-4b9e-b902-8eb8e5d2bd4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d6c0128de3b4073b8e281d892f9fd78'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:15.341505 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-b08fe7c8-cfe7-4b9e-b902-8eb8e5d2bd4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d6c0128de3b4073b8e281d892f9fd78'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:15.342113 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-b08fe7c8-cfe7-4b9e-b902-8eb8e5d2bd4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d6c0128de3b4073b8e281d892f9fd78'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:15.359960 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 916/1836] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:25:15 2022] DELETE /identity/v3/users/9d6c0128de3b4073b8e281d892f9fd78 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:25:15.364301 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf35261-b21a-46c1-8c0e-0df536057c3a None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:15.364649 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf35261-b21a-46c1-8c0e-0df536057c3a None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:15.364986 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf35261-b21a-46c1-8c0e-0df536057c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:15.382817 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-4bf35261-b21a-46c1-8c0e-0df536057c3a None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:25:15.384044 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-4bf35261-b21a-46c1-8c0e-0df536057c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:15.443026 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 921/1837] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:25:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:25:15.452813 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08fe7c8-cfe7-4b9e-b902-8eb8e5d2bd4f admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:15.454216 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-b08fe7c8-cfe7-4b9e-b902-8eb8e5d2bd4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:15.509046 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08fe7c8-cfe7-4b9e-b902-8eb8e5d2bd4f admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:15.513515 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b1fe5-dd70-408e-8320-67e58b8621ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:15.514151 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b1fe5-dd70-408e-8320-67e58b8621ed service neutron] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:15.514428 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b1fe5-dd70-408e-8320-67e58b8621ed service neutron] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:15.514695 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b1fe5-dd70-408e-8320-67e58b8621ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:15.523320 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977b1fe5-dd70-408e-8320-67e58b8621ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:15.524782 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977b1fe5-dd70-408e-8320-67e58b8621ed service neutron] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:15.534838 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 917/1838] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:25:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:25:15.803026 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf35261-b21a-46c1-8c0e-0df536057c3a None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:15.804498 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-4bf35261-b21a-46c1-8c0e-0df536057c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:15.828046 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf35261-b21a-46c1-8c0e-0df536057c3a None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:15.832762 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2827993-ffe3-4ffb-9865-1604c2db9ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:15.833619 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2827993-ffe3-4ffb-9865-1604c2db9ca0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:15.833900 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2827993-ffe3-4ffb-9865-1604c2db9ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:15.834174 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2827993-ffe3-4ffb-9865-1604c2db9ca0 admin admin] PATH_INFO: `/v3/projects/436cfcdd20fb4bf18c766db742c49634` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:15.835385 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2827993-ffe3-4ffb-9865-1604c2db9ca0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=436cfcdd20fb4bf18c766db742c49634)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:15.837376 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2827993-ffe3-4ffb-9865-1604c2db9ca0 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:15.884712 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-e2827993-ffe3-4ffb-9865-1604c2db9ca0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '436cfcdd20fb4bf18c766db742c49634', 'request_id': 'req-e2827993-ffe3-4ffb-9865-1604c2db9ca0'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:15.893328 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-e2827993-ffe3-4ffb-9865-1604c2db9ca0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '436cfcdd20fb4bf18c766db742c49634', 'request_id': 'req-e2827993-ffe3-4ffb-9865-1604c2db9ca0'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:15.899264 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-e2827993-ffe3-4ffb-9865-1604c2db9ca0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '436cfcdd20fb4bf18c766db742c49634', 'request_id': 'req-e2827993-ffe3-4ffb-9865-1604c2db9ca0'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:15.914271 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-e2827993-ffe3-4ffb-9865-1604c2db9ca0 admin admin] The token cache is being invalidate because project 436cfcdd20fb4bf18c766db742c49634 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:25:15.914647 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-e2827993-ffe3-4ffb-9865-1604c2db9ca0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:15.915204 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-e2827993-ffe3-4ffb-9865-1604c2db9ca0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:15.917141 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 922/1839] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:25:15 2022] DELETE /identity/v3/projects/436cfcdd20fb4bf18c766db742c49634 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:25:15.921745 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229b34c-ad84-43dd-aa0b-ccc69b87eefd None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:15.922029 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229b34c-ad84-43dd-aa0b-ccc69b87eefd None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:15.922300 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229b34c-ad84-43dd-aa0b-ccc69b87eefd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:15.940896 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-f229b34c-ad84-43dd-aa0b-ccc69b87eefd None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:25:15.942184 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-f229b34c-ad84-43dd-aa0b-ccc69b87eefd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:16.000802 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 918/1840] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:25:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:25:16.009516 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f12af84-3152-47d0-b9a7-9f92052bd77a None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:16.009996 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f12af84-3152-47d0-b9a7-9f92052bd77a None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:16.010111 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f12af84-3152-47d0-b9a7-9f92052bd77a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:16.028746 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-8f12af84-3152-47d0-b9a7-9f92052bd77a None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:25:16.029931 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-8f12af84-3152-47d0-b9a7-9f92052bd77a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:16.037697 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 923/1841] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:25:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:25:16.042091 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f229b34c-ad84-43dd-aa0b-ccc69b87eefd None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:16.051803 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f229b34c-ad84-43dd-aa0b-ccc69b87eefd None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:16.056341 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a1c759-c695-4922-97f2-10d827496547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:16.056975 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1c759-c695-4922-97f2-10d827496547 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:16.057246 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1c759-c695-4922-97f2-10d827496547 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:16.057510 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1c759-c695-4922-97f2-10d827496547 admin admin] PATH_INFO: `/v3/domains` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:16.058884 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a1c759-c695-4922-97f2-10d827496547 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:25:16.059197 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a1c759-c695-4922-97f2-10d827496547 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:16.060828 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a1c759-c695-4922-97f2-10d827496547 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:16.071797 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 919/1842] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 9 20:25:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:25:16.076526 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f12af84-3152-47d0-b9a7-9f92052bd77a None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:16.085415 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f12af84-3152-47d0-b9a7-9f92052bd77a None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:16.090089 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161296fa-ee26-455d-b693-b1b358aa24b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:16.090719 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161296fa-ee26-455d-b693-b1b358aa24b5 admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:16.090996 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161296fa-ee26-455d-b693-b1b358aa24b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:16.091269 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161296fa-ee26-455d-b693-b1b358aa24b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:16.091981 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161296fa-ee26-455d-b693-b1b358aa24b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:16.093864 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161296fa-ee26-455d-b693-b1b358aa24b5 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:16.117948 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 924/1843] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:25:16 2022] POST /identity/v3/projects => generated 377 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:25:16.122670 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a1c759-c695-4922-97f2-10d827496547 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:16.132397 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a1c759-c695-4922-97f2-10d827496547 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:16.186538 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b1396-124b-4ea9-b9aa-25ec03d1ae70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:16.187204 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b1396-124b-4ea9-b9aa-25ec03d1ae70 admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:16.187635 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b1396-124b-4ea9-b9aa-25ec03d1ae70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:16.187935 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b1396-124b-4ea9-b9aa-25ec03d1ae70 admin admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:16.188878 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260b1396-124b-4ea9-b9aa-25ec03d1ae70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:16.190873 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260b1396-124b-4ea9-b9aa-25ec03d1ae70 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:16.214933 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 920/1844] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:25:16 2022] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:25:16.216114 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161296fa-ee26-455d-b693-b1b358aa24b5 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:16.226295 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161296fa-ee26-455d-b693-b1b358aa24b5 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:16.231382 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a8bd0c-1bec-47b0-ab1e-e07be63dc244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:16.232077 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a8bd0c-1bec-47b0-ab1e-e07be63dc244 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:16.232384 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a8bd0c-1bec-47b0-ab1e-e07be63dc244 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:16.232620 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a8bd0c-1bec-47b0-ab1e-e07be63dc244 admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:16.233691 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a8bd0c-1bec-47b0-ab1e-e07be63dc244 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:16.235436 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a8bd0c-1bec-47b0-ab1e-e07be63dc244 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:16.247412 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 925/1845] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:25:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:25:16.251544 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b1396-124b-4ea9-b9aa-25ec03d1ae70 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:16.262150 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b1396-124b-4ea9-b9aa-25ec03d1ae70 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:16.266816 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767298be-9f4a-4cf9-8efe-067a69923056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:16.267491 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767298be-9f4a-4cf9-8efe-067a69923056 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:16.267768 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767298be-9f4a-4cf9-8efe-067a69923056 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:16.268035 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767298be-9f4a-4cf9-8efe-067a69923056 admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:16.268756 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767298be-9f4a-4cf9-8efe-067a69923056 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:16.270468 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767298be-9f4a-4cf9-8efe-067a69923056 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:16.281278 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 921/1846] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:25:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:25:16.284984 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a8bd0c-1bec-47b0-ab1e-e07be63dc244 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:16.297628 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a8bd0c-1bec-47b0-ab1e-e07be63dc244 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:16.303862 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64284e85-b6eb-4c83-a2fe-fc80864fd31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:16.304766 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64284e85-b6eb-4c83-a2fe-fc80864fd31b admin admin] REQUEST_METHOD: `PUT` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:16.305051 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64284e85-b6eb-4c83-a2fe-fc80864fd31b admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:16.305326 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64284e85-b6eb-4c83-a2fe-fc80864fd31b admin admin] PATH_INFO: `/v3/projects/66d73b5d738e40739df5b0beb6f123d5/users/ec4b5b956b2f4c3e8a2b9e81c01ebd7c/roles/79f90a0bf6ea43d0b3c434e31556253a` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:16.323164 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64284e85-b6eb-4c83-a2fe-fc80864fd31b admin admin] RBAC: Authorizing `identity:create_grant(project_id=66d73b5d738e40739df5b0beb6f123d5, user_id=ec4b5b956b2f4c3e8a2b9e81c01ebd7c, role_id=79f90a0bf6ea43d0b3c434e31556253a)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:16.326736 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64284e85-b6eb-4c83-a2fe-fc80864fd31b admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:16.343074 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 926/1847] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:25:16 2022] PUT /identity/v3/projects/66d73b5d738e40739df5b0beb6f123d5/users/ec4b5b956b2f4c3e8a2b9e81c01ebd7c/roles/79f90a0bf6ea43d0b3c434e31556253a => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:25:16.353596 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e648b-fe67-47bc-be0e-77d986d9a82e None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:16.353880 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e648b-fe67-47bc-be0e-77d986d9a82e None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:16.354150 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e648b-fe67-47bc-be0e-77d986d9a82e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:16.381417 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-a17e648b-fe67-47bc-be0e-77d986d9a82e None None] MFA Rules not processed for user `ec4b5b956b2f4c3e8a2b9e81c01ebd7c`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:25:16.382671 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-a17e648b-fe67-47bc-be0e-77d986d9a82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:16.456561 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 922/1848] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:25:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:25:16.468233 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64284e85-b6eb-4c83-a2fe-fc80864fd31b admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:16.469998 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-64284e85-b6eb-4c83-a2fe-fc80864fd31b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:16.528821 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64284e85-b6eb-4c83-a2fe-fc80864fd31b admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:16.532641 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b16c64-2559-4e0f-86a5-9f000cb761d8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65db5d9a86fd48acb5874df0165c0ef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:16.533352 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b16c64-2559-4e0f-86a5-9f000cb761d8 service glance] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:16.533675 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b16c64-2559-4e0f-86a5-9f000cb761d8 service glance] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:16.533946 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b16c64-2559-4e0f-86a5-9f000cb761d8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:16.542462 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b16c64-2559-4e0f-86a5-9f000cb761d8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:16.544274 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b16c64-2559-4e0f-86a5-9f000cb761d8 service glance] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:16.553468 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 927/1849] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:25:16 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:25:24.682376 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e648b-fe67-47bc-be0e-77d986d9a82e None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:24.684004 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-a17e648b-fe67-47bc-be0e-77d986d9a82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:24.759068 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e648b-fe67-47bc-be0e-77d986d9a82e None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:24.767032 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a3c17d-f96d-469b-a477-ef2cdabaedf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:24.768836 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a3c17d-f96d-469b-a477-ef2cdabaedf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:24.768836 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a3c17d-f96d-469b-a477-ef2cdabaedf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:24.768836 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a3c17d-f96d-469b-a477-ef2cdabaedf3 admin admin] PATH_INFO: `/v3/users/c5273c312b1c49678d3da66d299377d3` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:24.769828 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a3c17d-f96d-469b-a477-ef2cdabaedf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5273c312b1c49678d3da66d299377d3)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:24.771926 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a3c17d-f96d-469b-a477-ef2cdabaedf3 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:24.833758 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-75a3c17d-f96d-469b-a477-ef2cdabaedf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5273c312b1c49678d3da66d299377d3'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:24.841391 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-75a3c17d-f96d-469b-a477-ef2cdabaedf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5273c312b1c49678d3da66d299377d3'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:24.849809 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-75a3c17d-f96d-469b-a477-ef2cdabaedf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5273c312b1c49678d3da66d299377d3'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:24.850654 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-75a3c17d-f96d-469b-a477-ef2cdabaedf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5273c312b1c49678d3da66d299377d3'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:24.851326 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-75a3c17d-f96d-469b-a477-ef2cdabaedf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5273c312b1c49678d3da66d299377d3'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:24.876702 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 923/1850] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:25:24 2022] DELETE /identity/v3/users/c5273c312b1c49678d3da66d299377d3 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:25:24.876787 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f92fe-c080-42fa-b05b-cc652b7232e6 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:24.876787 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f92fe-c080-42fa-b05b-cc652b7232e6 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:24.876787 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f92fe-c080-42fa-b05b-cc652b7232e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:24.899571 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-dc0f92fe-c080-42fa-b05b-cc652b7232e6 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:25:24.901814 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-dc0f92fe-c080-42fa-b05b-cc652b7232e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:24.969275 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 928/1851] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:25:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:25:24.979079 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a3c17d-f96d-469b-a477-ef2cdabaedf3 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:24.980855 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-75a3c17d-f96d-469b-a477-ef2cdabaedf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:25.044153 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a3c17d-f96d-469b-a477-ef2cdabaedf3 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:25.048650 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ec4ca2-dfef-4eb4-94e3-52f7f8c5d289 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:25.049324 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec4ca2-dfef-4eb4-94e3-52f7f8c5d289 service neutron] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:25.049851 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec4ca2-dfef-4eb4-94e3-52f7f8c5d289 service neutron] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:25.050157 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec4ca2-dfef-4eb4-94e3-52f7f8c5d289 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:25.061332 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ec4ca2-dfef-4eb4-94e3-52f7f8c5d289 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:25.063005 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ec4ca2-dfef-4eb4-94e3-52f7f8c5d289 service neutron] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:25.072587 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 924/1852] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:25:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:25:25.343008 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0f92fe-c080-42fa-b05b-cc652b7232e6 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:25.344495 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-dc0f92fe-c080-42fa-b05b-cc652b7232e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:25.357660 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0f92fe-c080-42fa-b05b-cc652b7232e6 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:25.364202 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d12a49d-2833-49a7-b0e3-9357010c26b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:25.365052 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d12a49d-2833-49a7-b0e3-9357010c26b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:25.365329 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d12a49d-2833-49a7-b0e3-9357010c26b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:25.365639 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d12a49d-2833-49a7-b0e3-9357010c26b2 admin admin] PATH_INFO: `/v3/projects/e7be8e231d9f4835a72ed445cf56e066` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:25.366795 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d12a49d-2833-49a7-b0e3-9357010c26b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7be8e231d9f4835a72ed445cf56e066)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:25.368735 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d12a49d-2833-49a7-b0e3-9357010c26b2 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:25.424252 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-7d12a49d-2833-49a7-b0e3-9357010c26b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7be8e231d9f4835a72ed445cf56e066', 'request_id': 'req-7d12a49d-2833-49a7-b0e3-9357010c26b2'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:25.432558 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-7d12a49d-2833-49a7-b0e3-9357010c26b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7be8e231d9f4835a72ed445cf56e066', 'request_id': 'req-7d12a49d-2833-49a7-b0e3-9357010c26b2'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:25.439280 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-7d12a49d-2833-49a7-b0e3-9357010c26b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7be8e231d9f4835a72ed445cf56e066', 'request_id': 'req-7d12a49d-2833-49a7-b0e3-9357010c26b2'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:25.453057 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-7d12a49d-2833-49a7-b0e3-9357010c26b2 admin admin] The token cache is being invalidate because project e7be8e231d9f4835a72ed445cf56e066 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:25:25.453337 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-7d12a49d-2833-49a7-b0e3-9357010c26b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:25.455274 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-7d12a49d-2833-49a7-b0e3-9357010c26b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:25.457188 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 929/1853] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:25:25 2022] DELETE /identity/v3/projects/e7be8e231d9f4835a72ed445cf56e066 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:25:25.462255 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ec4ca2-dfef-4eb4-94e3-52f7f8c5d289 service neutron] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:25.478072 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ec4ca2-dfef-4eb4-94e3-52f7f8c5d289 service neutron] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:25.539305 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23587a51-c60d-4717-ae59-49a654f45e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:25.540241 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23587a51-c60d-4717-ae59-49a654f45e1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:25.540450 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23587a51-c60d-4717-ae59-49a654f45e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:25.540709 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23587a51-c60d-4717-ae59-49a654f45e1a admin admin] PATH_INFO: `/v3/users/16d47c455b8f472284bf6dc232b114ba` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:25.541904 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23587a51-c60d-4717-ae59-49a654f45e1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=16d47c455b8f472284bf6dc232b114ba)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:25.544482 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23587a51-c60d-4717-ae59-49a654f45e1a admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:25.606962 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-23587a51-c60d-4717-ae59-49a654f45e1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16d47c455b8f472284bf6dc232b114ba'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:25.614296 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-23587a51-c60d-4717-ae59-49a654f45e1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16d47c455b8f472284bf6dc232b114ba'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:25.624074 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-23587a51-c60d-4717-ae59-49a654f45e1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16d47c455b8f472284bf6dc232b114ba'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:25.625004 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-23587a51-c60d-4717-ae59-49a654f45e1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16d47c455b8f472284bf6dc232b114ba'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:25.625805 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-23587a51-c60d-4717-ae59-49a654f45e1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16d47c455b8f472284bf6dc232b114ba'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:25.650119 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 925/1854] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:25:25 2022] DELETE /identity/v3/users/16d47c455b8f472284bf6dc232b114ba => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:25:26.045280 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d12a49d-2833-49a7-b0e3-9357010c26b2 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:26.046709 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-7d12a49d-2833-49a7-b0e3-9357010c26b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:26.059890 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d12a49d-2833-49a7-b0e3-9357010c26b2 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:26.134202 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be0e6ef-0bf9-4288-a931-31f73984657c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:26.135168 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be0e6ef-0bf9-4288-a931-31f73984657c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:26.135485 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be0e6ef-0bf9-4288-a931-31f73984657c admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:26.135786 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be0e6ef-0bf9-4288-a931-31f73984657c admin admin] PATH_INFO: `/v3/projects/c59f068d08af4da9a58ba6420f9edef9` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:26.137371 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be0e6ef-0bf9-4288-a931-31f73984657c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c59f068d08af4da9a58ba6420f9edef9)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:26.139253 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be0e6ef-0bf9-4288-a931-31f73984657c admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:26.186802 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-9be0e6ef-0bf9-4288-a931-31f73984657c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c59f068d08af4da9a58ba6420f9edef9', 'request_id': 'req-9be0e6ef-0bf9-4288-a931-31f73984657c'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:26.193363 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-9be0e6ef-0bf9-4288-a931-31f73984657c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c59f068d08af4da9a58ba6420f9edef9', 'request_id': 'req-9be0e6ef-0bf9-4288-a931-31f73984657c'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:26.199416 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-9be0e6ef-0bf9-4288-a931-31f73984657c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c59f068d08af4da9a58ba6420f9edef9', 'request_id': 'req-9be0e6ef-0bf9-4288-a931-31f73984657c'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:26.211722 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-9be0e6ef-0bf9-4288-a931-31f73984657c admin admin] The token cache is being invalidate because project c59f068d08af4da9a58ba6420f9edef9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:25:26.212000 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-9be0e6ef-0bf9-4288-a931-31f73984657c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:26.212603 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-9be0e6ef-0bf9-4288-a931-31f73984657c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:26.214324 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 930/1855] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:25:26 2022] DELETE /identity/v3/projects/c59f068d08af4da9a58ba6420f9edef9 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:25:26.218436 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23587a51-c60d-4717-ae59-49a654f45e1a admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:26.219899 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-23587a51-c60d-4717-ae59-49a654f45e1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:26.232917 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23587a51-c60d-4717-ae59-49a654f45e1a admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:26.290254 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0221a7bd-b97e-40e7-92ff-f7d0127dd13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:26.291266 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0221a7bd-b97e-40e7-92ff-f7d0127dd13d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:26.291572 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0221a7bd-b97e-40e7-92ff-f7d0127dd13d admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:26.291841 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0221a7bd-b97e-40e7-92ff-f7d0127dd13d admin admin] PATH_INFO: `/v3/users/3ed385792d314759bea1741bd61a0312` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:26.293869 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0221a7bd-b97e-40e7-92ff-f7d0127dd13d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ed385792d314759bea1741bd61a0312)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:26.296083 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0221a7bd-b97e-40e7-92ff-f7d0127dd13d admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:26.350482 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-0221a7bd-b97e-40e7-92ff-f7d0127dd13d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ed385792d314759bea1741bd61a0312'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:26.359579 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-0221a7bd-b97e-40e7-92ff-f7d0127dd13d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ed385792d314759bea1741bd61a0312'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:26.368784 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-0221a7bd-b97e-40e7-92ff-f7d0127dd13d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ed385792d314759bea1741bd61a0312'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:26.369368 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-0221a7bd-b97e-40e7-92ff-f7d0127dd13d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ed385792d314759bea1741bd61a0312'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:26.371197 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-0221a7bd-b97e-40e7-92ff-f7d0127dd13d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ed385792d314759bea1741bd61a0312'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:26.394440 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 926/1856] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:25:26 2022] DELETE /identity/v3/users/3ed385792d314759bea1741bd61a0312 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:25:26.723830 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be0e6ef-0bf9-4288-a931-31f73984657c admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:26.725916 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-9be0e6ef-0bf9-4288-a931-31f73984657c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:26.744784 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be0e6ef-0bf9-4288-a931-31f73984657c admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:26.817635 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363eeddf-5fe1-4688-b0af-bc3e03badae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:26.818998 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363eeddf-5fe1-4688-b0af-bc3e03badae6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:26.819279 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363eeddf-5fe1-4688-b0af-bc3e03badae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:26.819744 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363eeddf-5fe1-4688-b0af-bc3e03badae6 admin admin] PATH_INFO: `/v3/projects/a5fe080fb6554d65a26bfa6af2683261` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:26.821244 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363eeddf-5fe1-4688-b0af-bc3e03badae6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5fe080fb6554d65a26bfa6af2683261)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:26.823886 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363eeddf-5fe1-4688-b0af-bc3e03badae6 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:26.878565 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-363eeddf-5fe1-4688-b0af-bc3e03badae6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5fe080fb6554d65a26bfa6af2683261', 'request_id': 'req-363eeddf-5fe1-4688-b0af-bc3e03badae6'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:26.888175 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-363eeddf-5fe1-4688-b0af-bc3e03badae6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5fe080fb6554d65a26bfa6af2683261', 'request_id': 'req-363eeddf-5fe1-4688-b0af-bc3e03badae6'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:26.896590 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-363eeddf-5fe1-4688-b0af-bc3e03badae6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5fe080fb6554d65a26bfa6af2683261', 'request_id': 'req-363eeddf-5fe1-4688-b0af-bc3e03badae6'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:26.910928 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-363eeddf-5fe1-4688-b0af-bc3e03badae6 admin admin] The token cache is being invalidate because project a5fe080fb6554d65a26bfa6af2683261 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:25:26.911300 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-363eeddf-5fe1-4688-b0af-bc3e03badae6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:26.912024 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-363eeddf-5fe1-4688-b0af-bc3e03badae6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:26.913758 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 931/1857] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:25:26 2022] DELETE /identity/v3/projects/a5fe080fb6554d65a26bfa6af2683261 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:25:26.921963 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943331d8-7c49-41af-87f6-389187ee04ad None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:26.922265 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943331d8-7c49-41af-87f6-389187ee04ad None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:26.922560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943331d8-7c49-41af-87f6-389187ee04ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:26.941424 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-943331d8-7c49-41af-87f6-389187ee04ad None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:25:26.942624 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-943331d8-7c49-41af-87f6-389187ee04ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:27.012385 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 927/1858] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:25:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:25:27.021729 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53535f73-fcd0-405b-9a80-50700e58e789 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:27.022020 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53535f73-fcd0-405b-9a80-50700e58e789 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:27.022301 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53535f73-fcd0-405b-9a80-50700e58e789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:27.053289 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-53535f73-fcd0-405b-9a80-50700e58e789 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:25:27.054495 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-53535f73-fcd0-405b-9a80-50700e58e789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:27.064922 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 932/1859] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:25:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:25:27.070177 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943331d8-7c49-41af-87f6-389187ee04ad None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:27.081945 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943331d8-7c49-41af-87f6-389187ee04ad None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:27.087749 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee65f20-c881-48a7-bf3e-69edd921c741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:27.088580 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee65f20-c881-48a7-bf3e-69edd921c741 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:27.089132 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee65f20-c881-48a7-bf3e-69edd921c741 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:27.090184 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee65f20-c881-48a7-bf3e-69edd921c741 admin admin] PATH_INFO: `/v3/domains` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:27.091276 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee65f20-c881-48a7-bf3e-69edd921c741 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:25:27.091687 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee65f20-c881-48a7-bf3e-69edd921c741 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:27.093448 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee65f20-c881-48a7-bf3e-69edd921c741 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:27.108425 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 928/1860] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 9 20:25:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:25:27.112405 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53535f73-fcd0-405b-9a80-50700e58e789 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:27.122484 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53535f73-fcd0-405b-9a80-50700e58e789 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:27.128565 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f9efb4-ddff-41ba-8d73-34f5609d592e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:27.129931 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9efb4-ddff-41ba-8d73-34f5609d592e admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:27.130428 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9efb4-ddff-41ba-8d73-34f5609d592e admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:27.130910 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9efb4-ddff-41ba-8d73-34f5609d592e admin admin] PATH_INFO: `/v3/projects` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:27.131911 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f9efb4-ddff-41ba-8d73-34f5609d592e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:27.134449 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f9efb4-ddff-41ba-8d73-34f5609d592e admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:27.174204 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 933/1861] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:25:27 2022] POST /identity/v3/projects => generated 383 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:25:27.178793 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee65f20-c881-48a7-bf3e-69edd921c741 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:27.195011 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee65f20-c881-48a7-bf3e-69edd921c741 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:27.269280 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d398de-33e6-41ae-a1c7-4084901b7c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:27.270010 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d398de-33e6-41ae-a1c7-4084901b7c0f admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:27.270295 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d398de-33e6-41ae-a1c7-4084901b7c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:27.270610 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d398de-33e6-41ae-a1c7-4084901b7c0f admin admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:27.271349 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d398de-33e6-41ae-a1c7-4084901b7c0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:27.273601 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d398de-33e6-41ae-a1c7-4084901b7c0f admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:27.294826 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 929/1862] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:25:27 2022] POST /identity/v3/users => generated 292 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 20:25:27.298942 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f9efb4-ddff-41ba-8d73-34f5609d592e admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:27.310197 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f9efb4-ddff-41ba-8d73-34f5609d592e admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:27.316078 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222cb12c-6c80-445b-a34e-56d7595262c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:27.316777 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222cb12c-6c80-445b-a34e-56d7595262c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:27.317120 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222cb12c-6c80-445b-a34e-56d7595262c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:27.317436 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222cb12c-6c80-445b-a34e-56d7595262c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:27.318220 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222cb12c-6c80-445b-a34e-56d7595262c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:27.319861 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222cb12c-6c80-445b-a34e-56d7595262c6 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:27.331249 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 934/1863] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:25:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:25:27.335247 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d398de-33e6-41ae-a1c7-4084901b7c0f admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:27.345041 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d398de-33e6-41ae-a1c7-4084901b7c0f admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:27.349559 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2625cc0c-57cd-47f3-97aa-f8a8941d898a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:27.350204 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625cc0c-57cd-47f3-97aa-f8a8941d898a admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:27.350477 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625cc0c-57cd-47f3-97aa-f8a8941d898a admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:27.350743 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625cc0c-57cd-47f3-97aa-f8a8941d898a admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:27.351480 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2625cc0c-57cd-47f3-97aa-f8a8941d898a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:27.353094 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2625cc0c-57cd-47f3-97aa-f8a8941d898a admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:27.362516 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 930/1864] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:25:27 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:25:27.367156 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222cb12c-6c80-445b-a34e-56d7595262c6 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:27.378266 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222cb12c-6c80-445b-a34e-56d7595262c6 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:27.382859 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725c5a03-6ae9-4e6b-8e6e-9b4b8348c2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:27.383770 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725c5a03-6ae9-4e6b-8e6e-9b4b8348c2f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:27.384051 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725c5a03-6ae9-4e6b-8e6e-9b4b8348c2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:27.384325 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725c5a03-6ae9-4e6b-8e6e-9b4b8348c2f8 admin admin] PATH_INFO: `/v3/projects/9f9034c1e45d4251a80f3c63872fd6cf/users/4f6e6f19ec8e4996af9a9fe2e556d24a/roles/79f90a0bf6ea43d0b3c434e31556253a` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:27.400609 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725c5a03-6ae9-4e6b-8e6e-9b4b8348c2f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f9034c1e45d4251a80f3c63872fd6cf, user_id=4f6e6f19ec8e4996af9a9fe2e556d24a, role_id=79f90a0bf6ea43d0b3c434e31556253a)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:27.403341 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725c5a03-6ae9-4e6b-8e6e-9b4b8348c2f8 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:27.415882 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 935/1865] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:25:27 2022] PUT /identity/v3/projects/9f9034c1e45d4251a80f3c63872fd6cf/users/4f6e6f19ec8e4996af9a9fe2e556d24a/roles/79f90a0bf6ea43d0b3c434e31556253a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:25:27.426974 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c50bd77-c2e5-40e9-ac99-a220a389c3fa None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:27.427269 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c50bd77-c2e5-40e9-ac99-a220a389c3fa None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:27.427583 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c50bd77-c2e5-40e9-ac99-a220a389c3fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:27.455730 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-3c50bd77-c2e5-40e9-ac99-a220a389c3fa None None] MFA Rules not processed for user `4f6e6f19ec8e4996af9a9fe2e556d24a`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:25:27.456953 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-3c50bd77-c2e5-40e9-ac99-a220a389c3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:27.521976 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 931/1866] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:25:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:25:27.526320 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725c5a03-6ae9-4e6b-8e6e-9b4b8348c2f8 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:27.590144 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725c5a03-6ae9-4e6b-8e6e-9b4b8348c2f8 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:27.595011 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590400af-77b6-4025-a9e9-28b855095ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:27.595821 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590400af-77b6-4025-a9e9-28b855095ea9 admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:27.596107 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590400af-77b6-4025-a9e9-28b855095ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:27.596465 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590400af-77b6-4025-a9e9-28b855095ea9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:27.597167 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590400af-77b6-4025-a9e9-28b855095ea9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:27.599330 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590400af-77b6-4025-a9e9-28b855095ea9 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:27.625801 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 936/1867] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:25:27 2022] POST /identity/v3/projects => generated 383 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 20:25:27.629780 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c50bd77-c2e5-40e9-ac99-a220a389c3fa None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:27.641417 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c50bd77-c2e5-40e9-ac99-a220a389c3fa None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:27.697483 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808d6baa-7955-432a-b14c-d6bfff96c1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:27.698152 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808d6baa-7955-432a-b14c-d6bfff96c1fc admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:27.698544 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808d6baa-7955-432a-b14c-d6bfff96c1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:27.698820 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808d6baa-7955-432a-b14c-d6bfff96c1fc admin admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:27.699520 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808d6baa-7955-432a-b14c-d6bfff96c1fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:27.701427 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808d6baa-7955-432a-b14c-d6bfff96c1fc admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:27.720676 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 932/1868] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:25:27 2022] POST /identity/v3/users => generated 298 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:25:27.724767 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590400af-77b6-4025-a9e9-28b855095ea9 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:27.736597 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590400af-77b6-4025-a9e9-28b855095ea9 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:27.741260 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddace36-e515-4d02-9287-5a600e4e3b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:27.741919 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddace36-e515-4d02-9287-5a600e4e3b94 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:27.742214 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddace36-e515-4d02-9287-5a600e4e3b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:27.742475 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddace36-e515-4d02-9287-5a600e4e3b94 admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:27.743191 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddace36-e515-4d02-9287-5a600e4e3b94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:27.744805 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddace36-e515-4d02-9287-5a600e4e3b94 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:27.756254 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 937/1869] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:25:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:25:27.760307 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808d6baa-7955-432a-b14c-d6bfff96c1fc admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:27.771522 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808d6baa-7955-432a-b14c-d6bfff96c1fc admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:27.776969 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85721036-35be-4ecb-8657-6a1318a9db3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:27.777898 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85721036-35be-4ecb-8657-6a1318a9db3d admin admin] REQUEST_METHOD: `PUT` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:27.778178 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85721036-35be-4ecb-8657-6a1318a9db3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:27.778447 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85721036-35be-4ecb-8657-6a1318a9db3d admin admin] PATH_INFO: `/v3/projects/173af21ff73d4d47928b347a231468ba/users/deba7f244f0f4313b46608e8c281d5ea/roles/274130b78e304bb88789c1b349263f3c` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:27.796354 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85721036-35be-4ecb-8657-6a1318a9db3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=173af21ff73d4d47928b347a231468ba, user_id=deba7f244f0f4313b46608e8c281d5ea, role_id=274130b78e304bb88789c1b349263f3c)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:27.799019 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85721036-35be-4ecb-8657-6a1318a9db3d admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:27.812727 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 933/1870] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:25:27 2022] PUT /identity/v3/projects/173af21ff73d4d47928b347a231468ba/users/deba7f244f0f4313b46608e8c281d5ea/roles/274130b78e304bb88789c1b349263f3c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:25:27.816657 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddace36-e515-4d02-9287-5a600e4e3b94 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:27.827472 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddace36-e515-4d02-9287-5a600e4e3b94 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:27.885754 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b837d23f-eb8c-4044-9a79-52233c2f2802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:27.886783 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837d23f-eb8c-4044-9a79-52233c2f2802 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:27.890368 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837d23f-eb8c-4044-9a79-52233c2f2802 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:27.890368 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837d23f-eb8c-4044-9a79-52233c2f2802 admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:27.890368 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b837d23f-eb8c-4044-9a79-52233c2f2802 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:27.890368 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b837d23f-eb8c-4044-9a79-52233c2f2802 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:27.904261 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 938/1871] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:25:27 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:25:27.905374 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85721036-35be-4ecb-8657-6a1318a9db3d admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:27.915503 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85721036-35be-4ecb-8657-6a1318a9db3d admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:27.920858 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0640621-cb89-417d-b0a7-78e48ccaf223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:27.921727 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0640621-cb89-417d-b0a7-78e48ccaf223 admin admin] REQUEST_METHOD: `PUT` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:27.922002 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0640621-cb89-417d-b0a7-78e48ccaf223 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:27.922300 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0640621-cb89-417d-b0a7-78e48ccaf223 admin admin] PATH_INFO: `/v3/projects/173af21ff73d4d47928b347a231468ba/users/deba7f244f0f4313b46608e8c281d5ea/roles/274130b78e304bb88789c1b349263f3c` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:27.924275 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0640621-cb89-417d-b0a7-78e48ccaf223 admin admin] RBAC: Authorizing `identity:create_grant(project_id=173af21ff73d4d47928b347a231468ba, user_id=deba7f244f0f4313b46608e8c281d5ea, role_id=274130b78e304bb88789c1b349263f3c)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:27.926962 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0640621-cb89-417d-b0a7-78e48ccaf223 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:27.938036 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 934/1872] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:25:27 2022] PUT /identity/v3/projects/173af21ff73d4d47928b347a231468ba/users/deba7f244f0f4313b46608e8c281d5ea/roles/274130b78e304bb88789c1b349263f3c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:25:27.949320 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9c752-c816-4bd8-9030-cf0bbfb4063a None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:27.949610 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9c752-c816-4bd8-9030-cf0bbfb4063a None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:27.949882 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9c752-c816-4bd8-9030-cf0bbfb4063a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:27.977553 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-05a9c752-c816-4bd8-9030-cf0bbfb4063a None None] MFA Rules not processed for user `deba7f244f0f4313b46608e8c281d5ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:25:27.978885 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-05a9c752-c816-4bd8-9030-cf0bbfb4063a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:28.048721 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 939/1873] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:25:27 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:25:28.059987 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0640621-cb89-417d-b0a7-78e48ccaf223 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:28.061680 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-c0640621-cb89-417d-b0a7-78e48ccaf223 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:28.121965 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0640621-cb89-417d-b0a7-78e48ccaf223 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:28.125671 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d144807a-f7cc-4a60-a595-73799696c451 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d65e731386d44948dcc1ecd40cbda65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:28.126321 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d144807a-f7cc-4a60-a595-73799696c451 service cinder] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:28.126595 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d144807a-f7cc-4a60-a595-73799696c451 service cinder] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:28.126865 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d144807a-f7cc-4a60-a595-73799696c451 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:28.136213 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d144807a-f7cc-4a60-a595-73799696c451 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:28.137940 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d144807a-f7cc-4a60-a595-73799696c451 service cinder] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:28.147587 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 935/1874] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:25:28 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:25:28.239879 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a9c752-c816-4bd8-9030-cf0bbfb4063a None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:28.250228 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a9c752-c816-4bd8-9030-cf0bbfb4063a None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:28.254259 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a8817a-a8c7-4f33-b445-50122a50a8f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d65e731386d44948dcc1ecd40cbda65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:28.254994 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a8817a-a8c7-4f33-b445-50122a50a8f9 service cinder] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:28.255347 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a8817a-a8c7-4f33-b445-50122a50a8f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:28.255715 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a8817a-a8c7-4f33-b445-50122a50a8f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:28.322959 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a8817a-a8c7-4f33-b445-50122a50a8f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:28.324922 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a8817a-a8c7-4f33-b445-50122a50a8f9 service cinder] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:28.337607 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 940/1875] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:25:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:25:28.649295 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d144807a-f7cc-4a60-a595-73799696c451 service cinder] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:28.752714 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d144807a-f7cc-4a60-a595-73799696c451 service cinder] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:28.757755 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5496c7-66d4-45cf-9d27-cd9a22cc38c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:28.758742 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5496c7-66d4-45cf-9d27-cd9a22cc38c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:28.759088 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5496c7-66d4-45cf-9d27-cd9a22cc38c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:28.759486 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5496c7-66d4-45cf-9d27-cd9a22cc38c3 admin admin] PATH_INFO: `/v3/users/4f6e6f19ec8e4996af9a9fe2e556d24a` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:28.760838 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5496c7-66d4-45cf-9d27-cd9a22cc38c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f6e6f19ec8e4996af9a9fe2e556d24a)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:28.763137 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5496c7-66d4-45cf-9d27-cd9a22cc38c3 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:28.815008 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-1b5496c7-66d4-45cf-9d27-cd9a22cc38c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f6e6f19ec8e4996af9a9fe2e556d24a'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:28.821748 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-1b5496c7-66d4-45cf-9d27-cd9a22cc38c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f6e6f19ec8e4996af9a9fe2e556d24a'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:28.829849 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-1b5496c7-66d4-45cf-9d27-cd9a22cc38c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f6e6f19ec8e4996af9a9fe2e556d24a'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:28.830470 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-1b5496c7-66d4-45cf-9d27-cd9a22cc38c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f6e6f19ec8e4996af9a9fe2e556d24a'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:28.831072 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-1b5496c7-66d4-45cf-9d27-cd9a22cc38c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f6e6f19ec8e4996af9a9fe2e556d24a'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:28.849085 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 936/1876] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:25:28 2022] DELETE /identity/v3/users/4f6e6f19ec8e4996af9a9fe2e556d24a => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:25:28.853395 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b20d60-065a-41a9-b5d1-7e76fe6e4463 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:28.853685 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b20d60-065a-41a9-b5d1-7e76fe6e4463 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:28.853963 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b20d60-065a-41a9-b5d1-7e76fe6e4463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:28.875114 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-e7b20d60-065a-41a9-b5d1-7e76fe6e4463 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:25:28.876390 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-e7b20d60-065a-41a9-b5d1-7e76fe6e4463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:28.942599 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 941/1877] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:25:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:25:28.952995 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5496c7-66d4-45cf-9d27-cd9a22cc38c3 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:28.954479 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-1b5496c7-66d4-45cf-9d27-cd9a22cc38c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:29.013949 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5496c7-66d4-45cf-9d27-cd9a22cc38c3 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:29.017622 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d6ed9-3563-4b21-a07c-b389f1d612f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:29.018276 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d6ed9-3563-4b21-a07c-b389f1d612f1 service neutron] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:29.018552 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d6ed9-3563-4b21-a07c-b389f1d612f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:29.018819 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d6ed9-3563-4b21-a07c-b389f1d612f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:29.029409 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827d6ed9-3563-4b21-a07c-b389f1d612f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:29.030856 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827d6ed9-3563-4b21-a07c-b389f1d612f1 service neutron] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:29.040440 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 937/1878] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:25:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:25:29.619506 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b20d60-065a-41a9-b5d1-7e76fe6e4463 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:29.625414 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-e7b20d60-065a-41a9-b5d1-7e76fe6e4463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:29.644247 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b20d60-065a-41a9-b5d1-7e76fe6e4463 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:29.654240 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a036f601-ea58-45f5-92eb-85ea430bc05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:29.655497 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a036f601-ea58-45f5-92eb-85ea430bc05b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:29.656801 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a036f601-ea58-45f5-92eb-85ea430bc05b admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:29.657299 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a036f601-ea58-45f5-92eb-85ea430bc05b admin admin] PATH_INFO: `/v3/projects/9f9034c1e45d4251a80f3c63872fd6cf` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:29.658863 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a036f601-ea58-45f5-92eb-85ea430bc05b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f9034c1e45d4251a80f3c63872fd6cf)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:29.661328 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a036f601-ea58-45f5-92eb-85ea430bc05b admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:29.812815 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-a036f601-ea58-45f5-92eb-85ea430bc05b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f9034c1e45d4251a80f3c63872fd6cf', 'request_id': 'req-a036f601-ea58-45f5-92eb-85ea430bc05b'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:29.819175 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-a036f601-ea58-45f5-92eb-85ea430bc05b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f9034c1e45d4251a80f3c63872fd6cf', 'request_id': 'req-a036f601-ea58-45f5-92eb-85ea430bc05b'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:29.825424 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-a036f601-ea58-45f5-92eb-85ea430bc05b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f9034c1e45d4251a80f3c63872fd6cf', 'request_id': 'req-a036f601-ea58-45f5-92eb-85ea430bc05b'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:29.841658 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-a036f601-ea58-45f5-92eb-85ea430bc05b admin admin] The token cache is being invalidate because project 9f9034c1e45d4251a80f3c63872fd6cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:25:29.841944 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-a036f601-ea58-45f5-92eb-85ea430bc05b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:29.844131 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-a036f601-ea58-45f5-92eb-85ea430bc05b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:29.845713 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 942/1879] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:25:29 2022] DELETE /identity/v3/projects/9f9034c1e45d4251a80f3c63872fd6cf => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:25:29.850475 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d6ed9-3563-4b21-a07c-b389f1d612f1 service neutron] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:29.863929 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d6ed9-3563-4b21-a07c-b389f1d612f1 service neutron] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:29.930395 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb831ac-c829-46b9-bc31-9119ccca490f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:29.931285 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb831ac-c829-46b9-bc31-9119ccca490f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:29.931604 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb831ac-c829-46b9-bc31-9119ccca490f admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:29.931934 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb831ac-c829-46b9-bc31-9119ccca490f admin admin] PATH_INFO: `/v3/users/deba7f244f0f4313b46608e8c281d5ea` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:29.934648 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb831ac-c829-46b9-bc31-9119ccca490f admin admin] RBAC: Authorizing `identity:delete_user(user_id=deba7f244f0f4313b46608e8c281d5ea)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:29.936721 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb831ac-c829-46b9-bc31-9119ccca490f admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:29.986339 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-2fb831ac-c829-46b9-bc31-9119ccca490f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'deba7f244f0f4313b46608e8c281d5ea'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:29.993043 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-2fb831ac-c829-46b9-bc31-9119ccca490f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'deba7f244f0f4313b46608e8c281d5ea'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:30.000904 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-2fb831ac-c829-46b9-bc31-9119ccca490f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'deba7f244f0f4313b46608e8c281d5ea'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:30.001836 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-2fb831ac-c829-46b9-bc31-9119ccca490f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'deba7f244f0f4313b46608e8c281d5ea'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:30.003131 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-2fb831ac-c829-46b9-bc31-9119ccca490f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'deba7f244f0f4313b46608e8c281d5ea'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:30.021313 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 938/1880] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:25:29 2022] DELETE /identity/v3/users/deba7f244f0f4313b46608e8c281d5ea => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:25:30.364379 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a036f601-ea58-45f5-92eb-85ea430bc05b admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:30.366003 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-a036f601-ea58-45f5-92eb-85ea430bc05b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:30.381850 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a036f601-ea58-45f5-92eb-85ea430bc05b admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:30.438093 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691bf14c-48bf-4ebb-93e3-ba7695efaec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:30.438947 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691bf14c-48bf-4ebb-93e3-ba7695efaec8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:30.439226 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691bf14c-48bf-4ebb-93e3-ba7695efaec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:30.439530 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691bf14c-48bf-4ebb-93e3-ba7695efaec8 admin admin] PATH_INFO: `/v3/projects/173af21ff73d4d47928b347a231468ba` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:30.440700 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691bf14c-48bf-4ebb-93e3-ba7695efaec8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=173af21ff73d4d47928b347a231468ba)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:30.442614 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691bf14c-48bf-4ebb-93e3-ba7695efaec8 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:30.486623 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-691bf14c-48bf-4ebb-93e3-ba7695efaec8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '173af21ff73d4d47928b347a231468ba', 'request_id': 'req-691bf14c-48bf-4ebb-93e3-ba7695efaec8'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:30.492643 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-691bf14c-48bf-4ebb-93e3-ba7695efaec8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '173af21ff73d4d47928b347a231468ba', 'request_id': 'req-691bf14c-48bf-4ebb-93e3-ba7695efaec8'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:30.498464 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-691bf14c-48bf-4ebb-93e3-ba7695efaec8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '173af21ff73d4d47928b347a231468ba', 'request_id': 'req-691bf14c-48bf-4ebb-93e3-ba7695efaec8'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:30.510321 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-691bf14c-48bf-4ebb-93e3-ba7695efaec8 admin admin] The token cache is being invalidate because project 173af21ff73d4d47928b347a231468ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:25:30.510605 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-691bf14c-48bf-4ebb-93e3-ba7695efaec8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:30.512058 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-691bf14c-48bf-4ebb-93e3-ba7695efaec8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:30.513726 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 943/1881] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:25:30 2022] DELETE /identity/v3/projects/173af21ff73d4d47928b347a231468ba => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:25:30.519299 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f6dbc-2493-4a7a-9416-17e44105c20f None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:30.521704 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f6dbc-2493-4a7a-9416-17e44105c20f None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:30.522897 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f6dbc-2493-4a7a-9416-17e44105c20f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:30.544729 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-a94f6dbc-2493-4a7a-9416-17e44105c20f None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:25:30.546017 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-a94f6dbc-2493-4a7a-9416-17e44105c20f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:30.608756 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 939/1882] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:25:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:25:30.616607 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c26f73-442b-4d5f-b07d-4de64b516099 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:30.616890 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c26f73-442b-4d5f-b07d-4de64b516099 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:30.617163 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c26f73-442b-4d5f-b07d-4de64b516099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:30.638065 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-37c26f73-442b-4d5f-b07d-4de64b516099 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:25:30.639172 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-37c26f73-442b-4d5f-b07d-4de64b516099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:30.646987 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 944/1883] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:25:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:25:30.651229 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94f6dbc-2493-4a7a-9416-17e44105c20f None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:30.662910 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94f6dbc-2493-4a7a-9416-17e44105c20f None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:30.668446 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507a4985-e3d8-4fab-b5a7-f3d42a79f3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:30.669114 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a4985-e3d8-4fab-b5a7-f3d42a79f3bc admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:30.669393 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a4985-e3d8-4fab-b5a7-f3d42a79f3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:30.669679 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a4985-e3d8-4fab-b5a7-f3d42a79f3bc admin admin] PATH_INFO: `/v3/domains` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:30.670504 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507a4985-e3d8-4fab-b5a7-f3d42a79f3bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:25:30.670834 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507a4985-e3d8-4fab-b5a7-f3d42a79f3bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:30.672477 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507a4985-e3d8-4fab-b5a7-f3d42a79f3bc admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:30.684066 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 940/1884] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 9 20:25:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:25:30.688334 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c26f73-442b-4d5f-b07d-4de64b516099 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:30.697360 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c26f73-442b-4d5f-b07d-4de64b516099 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:30.702444 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b5b33f-fb36-413b-b65f-e007cc66fc2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:30.703082 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b5b33f-fb36-413b-b65f-e007cc66fc2f admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:30.703663 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b5b33f-fb36-413b-b65f-e007cc66fc2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:30.703940 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b5b33f-fb36-413b-b65f-e007cc66fc2f admin admin] PATH_INFO: `/v3/projects` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:30.704621 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b5b33f-fb36-413b-b65f-e007cc66fc2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:30.706496 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b5b33f-fb36-413b-b65f-e007cc66fc2f admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:30.730557 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 945/1885] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:25:30 2022] POST /identity/v3/projects => generated 363 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:25:30.734717 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507a4985-e3d8-4fab-b5a7-f3d42a79f3bc admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:30.744649 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507a4985-e3d8-4fab-b5a7-f3d42a79f3bc admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:30.804268 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2223ba10-6af7-4bbb-bee1-c4235ea98a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:30.804932 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2223ba10-6af7-4bbb-bee1-c4235ea98a89 admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:30.805214 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2223ba10-6af7-4bbb-bee1-c4235ea98a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:30.805481 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2223ba10-6af7-4bbb-bee1-c4235ea98a89 admin admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:30.806177 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2223ba10-6af7-4bbb-bee1-c4235ea98a89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:30.808187 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2223ba10-6af7-4bbb-bee1-c4235ea98a89 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:30.843739 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 941/1886] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:25:30 2022] POST /identity/v3/users => generated 282 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 20:25:30.847746 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b5b33f-fb36-413b-b65f-e007cc66fc2f admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:30.860653 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b5b33f-fb36-413b-b65f-e007cc66fc2f admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:30.866711 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4aacdc-d5fe-49ce-990d-be219eb5b18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:30.867677 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4aacdc-d5fe-49ce-990d-be219eb5b18e admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:30.868169 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4aacdc-d5fe-49ce-990d-be219eb5b18e admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:30.868631 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4aacdc-d5fe-49ce-990d-be219eb5b18e admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:30.869540 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4aacdc-d5fe-49ce-990d-be219eb5b18e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:30.871525 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4aacdc-d5fe-49ce-990d-be219eb5b18e admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:30.897584 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2223ba10-6af7-4bbb-bee1-c4235ea98a89 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:30.898288 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 946/1887] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:25:30 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 09 20:25:30.909656 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2223ba10-6af7-4bbb-bee1-c4235ea98a89 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:30.914982 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1f3afa-3698-4c62-bd0e-2925618a5c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:30.915810 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f3afa-3698-4c62-bd0e-2925618a5c23 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:30.916308 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f3afa-3698-4c62-bd0e-2925618a5c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:30.916833 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f3afa-3698-4c62-bd0e-2925618a5c23 admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:30.918398 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1f3afa-3698-4c62-bd0e-2925618a5c23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:30.920681 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1f3afa-3698-4c62-bd0e-2925618a5c23 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:30.934658 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 942/1888] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:25:30 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 09 20:25:30.938907 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4aacdc-d5fe-49ce-990d-be219eb5b18e admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:30.950223 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4aacdc-d5fe-49ce-990d-be219eb5b18e admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:30.956104 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d1152f-66df-4e2b-bb0f-b3f0e9e62422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:30.957204 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d1152f-66df-4e2b-bb0f-b3f0e9e62422 admin admin] REQUEST_METHOD: `PUT` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:30.957630 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d1152f-66df-4e2b-bb0f-b3f0e9e62422 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:30.958086 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d1152f-66df-4e2b-bb0f-b3f0e9e62422 admin admin] PATH_INFO: `/v3/projects/5336a0aabecd430fb4334fd3a98b0e7c/users/e3a48e36f64847ef9f609733789d3a28/roles/79f90a0bf6ea43d0b3c434e31556253a` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:30.976541 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d1152f-66df-4e2b-bb0f-b3f0e9e62422 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5336a0aabecd430fb4334fd3a98b0e7c, user_id=e3a48e36f64847ef9f609733789d3a28, role_id=79f90a0bf6ea43d0b3c434e31556253a)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:30.980762 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d1152f-66df-4e2b-bb0f-b3f0e9e62422 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:31.000703 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 947/1889] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:25:30 2022] PUT /identity/v3/projects/5336a0aabecd430fb4334fd3a98b0e7c/users/e3a48e36f64847ef9f609733789d3a28/roles/79f90a0bf6ea43d0b3c434e31556253a => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:25:31.011196 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949baaf-a8f9-4c7c-9909-1b204eef1f36 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:31.012056 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949baaf-a8f9-4c7c-9909-1b204eef1f36 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:31.012482 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949baaf-a8f9-4c7c-9909-1b204eef1f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:31.043239 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-5949baaf-a8f9-4c7c-9909-1b204eef1f36 None None] MFA Rules not processed for user `e3a48e36f64847ef9f609733789d3a28`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:25:31.044402 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-5949baaf-a8f9-4c7c-9909-1b204eef1f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:31.112971 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 943/1890] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:25:31 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:25:31.124602 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d1152f-66df-4e2b-bb0f-b3f0e9e62422 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:31.126412 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-67d1152f-66df-4e2b-bb0f-b3f0e9e62422 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:31.183321 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d1152f-66df-4e2b-bb0f-b3f0e9e62422 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:31.187133 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5c8886-efd1-407b-b523-829415bd736d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d65e731386d44948dcc1ecd40cbda65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:31.187822 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c8886-efd1-407b-b523-829415bd736d service cinder] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:31.188105 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c8886-efd1-407b-b523-829415bd736d service cinder] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:31.188381 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c8886-efd1-407b-b523-829415bd736d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:31.197004 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5c8886-efd1-407b-b523-829415bd736d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:31.199008 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5c8886-efd1-407b-b523-829415bd736d service cinder] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:31.207705 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 948/1891] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:25:31 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:25:39.334190 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949baaf-a8f9-4c7c-9909-1b204eef1f36 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:39.335736 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-5949baaf-a8f9-4c7c-9909-1b204eef1f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:39.431285 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949baaf-a8f9-4c7c-9909-1b204eef1f36 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:39.440261 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45c01fc-9113-481e-a5fd-d2c287435078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:39.441586 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c01fc-9113-481e-a5fd-d2c287435078 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:39.441943 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c01fc-9113-481e-a5fd-d2c287435078 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:39.442289 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c01fc-9113-481e-a5fd-d2c287435078 admin admin] PATH_INFO: `/v3/users/60cda2b0c2d847349815e0ba1bf3a1df` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:39.444297 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45c01fc-9113-481e-a5fd-d2c287435078 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60cda2b0c2d847349815e0ba1bf3a1df)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:39.447354 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45c01fc-9113-481e-a5fd-d2c287435078 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:39.518301 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-c45c01fc-9113-481e-a5fd-d2c287435078 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60cda2b0c2d847349815e0ba1bf3a1df'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:39.556931 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-c45c01fc-9113-481e-a5fd-d2c287435078 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60cda2b0c2d847349815e0ba1bf3a1df'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:39.579118 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-c45c01fc-9113-481e-a5fd-d2c287435078 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60cda2b0c2d847349815e0ba1bf3a1df'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:39.580883 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-c45c01fc-9113-481e-a5fd-d2c287435078 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60cda2b0c2d847349815e0ba1bf3a1df'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:39.582258 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-c45c01fc-9113-481e-a5fd-d2c287435078 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60cda2b0c2d847349815e0ba1bf3a1df'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:39.609078 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 944/1892] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:25:39 2022] DELETE /identity/v3/users/60cda2b0c2d847349815e0ba1bf3a1df => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:25:39.613886 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f4818-4a6d-45b4-b2d9-2e2f792237fa None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:39.614408 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f4818-4a6d-45b4-b2d9-2e2f792237fa None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:39.614542 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f4818-4a6d-45b4-b2d9-2e2f792237fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:39.659961 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-a40f4818-4a6d-45b4-b2d9-2e2f792237fa None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:25:39.661503 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-a40f4818-4a6d-45b4-b2d9-2e2f792237fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:39.777348 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 949/1893] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:25:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:25:39.792038 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45c01fc-9113-481e-a5fd-d2c287435078 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:39.793539 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-c45c01fc-9113-481e-a5fd-d2c287435078 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:39.862528 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45c01fc-9113-481e-a5fd-d2c287435078 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:39.868339 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dfb86a-fac8-4f24-b84d-c80c682b4f0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:39.869118 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dfb86a-fac8-4f24-b84d-c80c682b4f0b service neutron] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:39.869371 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dfb86a-fac8-4f24-b84d-c80c682b4f0b service neutron] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:39.869665 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dfb86a-fac8-4f24-b84d-c80c682b4f0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:39.881746 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dfb86a-fac8-4f24-b84d-c80c682b4f0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:39.884332 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dfb86a-fac8-4f24-b84d-c80c682b4f0b service neutron] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:39.897191 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 945/1894] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:25:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:25:41.268988 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40f4818-4a6d-45b4-b2d9-2e2f792237fa None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:41.270524 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-a40f4818-4a6d-45b4-b2d9-2e2f792237fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:41.284089 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40f4818-4a6d-45b4-b2d9-2e2f792237fa None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:41.288633 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5847bb15-1c71-4b56-8634-e55353952cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:41.290066 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5847bb15-1c71-4b56-8634-e55353952cc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:41.290344 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5847bb15-1c71-4b56-8634-e55353952cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:41.290611 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5847bb15-1c71-4b56-8634-e55353952cc8 admin admin] PATH_INFO: `/v3/projects/8c44f4b5b22d407f9f7c3a06f1ecd5b2` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:41.291865 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5847bb15-1c71-4b56-8634-e55353952cc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c44f4b5b22d407f9f7c3a06f1ecd5b2)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:41.293968 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5847bb15-1c71-4b56-8634-e55353952cc8 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:41.393608 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-5847bb15-1c71-4b56-8634-e55353952cc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c44f4b5b22d407f9f7c3a06f1ecd5b2', 'request_id': 'req-5847bb15-1c71-4b56-8634-e55353952cc8'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:41.400308 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-5847bb15-1c71-4b56-8634-e55353952cc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c44f4b5b22d407f9f7c3a06f1ecd5b2', 'request_id': 'req-5847bb15-1c71-4b56-8634-e55353952cc8'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:41.406821 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-5847bb15-1c71-4b56-8634-e55353952cc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c44f4b5b22d407f9f7c3a06f1ecd5b2', 'request_id': 'req-5847bb15-1c71-4b56-8634-e55353952cc8'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:41.421117 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-5847bb15-1c71-4b56-8634-e55353952cc8 admin admin] The token cache is being invalidate because project 8c44f4b5b22d407f9f7c3a06f1ecd5b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:25:41.421410 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-5847bb15-1c71-4b56-8634-e55353952cc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:41.422057 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-5847bb15-1c71-4b56-8634-e55353952cc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:41.424738 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 950/1895] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:25:41 2022] DELETE /identity/v3/projects/8c44f4b5b22d407f9f7c3a06f1ecd5b2 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:25:41.428431 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dfb86a-fac8-4f24-b84d-c80c682b4f0b service neutron] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:41.441671 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dfb86a-fac8-4f24-b84d-c80c682b4f0b service neutron] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:41.512877 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b44cce-1a02-4edb-8373-af8fe3ec21d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:41.513959 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b44cce-1a02-4edb-8373-af8fe3ec21d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:41.514312 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b44cce-1a02-4edb-8373-af8fe3ec21d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:41.514669 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b44cce-1a02-4edb-8373-af8fe3ec21d7 admin admin] PATH_INFO: `/v3/users/a54cd3b291c04896903944bc0cbe3c76` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:41.516914 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b44cce-1a02-4edb-8373-af8fe3ec21d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a54cd3b291c04896903944bc0cbe3c76)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:41.521602 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b44cce-1a02-4edb-8373-af8fe3ec21d7 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:41.603497 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-a1b44cce-1a02-4edb-8373-af8fe3ec21d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a54cd3b291c04896903944bc0cbe3c76'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:41.624053 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-a1b44cce-1a02-4edb-8373-af8fe3ec21d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a54cd3b291c04896903944bc0cbe3c76'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:41.637505 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-a1b44cce-1a02-4edb-8373-af8fe3ec21d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a54cd3b291c04896903944bc0cbe3c76'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:41.638504 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-a1b44cce-1a02-4edb-8373-af8fe3ec21d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a54cd3b291c04896903944bc0cbe3c76'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:41.639934 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-a1b44cce-1a02-4edb-8373-af8fe3ec21d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a54cd3b291c04896903944bc0cbe3c76'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:41.666013 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 946/1896] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:25:41 2022] DELETE /identity/v3/users/a54cd3b291c04896903944bc0cbe3c76 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:25:42.056741 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5847bb15-1c71-4b56-8634-e55353952cc8 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:42.058944 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-5847bb15-1c71-4b56-8634-e55353952cc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:42.083222 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5847bb15-1c71-4b56-8634-e55353952cc8 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:42.314828 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b44615-418b-41ef-965f-24eeeac46e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:42.328987 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b44615-418b-41ef-965f-24eeeac46e5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:42.330905 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b44615-418b-41ef-965f-24eeeac46e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:42.331338 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b44615-418b-41ef-965f-24eeeac46e5f admin admin] PATH_INFO: `/v3/projects/eeb11f3e5b6a44f097cef2c5cbae7b9a` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:42.343490 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b44615-418b-41ef-965f-24eeeac46e5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=eeb11f3e5b6a44f097cef2c5cbae7b9a)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:42.347640 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b44615-418b-41ef-965f-24eeeac46e5f admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:42.451322 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-25b44615-418b-41ef-965f-24eeeac46e5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eeb11f3e5b6a44f097cef2c5cbae7b9a', 'request_id': 'req-25b44615-418b-41ef-965f-24eeeac46e5f'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:42.459064 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-25b44615-418b-41ef-965f-24eeeac46e5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eeb11f3e5b6a44f097cef2c5cbae7b9a', 'request_id': 'req-25b44615-418b-41ef-965f-24eeeac46e5f'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:42.465429 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-25b44615-418b-41ef-965f-24eeeac46e5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eeb11f3e5b6a44f097cef2c5cbae7b9a', 'request_id': 'req-25b44615-418b-41ef-965f-24eeeac46e5f'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:42.488090 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-25b44615-418b-41ef-965f-24eeeac46e5f admin admin] The token cache is being invalidate because project eeb11f3e5b6a44f097cef2c5cbae7b9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:25:42.488205 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-25b44615-418b-41ef-965f-24eeeac46e5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:42.491167 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-25b44615-418b-41ef-965f-24eeeac46e5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:42.497906 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 951/1897] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:25:42 2022] DELETE /identity/v3/projects/eeb11f3e5b6a44f097cef2c5cbae7b9a => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:25:42.503851 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c103cb-e1ce-4e59-bc9a-4439b51e49a7 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:42.504699 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c103cb-e1ce-4e59-bc9a-4439b51e49a7 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:42.505144 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c103cb-e1ce-4e59-bc9a-4439b51e49a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:42.525515 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-a9c103cb-e1ce-4e59-bc9a-4439b51e49a7 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:25:42.527546 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-a9c103cb-e1ce-4e59-bc9a-4439b51e49a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:42.608975 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 947/1898] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:25:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:25:42.625888 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972764db-1248-47f0-a536-24705190080f None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:42.626199 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972764db-1248-47f0-a536-24705190080f None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:42.626473 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972764db-1248-47f0-a536-24705190080f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:42.648205 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-972764db-1248-47f0-a536-24705190080f None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:25:42.649455 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-972764db-1248-47f0-a536-24705190080f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:42.658513 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 952/1899] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:25:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:25:42.662718 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c103cb-e1ce-4e59-bc9a-4439b51e49a7 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:42.673535 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c103cb-e1ce-4e59-bc9a-4439b51e49a7 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:42.678492 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ee8311-2e67-4141-9a5c-05ef5fb801e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:42.679381 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee8311-2e67-4141-9a5c-05ef5fb801e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:42.679689 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee8311-2e67-4141-9a5c-05ef5fb801e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:42.679956 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee8311-2e67-4141-9a5c-05ef5fb801e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:42.680963 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ee8311-2e67-4141-9a5c-05ef5fb801e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:25:42.680963 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ee8311-2e67-4141-9a5c-05ef5fb801e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:42.683363 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ee8311-2e67-4141-9a5c-05ef5fb801e4 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:42.700111 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 948/1900] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 9 20:25:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:25:42.702668 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972764db-1248-47f0-a536-24705190080f None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:42.712608 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972764db-1248-47f0-a536-24705190080f None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:42.719261 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7992506-ff83-4b4a-96c7-0c07ec03d28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:42.719970 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7992506-ff83-4b4a-96c7-0c07ec03d28c admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:42.720252 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7992506-ff83-4b4a-96c7-0c07ec03d28c admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:42.720831 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7992506-ff83-4b4a-96c7-0c07ec03d28c admin admin] PATH_INFO: `/v3/projects` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:42.721546 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7992506-ff83-4b4a-96c7-0c07ec03d28c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:42.723561 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7992506-ff83-4b4a-96c7-0c07ec03d28c admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:42.772749 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 953/1901] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:25:42 2022] POST /identity/v3/projects => generated 387 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:25:42.777570 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ee8311-2e67-4141-9a5c-05ef5fb801e4 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:42.789746 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ee8311-2e67-4141-9a5c-05ef5fb801e4 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:42.869106 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd31aad4-0bb8-4db8-aac9-e5ac429f9879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:42.870800 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd31aad4-0bb8-4db8-aac9-e5ac429f9879 admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:42.871364 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd31aad4-0bb8-4db8-aac9-e5ac429f9879 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:42.871665 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd31aad4-0bb8-4db8-aac9-e5ac429f9879 admin admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:42.872537 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd31aad4-0bb8-4db8-aac9-e5ac429f9879 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:42.874912 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd31aad4-0bb8-4db8-aac9-e5ac429f9879 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:42.921474 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7992506-ff83-4b4a-96c7-0c07ec03d28c admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:42.934327 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 949/1902] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:25:42 2022] POST /identity/v3/users => generated 294 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:25:42.941925 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7992506-ff83-4b4a-96c7-0c07ec03d28c admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:42.954938 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75625b95-2e72-41b9-818c-36ddb20045eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:42.955663 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75625b95-2e72-41b9-818c-36ddb20045eb admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:42.955949 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75625b95-2e72-41b9-818c-36ddb20045eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:42.956221 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75625b95-2e72-41b9-818c-36ddb20045eb admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:42.956956 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75625b95-2e72-41b9-818c-36ddb20045eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:42.966333 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75625b95-2e72-41b9-818c-36ddb20045eb admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:42.983488 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 954/1903] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:25:42 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 09 20:25:42.987167 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd31aad4-0bb8-4db8-aac9-e5ac429f9879 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:43.000426 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd31aad4-0bb8-4db8-aac9-e5ac429f9879 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:43.008433 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebf19db-f696-43ce-a11e-a50036a029a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:43.009383 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf19db-f696-43ce-a11e-a50036a029a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:43.009815 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf19db-f696-43ce-a11e-a50036a029a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:43.010226 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf19db-f696-43ce-a11e-a50036a029a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:43.012905 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebf19db-f696-43ce-a11e-a50036a029a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:43.015014 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebf19db-f696-43ce-a11e-a50036a029a9 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:43.039694 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 950/1904] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:25:42 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 09 20:25:43.041333 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75625b95-2e72-41b9-818c-36ddb20045eb admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:43.060286 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75625b95-2e72-41b9-818c-36ddb20045eb admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:43.077491 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed483866-eaa9-4710-9109-d62e43e1ffd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:43.078507 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed483866-eaa9-4710-9109-d62e43e1ffd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:43.078867 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed483866-eaa9-4710-9109-d62e43e1ffd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:43.079248 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed483866-eaa9-4710-9109-d62e43e1ffd0 admin admin] PATH_INFO: `/v3/projects/03ca8a92554d4a7f8993fefc9916ae1b/users/7d40b109b82f4d2c9abb9239a60af2f7/roles/79f90a0bf6ea43d0b3c434e31556253a` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:43.114202 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed483866-eaa9-4710-9109-d62e43e1ffd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03ca8a92554d4a7f8993fefc9916ae1b, user_id=7d40b109b82f4d2c9abb9239a60af2f7, role_id=79f90a0bf6ea43d0b3c434e31556253a)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:43.116883 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed483866-eaa9-4710-9109-d62e43e1ffd0 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:43.141276 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 955/1905] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:25:43 2022] PUT /identity/v3/projects/03ca8a92554d4a7f8993fefc9916ae1b/users/7d40b109b82f4d2c9abb9239a60af2f7/roles/79f90a0bf6ea43d0b3c434e31556253a => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:25:43.152038 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3459004f-0605-4360-aca3-3a407467c284 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:43.152540 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3459004f-0605-4360-aca3-3a407467c284 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:43.152818 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3459004f-0605-4360-aca3-3a407467c284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:43.181770 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-3459004f-0605-4360-aca3-3a407467c284 None None] MFA Rules not processed for user `7d40b109b82f4d2c9abb9239a60af2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:25:43.183463 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-3459004f-0605-4360-aca3-3a407467c284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:43.252321 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 951/1906] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:25:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:25:43.256815 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed483866-eaa9-4710-9109-d62e43e1ffd0 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:43.321493 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed483866-eaa9-4710-9109-d62e43e1ffd0 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:43.327743 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a748be19-b02a-41c7-80dc-2893342c013c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:43.328419 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a748be19-b02a-41c7-80dc-2893342c013c admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:43.329043 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a748be19-b02a-41c7-80dc-2893342c013c admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:43.329327 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a748be19-b02a-41c7-80dc-2893342c013c admin admin] PATH_INFO: `/v3/projects` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:43.330056 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a748be19-b02a-41c7-80dc-2893342c013c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:43.332010 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a748be19-b02a-41c7-80dc-2893342c013c admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:43.359431 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 956/1907] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:25:43 2022] POST /identity/v3/projects => generated 387 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:25:43.363085 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3459004f-0605-4360-aca3-3a407467c284 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:43.374613 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3459004f-0605-4360-aca3-3a407467c284 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:43.433040 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff65976-a944-41a6-8797-0febba3247aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:43.434078 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff65976-a944-41a6-8797-0febba3247aa admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:43.434384 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff65976-a944-41a6-8797-0febba3247aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:43.434657 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff65976-a944-41a6-8797-0febba3247aa admin admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:43.435371 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff65976-a944-41a6-8797-0febba3247aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:43.437572 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff65976-a944-41a6-8797-0febba3247aa admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:43.466844 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 952/1908] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:25:43 2022] POST /identity/v3/users => generated 300 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:25:43.466977 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a748be19-b02a-41c7-80dc-2893342c013c admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:43.476793 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a748be19-b02a-41c7-80dc-2893342c013c admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:43.482580 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e56227-ae0a-4f0c-bfde-75525c4b9358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:43.483249 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e56227-ae0a-4f0c-bfde-75525c4b9358 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:43.483629 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e56227-ae0a-4f0c-bfde-75525c4b9358 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:43.485087 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e56227-ae0a-4f0c-bfde-75525c4b9358 admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:43.486007 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e56227-ae0a-4f0c-bfde-75525c4b9358 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:43.488128 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e56227-ae0a-4f0c-bfde-75525c4b9358 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:43.504591 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 957/1909] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:25:43 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 09 20:25:43.505804 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff65976-a944-41a6-8797-0febba3247aa admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:43.522523 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff65976-a944-41a6-8797-0febba3247aa admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:43.539687 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0154229d-b7ae-4464-8894-1eb4c2bbbe4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:43.540708 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0154229d-b7ae-4464-8894-1eb4c2bbbe4d admin admin] REQUEST_METHOD: `PUT` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:43.541053 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0154229d-b7ae-4464-8894-1eb4c2bbbe4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:43.541382 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0154229d-b7ae-4464-8894-1eb4c2bbbe4d admin admin] PATH_INFO: `/v3/projects/411bbd83ea3e4e4b83bda4853cb9bac3/users/53a99327c89b4627a9160467754a1236/roles/274130b78e304bb88789c1b349263f3c` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:43.570168 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0154229d-b7ae-4464-8894-1eb4c2bbbe4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=411bbd83ea3e4e4b83bda4853cb9bac3, user_id=53a99327c89b4627a9160467754a1236, role_id=274130b78e304bb88789c1b349263f3c)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:43.573807 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0154229d-b7ae-4464-8894-1eb4c2bbbe4d admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:43.591200 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 953/1910] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:25:43 2022] PUT /identity/v3/projects/411bbd83ea3e4e4b83bda4853cb9bac3/users/53a99327c89b4627a9160467754a1236/roles/274130b78e304bb88789c1b349263f3c => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:25:43.595330 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e56227-ae0a-4f0c-bfde-75525c4b9358 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:43.605674 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e56227-ae0a-4f0c-bfde-75525c4b9358 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:43.680188 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e551bf3-9523-483d-8bc7-50a305864ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:43.685211 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e551bf3-9523-483d-8bc7-50a305864ba9 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:43.685423 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e551bf3-9523-483d-8bc7-50a305864ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:43.685703 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e551bf3-9523-483d-8bc7-50a305864ba9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:43.686458 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e551bf3-9523-483d-8bc7-50a305864ba9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:43.688149 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e551bf3-9523-483d-8bc7-50a305864ba9 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:43.705720 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0154229d-b7ae-4464-8894-1eb4c2bbbe4d admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:43.712530 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 958/1911] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:25:43 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:25:43.717240 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0154229d-b7ae-4464-8894-1eb4c2bbbe4d admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:43.722114 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c65ef9-59ab-4c45-a206-ad76c1bb38c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:43.723027 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c65ef9-59ab-4c45-a206-ad76c1bb38c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:43.723299 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c65ef9-59ab-4c45-a206-ad76c1bb38c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:43.723628 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c65ef9-59ab-4c45-a206-ad76c1bb38c7 admin admin] PATH_INFO: `/v3/projects/411bbd83ea3e4e4b83bda4853cb9bac3/users/53a99327c89b4627a9160467754a1236/roles/274130b78e304bb88789c1b349263f3c` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:43.725851 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c65ef9-59ab-4c45-a206-ad76c1bb38c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=411bbd83ea3e4e4b83bda4853cb9bac3, user_id=53a99327c89b4627a9160467754a1236, role_id=274130b78e304bb88789c1b349263f3c)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:43.728642 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c65ef9-59ab-4c45-a206-ad76c1bb38c7 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:43.740555 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 954/1912] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:25:43 2022] PUT /identity/v3/projects/411bbd83ea3e4e4b83bda4853cb9bac3/users/53a99327c89b4627a9160467754a1236/roles/274130b78e304bb88789c1b349263f3c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:25:43.752936 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd291b-6760-4152-8e07-9d1c026e5cc6 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:43.753642 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd291b-6760-4152-8e07-9d1c026e5cc6 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:43.754417 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd291b-6760-4152-8e07-9d1c026e5cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:43.827265 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-94fd291b-6760-4152-8e07-9d1c026e5cc6 None None] MFA Rules not processed for user `53a99327c89b4627a9160467754a1236`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:25:43.828945 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-94fd291b-6760-4152-8e07-9d1c026e5cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:43.919006 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 959/1913] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:25:43 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:25:43.931545 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c65ef9-59ab-4c45-a206-ad76c1bb38c7 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:43.933847 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-41c65ef9-59ab-4c45-a206-ad76c1bb38c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:44.011835 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c65ef9-59ab-4c45-a206-ad76c1bb38c7 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:44.017228 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58859549-15f7-41d7-97c0-c940554bf4c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d65e731386d44948dcc1ecd40cbda65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:44.018073 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58859549-15f7-41d7-97c0-c940554bf4c0 service cinder] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:44.018428 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58859549-15f7-41d7-97c0-c940554bf4c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:44.019273 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58859549-15f7-41d7-97c0-c940554bf4c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:44.032416 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58859549-15f7-41d7-97c0-c940554bf4c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:44.034040 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58859549-15f7-41d7-97c0-c940554bf4c0 service cinder] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:44.049544 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 955/1914] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:25:43 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:25:44.140512 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fd291b-6760-4152-8e07-9d1c026e5cc6 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:44.220134 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fd291b-6760-4152-8e07-9d1c026e5cc6 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:44.224778 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1deae7-0c17-406f-9beb-bd115008093e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:44.225639 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1deae7-0c17-406f-9beb-bd115008093e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:44.225921 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1deae7-0c17-406f-9beb-bd115008093e admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:44.226195 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1deae7-0c17-406f-9beb-bd115008093e admin admin] PATH_INFO: `/v3/users/7d40b109b82f4d2c9abb9239a60af2f7` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:44.227379 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1deae7-0c17-406f-9beb-bd115008093e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d40b109b82f4d2c9abb9239a60af2f7)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:44.234958 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1deae7-0c17-406f-9beb-bd115008093e admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:44.330373 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-9a1deae7-0c17-406f-9beb-bd115008093e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d40b109b82f4d2c9abb9239a60af2f7'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:44.331877 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-9a1deae7-0c17-406f-9beb-bd115008093e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d40b109b82f4d2c9abb9239a60af2f7'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:44.340921 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-9a1deae7-0c17-406f-9beb-bd115008093e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d40b109b82f4d2c9abb9239a60af2f7'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:44.341697 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-9a1deae7-0c17-406f-9beb-bd115008093e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d40b109b82f4d2c9abb9239a60af2f7'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:44.351290 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-9a1deae7-0c17-406f-9beb-bd115008093e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d40b109b82f4d2c9abb9239a60af2f7'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:44.377730 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 960/1915] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:25:44 2022] DELETE /identity/v3/users/7d40b109b82f4d2c9abb9239a60af2f7 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:25:44.380087 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2be3b1-e5f3-4230-8aa8-2096d934fe05 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:44.380370 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2be3b1-e5f3-4230-8aa8-2096d934fe05 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:44.380640 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2be3b1-e5f3-4230-8aa8-2096d934fe05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:44.408273 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-ee2be3b1-e5f3-4230-8aa8-2096d934fe05 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:25:44.409486 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-ee2be3b1-e5f3-4230-8aa8-2096d934fe05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:44.495622 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 956/1916] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:25:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:25:44.505023 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1deae7-0c17-406f-9beb-bd115008093e admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:44.506509 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-9a1deae7-0c17-406f-9beb-bd115008093e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:44.587337 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1deae7-0c17-406f-9beb-bd115008093e admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:44.591539 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5190eca7-ba0d-4023-8ee0-453cbcf61588 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:44.592192 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5190eca7-ba0d-4023-8ee0-453cbcf61588 service neutron] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:44.592476 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5190eca7-ba0d-4023-8ee0-453cbcf61588 service neutron] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:44.592751 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5190eca7-ba0d-4023-8ee0-453cbcf61588 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:44.603227 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5190eca7-ba0d-4023-8ee0-453cbcf61588 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:44.604749 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5190eca7-ba0d-4023-8ee0-453cbcf61588 service neutron] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:44.653953 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 961/1917] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:25:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:25:44.985262 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2be3b1-e5f3-4230-8aa8-2096d934fe05 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:44.986945 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-ee2be3b1-e5f3-4230-8aa8-2096d934fe05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:45.000481 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2be3b1-e5f3-4230-8aa8-2096d934fe05 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:45.005578 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e6036-81f6-4bb6-b9d9-e66f5dc9facd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:45.006599 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e6036-81f6-4bb6-b9d9-e66f5dc9facd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:45.006905 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e6036-81f6-4bb6-b9d9-e66f5dc9facd admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:45.007177 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e6036-81f6-4bb6-b9d9-e66f5dc9facd admin admin] PATH_INFO: `/v3/projects/03ca8a92554d4a7f8993fefc9916ae1b` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:45.008655 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714e6036-81f6-4bb6-b9d9-e66f5dc9facd admin admin] RBAC: Authorizing `identity:delete_project(project_id=03ca8a92554d4a7f8993fefc9916ae1b)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:45.010995 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714e6036-81f6-4bb6-b9d9-e66f5dc9facd admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:45.070328 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-714e6036-81f6-4bb6-b9d9-e66f5dc9facd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03ca8a92554d4a7f8993fefc9916ae1b', 'request_id': 'req-714e6036-81f6-4bb6-b9d9-e66f5dc9facd'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:45.077899 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-714e6036-81f6-4bb6-b9d9-e66f5dc9facd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03ca8a92554d4a7f8993fefc9916ae1b', 'request_id': 'req-714e6036-81f6-4bb6-b9d9-e66f5dc9facd'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:45.083531 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-714e6036-81f6-4bb6-b9d9-e66f5dc9facd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03ca8a92554d4a7f8993fefc9916ae1b', 'request_id': 'req-714e6036-81f6-4bb6-b9d9-e66f5dc9facd'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:45.096558 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-714e6036-81f6-4bb6-b9d9-e66f5dc9facd admin admin] The token cache is being invalidate because project 03ca8a92554d4a7f8993fefc9916ae1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:25:45.096840 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-714e6036-81f6-4bb6-b9d9-e66f5dc9facd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:45.097475 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-714e6036-81f6-4bb6-b9d9-e66f5dc9facd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:45.099096 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 957/1918] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:25:44 2022] DELETE /identity/v3/projects/03ca8a92554d4a7f8993fefc9916ae1b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:25:45.103118 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5190eca7-ba0d-4023-8ee0-453cbcf61588 service neutron] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:45.113337 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5190eca7-ba0d-4023-8ee0-453cbcf61588 service neutron] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:45.172628 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb7d8e-c6ed-4969-993e-bbee7f650a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:45.173496 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb7d8e-c6ed-4969-993e-bbee7f650a41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:45.173779 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb7d8e-c6ed-4969-993e-bbee7f650a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:45.174056 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb7d8e-c6ed-4969-993e-bbee7f650a41 admin admin] PATH_INFO: `/v3/users/53a99327c89b4627a9160467754a1236` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:45.175280 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb7d8e-c6ed-4969-993e-bbee7f650a41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53a99327c89b4627a9160467754a1236)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:45.177449 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb7d8e-c6ed-4969-993e-bbee7f650a41 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:45.222889 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-8cbb7d8e-c6ed-4969-993e-bbee7f650a41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53a99327c89b4627a9160467754a1236'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:45.223714 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-8cbb7d8e-c6ed-4969-993e-bbee7f650a41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53a99327c89b4627a9160467754a1236'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:45.231322 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-8cbb7d8e-c6ed-4969-993e-bbee7f650a41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53a99327c89b4627a9160467754a1236'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:45.232078 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-8cbb7d8e-c6ed-4969-993e-bbee7f650a41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53a99327c89b4627a9160467754a1236'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:45.239959 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-8cbb7d8e-c6ed-4969-993e-bbee7f650a41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53a99327c89b4627a9160467754a1236'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:45.257763 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 962/1919] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:25:45 2022] DELETE /identity/v3/users/53a99327c89b4627a9160467754a1236 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:25:45.538858 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e6036-81f6-4bb6-b9d9-e66f5dc9facd admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:45.541023 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-714e6036-81f6-4bb6-b9d9-e66f5dc9facd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:45.554992 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e6036-81f6-4bb6-b9d9-e66f5dc9facd admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:45.634184 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f364c1a-3712-4523-8822-516f096c5b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:45.636929 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f364c1a-3712-4523-8822-516f096c5b5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:45.637211 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f364c1a-3712-4523-8822-516f096c5b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:45.637483 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f364c1a-3712-4523-8822-516f096c5b5d admin admin] PATH_INFO: `/v3/projects/411bbd83ea3e4e4b83bda4853cb9bac3` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:45.638749 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f364c1a-3712-4523-8822-516f096c5b5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=411bbd83ea3e4e4b83bda4853cb9bac3)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:45.641316 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f364c1a-3712-4523-8822-516f096c5b5d admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:45.692579 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-9f364c1a-3712-4523-8822-516f096c5b5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '411bbd83ea3e4e4b83bda4853cb9bac3', 'request_id': 'req-9f364c1a-3712-4523-8822-516f096c5b5d'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:45.699421 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-9f364c1a-3712-4523-8822-516f096c5b5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '411bbd83ea3e4e4b83bda4853cb9bac3', 'request_id': 'req-9f364c1a-3712-4523-8822-516f096c5b5d'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:45.704762 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-9f364c1a-3712-4523-8822-516f096c5b5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '411bbd83ea3e4e4b83bda4853cb9bac3', 'request_id': 'req-9f364c1a-3712-4523-8822-516f096c5b5d'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:45.718090 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-9f364c1a-3712-4523-8822-516f096c5b5d admin admin] The token cache is being invalidate because project 411bbd83ea3e4e4b83bda4853cb9bac3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:25:45.718375 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-9f364c1a-3712-4523-8822-516f096c5b5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:45.718995 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-9f364c1a-3712-4523-8822-516f096c5b5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:45.720868 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 958/1920] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:25:45 2022] DELETE /identity/v3/projects/411bbd83ea3e4e4b83bda4853cb9bac3 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:25:45.726355 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8491d1a2-9285-4b30-95a4-ae9ce4609c7a None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:45.726849 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8491d1a2-9285-4b30-95a4-ae9ce4609c7a None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:45.727088 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8491d1a2-9285-4b30-95a4-ae9ce4609c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:45.745586 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-8491d1a2-9285-4b30-95a4-ae9ce4609c7a None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:25:45.746841 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-8491d1a2-9285-4b30-95a4-ae9ce4609c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:45.808667 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 963/1921] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:25:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:25:45.816521 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f6bc28-d8cd-42fd-92a9-97a63f87717f None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:45.816903 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f6bc28-d8cd-42fd-92a9-97a63f87717f None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:45.817248 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f6bc28-d8cd-42fd-92a9-97a63f87717f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:45.839273 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-31f6bc28-d8cd-42fd-92a9-97a63f87717f None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:25:45.840525 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-31f6bc28-d8cd-42fd-92a9-97a63f87717f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:45.852649 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 959/1922] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:25:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:25:45.853849 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8491d1a2-9285-4b30-95a4-ae9ce4609c7a None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:45.864426 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8491d1a2-9285-4b30-95a4-ae9ce4609c7a None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:45.869111 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39bb2c2-a568-4452-afe8-c5e448b6be79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:45.871459 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39bb2c2-a568-4452-afe8-c5e448b6be79 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:45.872164 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39bb2c2-a568-4452-afe8-c5e448b6be79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:45.872439 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39bb2c2-a568-4452-afe8-c5e448b6be79 admin admin] PATH_INFO: `/v3/domains` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:45.873207 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39bb2c2-a568-4452-afe8-c5e448b6be79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:25:45.873515 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39bb2c2-a568-4452-afe8-c5e448b6be79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:45.875128 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39bb2c2-a568-4452-afe8-c5e448b6be79 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:45.890263 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 964/1923] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 9 20:25:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:25:45.895237 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f6bc28-d8cd-42fd-92a9-97a63f87717f None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:45.906449 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f6bc28-d8cd-42fd-92a9-97a63f87717f None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:45.911128 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3242588-af00-42d5-9a17-c852e7c74c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:45.911837 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3242588-af00-42d5-9a17-c852e7c74c0a admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:45.912113 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3242588-af00-42d5-9a17-c852e7c74c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:45.912381 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3242588-af00-42d5-9a17-c852e7c74c0a admin admin] PATH_INFO: `/v3/projects` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:45.913063 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3242588-af00-42d5-9a17-c852e7c74c0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:45.915012 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3242588-af00-42d5-9a17-c852e7c74c0a admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:45.947333 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 960/1924] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:25:45 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:25:45.950417 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39bb2c2-a568-4452-afe8-c5e448b6be79 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:45.961302 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39bb2c2-a568-4452-afe8-c5e448b6be79 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:46.021380 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431ae667-370b-4768-b150-afea7d86297f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:46.022312 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ae667-370b-4768-b150-afea7d86297f admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:46.022312 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ae667-370b-4768-b150-afea7d86297f admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:46.022577 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ae667-370b-4768-b150-afea7d86297f admin admin] PATH_INFO: `/v3/users` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:46.023264 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431ae667-370b-4768-b150-afea7d86297f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:46.025257 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431ae667-370b-4768-b150-afea7d86297f admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:46.049210 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 965/1925] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:25:45 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:25:46.050148 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3242588-af00-42d5-9a17-c852e7c74c0a admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:46.061475 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3242588-af00-42d5-9a17-c852e7c74c0a admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:46.066209 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f24cdc-d2a6-435a-95ae-051126e61b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:46.066868 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f24cdc-d2a6-435a-95ae-051126e61b85 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:46.067145 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f24cdc-d2a6-435a-95ae-051126e61b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:46.067443 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f24cdc-d2a6-435a-95ae-051126e61b85 admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:46.068166 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f24cdc-d2a6-435a-95ae-051126e61b85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:46.070102 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f24cdc-d2a6-435a-95ae-051126e61b85 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:46.081236 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 961/1926] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:25:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 09 20:25:46.085340 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431ae667-370b-4768-b150-afea7d86297f admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:46.095748 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431ae667-370b-4768-b150-afea7d86297f admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:46.100368 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1a9b37-a97d-47b6-8dbc-b812acb7ccbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:46.101021 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a9b37-a97d-47b6-8dbc-b812acb7ccbc admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:46.101303 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a9b37-a97d-47b6-8dbc-b812acb7ccbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:46.101577 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a9b37-a97d-47b6-8dbc-b812acb7ccbc admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:46.102329 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1a9b37-a97d-47b6-8dbc-b812acb7ccbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:46.104416 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1a9b37-a97d-47b6-8dbc-b812acb7ccbc admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:46.114950 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 966/1927] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:25:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:25:46.119475 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f24cdc-d2a6-435a-95ae-051126e61b85 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:46.129943 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f24cdc-d2a6-435a-95ae-051126e61b85 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:46.135508 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616fc560-3645-4ae4-be5e-b06585e9caa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:46.136384 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616fc560-3645-4ae4-be5e-b06585e9caa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:46.136948 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616fc560-3645-4ae4-be5e-b06585e9caa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:46.137220 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616fc560-3645-4ae4-be5e-b06585e9caa4 admin admin] PATH_INFO: `/v3/projects/4ee94ba81997489b86db2c0f88aa7dfd/users/ed14ff3168524d1f896cd45d195c3ce0/roles/79f90a0bf6ea43d0b3c434e31556253a` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:46.152812 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616fc560-3645-4ae4-be5e-b06585e9caa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ee94ba81997489b86db2c0f88aa7dfd, user_id=ed14ff3168524d1f896cd45d195c3ce0, role_id=79f90a0bf6ea43d0b3c434e31556253a)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:46.155525 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616fc560-3645-4ae4-be5e-b06585e9caa4 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:46.169438 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 962/1928] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:25:46 2022] PUT /identity/v3/projects/4ee94ba81997489b86db2c0f88aa7dfd/users/ed14ff3168524d1f896cd45d195c3ce0/roles/79f90a0bf6ea43d0b3c434e31556253a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:25:46.180058 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85783e36-0514-471b-9661-fe1a58c45481 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:46.180348 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85783e36-0514-471b-9661-fe1a58c45481 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:46.180624 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85783e36-0514-471b-9661-fe1a58c45481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:46.206761 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-85783e36-0514-471b-9661-fe1a58c45481 None None] MFA Rules not processed for user `ed14ff3168524d1f896cd45d195c3ce0`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:25:46.208095 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-85783e36-0514-471b-9661-fe1a58c45481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:46.272553 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 967/1929] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:25:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:25:46.277002 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616fc560-3645-4ae4-be5e-b06585e9caa4 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:46.336441 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616fc560-3645-4ae4-be5e-b06585e9caa4 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:46.341315 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9929723-c40b-4373-8be5-5204437d5e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:46.341964 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9929723-c40b-4373-8be5-5204437d5e6c admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:46.342244 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9929723-c40b-4373-8be5-5204437d5e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:46.342512 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9929723-c40b-4373-8be5-5204437d5e6c admin admin] PATH_INFO: `/v3/projects` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:46.343204 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9929723-c40b-4373-8be5-5204437d5e6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:46.345140 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9929723-c40b-4373-8be5-5204437d5e6c admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:46.370829 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 963/1930] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:25:46 2022] POST /identity/v3/projects => generated 383 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:25:46.374987 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85783e36-0514-471b-9661-fe1a58c45481 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:46.386354 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85783e36-0514-471b-9661-fe1a58c45481 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:46.444893 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb03728c-ad39-4b9a-a692-d66acbc11365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:46.445558 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03728c-ad39-4b9a-a692-d66acbc11365 admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:46.445863 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03728c-ad39-4b9a-a692-d66acbc11365 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:46.446132 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03728c-ad39-4b9a-a692-d66acbc11365 admin admin] PATH_INFO: `/v3/users` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:46.446821 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb03728c-ad39-4b9a-a692-d66acbc11365 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:46.449305 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb03728c-ad39-4b9a-a692-d66acbc11365 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:46.468892 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 968/1931] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:25:46 2022] POST /identity/v3/users => generated 298 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 20:25:46.472922 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9929723-c40b-4373-8be5-5204437d5e6c admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:46.483709 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9929723-c40b-4373-8be5-5204437d5e6c admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:46.488275 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac506e3-bc2f-41d9-823f-ef6b6cf3f139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:46.488925 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac506e3-bc2f-41d9-823f-ef6b6cf3f139 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:46.489201 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac506e3-bc2f-41d9-823f-ef6b6cf3f139 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:46.489468 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac506e3-bc2f-41d9-823f-ef6b6cf3f139 admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:46.490232 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac506e3-bc2f-41d9-823f-ef6b6cf3f139 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:46.491877 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac506e3-bc2f-41d9-823f-ef6b6cf3f139 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:46.506705 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 964/1932] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:25:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 09 20:25:46.508626 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb03728c-ad39-4b9a-a692-d66acbc11365 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:46.520967 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb03728c-ad39-4b9a-a692-d66acbc11365 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:46.525884 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd10cac6-8f8a-4e34-9cfc-36871957ce6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:46.527620 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10cac6-8f8a-4e34-9cfc-36871957ce6c admin admin] REQUEST_METHOD: `PUT` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:46.527976 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10cac6-8f8a-4e34-9cfc-36871957ce6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:46.528486 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10cac6-8f8a-4e34-9cfc-36871957ce6c admin admin] PATH_INFO: `/v3/projects/917e1e825ab74cea9aacf9cdc0350bf9/users/7d37e95d285d4c1d87ab3a4cf075acae/roles/274130b78e304bb88789c1b349263f3c` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:46.551855 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd10cac6-8f8a-4e34-9cfc-36871957ce6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=917e1e825ab74cea9aacf9cdc0350bf9, user_id=7d37e95d285d4c1d87ab3a4cf075acae, role_id=274130b78e304bb88789c1b349263f3c)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:46.554607 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd10cac6-8f8a-4e34-9cfc-36871957ce6c admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:46.568813 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 969/1933] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:25:46 2022] PUT /identity/v3/projects/917e1e825ab74cea9aacf9cdc0350bf9/users/7d37e95d285d4c1d87ab3a4cf075acae/roles/274130b78e304bb88789c1b349263f3c => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:25:46.572811 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac506e3-bc2f-41d9-823f-ef6b6cf3f139 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:46.583498 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac506e3-bc2f-41d9-823f-ef6b6cf3f139 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:46.649798 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c780cb0-cb99-48d3-b642-9cca481f247d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:46.650468 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c780cb0-cb99-48d3-b642-9cca481f247d admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:46.651275 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c780cb0-cb99-48d3-b642-9cca481f247d admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:46.651573 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c780cb0-cb99-48d3-b642-9cca481f247d admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:46.652350 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c780cb0-cb99-48d3-b642-9cca481f247d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:46.653988 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c780cb0-cb99-48d3-b642-9cca481f247d admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:46.667439 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 965/1934] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:25:46 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:25:46.668967 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd10cac6-8f8a-4e34-9cfc-36871957ce6c admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:46.680815 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd10cac6-8f8a-4e34-9cfc-36871957ce6c admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:46.685767 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac1b6f-db6c-4583-909f-b2d02b13b427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:46.686663 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac1b6f-db6c-4583-909f-b2d02b13b427 admin admin] REQUEST_METHOD: `PUT` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:46.686945 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac1b6f-db6c-4583-909f-b2d02b13b427 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:46.687224 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac1b6f-db6c-4583-909f-b2d02b13b427 admin admin] PATH_INFO: `/v3/projects/917e1e825ab74cea9aacf9cdc0350bf9/users/7d37e95d285d4c1d87ab3a4cf075acae/roles/274130b78e304bb88789c1b349263f3c` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:46.689626 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abac1b6f-db6c-4583-909f-b2d02b13b427 admin admin] RBAC: Authorizing `identity:create_grant(project_id=917e1e825ab74cea9aacf9cdc0350bf9, user_id=7d37e95d285d4c1d87ab3a4cf075acae, role_id=274130b78e304bb88789c1b349263f3c)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:46.692338 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abac1b6f-db6c-4583-909f-b2d02b13b427 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:46.703965 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 970/1935] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:25:46 2022] PUT /identity/v3/projects/917e1e825ab74cea9aacf9cdc0350bf9/users/7d37e95d285d4c1d87ab3a4cf075acae/roles/274130b78e304bb88789c1b349263f3c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:25:46.716136 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe11c5-9471-4715-a8fe-050da5568456 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:46.716608 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe11c5-9471-4715-a8fe-050da5568456 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:46.717120 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe11c5-9471-4715-a8fe-050da5568456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:46.746936 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-99fe11c5-9471-4715-a8fe-050da5568456 None None] MFA Rules not processed for user `7d37e95d285d4c1d87ab3a4cf075acae`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:25:46.748197 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-99fe11c5-9471-4715-a8fe-050da5568456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:46.833061 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 966/1936] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:25:46 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:25:46.844793 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac1b6f-db6c-4583-909f-b2d02b13b427 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:46.847239 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-abac1b6f-db6c-4583-909f-b2d02b13b427 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:46.919662 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac1b6f-db6c-4583-909f-b2d02b13b427 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:46.923383 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980ce7d3-00f6-4c15-bead-c0e9362662a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d65e731386d44948dcc1ecd40cbda65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:46.924067 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ce7d3-00f6-4c15-bead-c0e9362662a8 service cinder] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:46.924348 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ce7d3-00f6-4c15-bead-c0e9362662a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:46.924621 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ce7d3-00f6-4c15-bead-c0e9362662a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:46.934724 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980ce7d3-00f6-4c15-bead-c0e9362662a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:46.936174 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980ce7d3-00f6-4c15-bead-c0e9362662a8 service cinder] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:46.946106 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 971/1937] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:25:46 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:25:47.060630 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe11c5-9471-4715-a8fe-050da5568456 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:47.070499 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe11c5-9471-4715-a8fe-050da5568456 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:47.074509 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0e9a2d-d9b6-413c-83e6-f313de321170 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d65e731386d44948dcc1ecd40cbda65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:47.075228 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e9a2d-d9b6-413c-83e6-f313de321170 service cinder] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:47.075634 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e9a2d-d9b6-413c-83e6-f313de321170 service cinder] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:47.075973 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e9a2d-d9b6-413c-83e6-f313de321170 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:47.131655 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0e9a2d-d9b6-413c-83e6-f313de321170 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:47.133088 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0e9a2d-d9b6-413c-83e6-f313de321170 service cinder] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:47.142388 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 967/1938] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:25:47 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:25:52.888368 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980ce7d3-00f6-4c15-bead-c0e9362662a8 service cinder] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:52.946631 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980ce7d3-00f6-4c15-bead-c0e9362662a8 service cinder] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:52.951999 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2cf870-acfe-4b43-91f6-89b2290ef04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:52.952844 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2cf870-acfe-4b43-91f6-89b2290ef04d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:52.953124 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2cf870-acfe-4b43-91f6-89b2290ef04d admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:52.953403 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2cf870-acfe-4b43-91f6-89b2290ef04d admin admin] PATH_INFO: `/v3/users/ed14ff3168524d1f896cd45d195c3ce0` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:52.954572 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2cf870-acfe-4b43-91f6-89b2290ef04d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed14ff3168524d1f896cd45d195c3ce0)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:52.956517 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2cf870-acfe-4b43-91f6-89b2290ef04d admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:53.003277 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-cb2cf870-acfe-4b43-91f6-89b2290ef04d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed14ff3168524d1f896cd45d195c3ce0'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:53.004068 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-cb2cf870-acfe-4b43-91f6-89b2290ef04d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed14ff3168524d1f896cd45d195c3ce0'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:53.012321 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-cb2cf870-acfe-4b43-91f6-89b2290ef04d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed14ff3168524d1f896cd45d195c3ce0'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:53.012902 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-cb2cf870-acfe-4b43-91f6-89b2290ef04d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed14ff3168524d1f896cd45d195c3ce0'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:53.021472 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-cb2cf870-acfe-4b43-91f6-89b2290ef04d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed14ff3168524d1f896cd45d195c3ce0'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:53.041947 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 972/1939] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:25:52 2022] DELETE /identity/v3/users/ed14ff3168524d1f896cd45d195c3ce0 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:25:53.046918 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20557ad-ae52-4494-a655-98b1eb7ce8bb None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:53.047447 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20557ad-ae52-4494-a655-98b1eb7ce8bb None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:53.047563 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20557ad-ae52-4494-a655-98b1eb7ce8bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:53.064667 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-d20557ad-ae52-4494-a655-98b1eb7ce8bb None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:25:53.065844 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-d20557ad-ae52-4494-a655-98b1eb7ce8bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:53.121295 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 968/1940] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:25:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:25:53.130766 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2cf870-acfe-4b43-91f6-89b2290ef04d admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:53.132181 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-cb2cf870-acfe-4b43-91f6-89b2290ef04d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:53.187223 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2cf870-acfe-4b43-91f6-89b2290ef04d admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:53.190827 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f003e-b344-4a18-b739-d427d40fc91e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:53.191491 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f003e-b344-4a18-b739-d427d40fc91e service neutron] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:53.191770 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f003e-b344-4a18-b739-d427d40fc91e service neutron] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:53.192036 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f003e-b344-4a18-b739-d427d40fc91e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:53.201035 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655f003e-b344-4a18-b739-d427d40fc91e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:53.202445 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655f003e-b344-4a18-b739-d427d40fc91e service neutron] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:53.211519 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 973/1941] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:25:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 09 20:25:53.476199 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20557ad-ae52-4494-a655-98b1eb7ce8bb None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:53.477681 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-d20557ad-ae52-4494-a655-98b1eb7ce8bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:53.480724 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f003e-b344-4a18-b739-d427d40fc91e service neutron] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:53.482154 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-655f003e-b344-4a18-b739-d427d40fc91e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:53.495784 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f003e-b344-4a18-b739-d427d40fc91e service neutron] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:53.501364 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14721dd-9557-4cdc-92bb-cee55e962a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:53.502203 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14721dd-9557-4cdc-92bb-cee55e962a77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:53.502486 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14721dd-9557-4cdc-92bb-cee55e962a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:53.502764 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14721dd-9557-4cdc-92bb-cee55e962a77 admin admin] PATH_INFO: `/v3/users/ec4b5b956b2f4c3e8a2b9e81c01ebd7c` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:53.503105 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20557ad-ae52-4494-a655-98b1eb7ce8bb None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:53.504063 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14721dd-9557-4cdc-92bb-cee55e962a77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec4b5b956b2f4c3e8a2b9e81c01ebd7c)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:53.506082 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14721dd-9557-4cdc-92bb-cee55e962a77 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:53.509364 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a61fee-d32c-4e64-a112-86b9d44d6574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:53.510259 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a61fee-d32c-4e64-a112-86b9d44d6574 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:53.510531 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a61fee-d32c-4e64-a112-86b9d44d6574 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:53.510795 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a61fee-d32c-4e64-a112-86b9d44d6574 admin admin] PATH_INFO: `/v3/projects/4ee94ba81997489b86db2c0f88aa7dfd` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:53.512467 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a61fee-d32c-4e64-a112-86b9d44d6574 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ee94ba81997489b86db2c0f88aa7dfd)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:53.514408 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a61fee-d32c-4e64-a112-86b9d44d6574 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:53.555033 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-c14721dd-9557-4cdc-92bb-cee55e962a77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec4b5b956b2f4c3e8a2b9e81c01ebd7c'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:53.555734 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-c14721dd-9557-4cdc-92bb-cee55e962a77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec4b5b956b2f4c3e8a2b9e81c01ebd7c'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:53.561879 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-51a61fee-d32c-4e64-a112-86b9d44d6574 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ee94ba81997489b86db2c0f88aa7dfd', 'request_id': 'req-51a61fee-d32c-4e64-a112-86b9d44d6574'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:53.562602 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-c14721dd-9557-4cdc-92bb-cee55e962a77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec4b5b956b2f4c3e8a2b9e81c01ebd7c'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:53.563231 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-c14721dd-9557-4cdc-92bb-cee55e962a77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec4b5b956b2f4c3e8a2b9e81c01ebd7c'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:53.568111 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-51a61fee-d32c-4e64-a112-86b9d44d6574 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ee94ba81997489b86db2c0f88aa7dfd', 'request_id': 'req-51a61fee-d32c-4e64-a112-86b9d44d6574'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:53.571960 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-c14721dd-9557-4cdc-92bb-cee55e962a77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec4b5b956b2f4c3e8a2b9e81c01ebd7c'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:53.575112 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-51a61fee-d32c-4e64-a112-86b9d44d6574 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ee94ba81997489b86db2c0f88aa7dfd', 'request_id': 'req-51a61fee-d32c-4e64-a112-86b9d44d6574'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:53.587504 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-51a61fee-d32c-4e64-a112-86b9d44d6574 admin admin] The token cache is being invalidate because project 4ee94ba81997489b86db2c0f88aa7dfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:25:53.587792 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-51a61fee-d32c-4e64-a112-86b9d44d6574 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:53.589514 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-51a61fee-d32c-4e64-a112-86b9d44d6574 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:53.590722 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 974/1942] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:25:53 2022] DELETE /identity/v3/users/ec4b5b956b2f4c3e8a2b9e81c01ebd7c => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:25:53.590941 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 969/1943] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:25:53 2022] DELETE /identity/v3/projects/4ee94ba81997489b86db2c0f88aa7dfd => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:25:53.594561 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a61fee-d32c-4e64-a112-86b9d44d6574 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:53.595117 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff84ddc-6652-4dd0-a6c5-9c00a4d8ea6a None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:53.595424 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff84ddc-6652-4dd0-a6c5-9c00a4d8ea6a None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:53.595745 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff84ddc-6652-4dd0-a6c5-9c00a4d8ea6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:53.595967 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-51a61fee-d32c-4e64-a112-86b9d44d6574 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:53.613466 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-2ff84ddc-6652-4dd0-a6c5-9c00a4d8ea6a None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:25:53.614566 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-2ff84ddc-6652-4dd0-a6c5-9c00a4d8ea6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:53.657860 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a61fee-d32c-4e64-a112-86b9d44d6574 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:53.671931 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 975/1944] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:25:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:25:53.681692 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff84ddc-6652-4dd0-a6c5-9c00a4d8ea6a None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:53.684953 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-2ff84ddc-6652-4dd0-a6c5-9c00a4d8ea6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:53.715697 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b341fca2-1b0d-4643-86f0-115ce4722b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:53.716912 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b341fca2-1b0d-4643-86f0-115ce4722b0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:53.717202 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b341fca2-1b0d-4643-86f0-115ce4722b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:53.717470 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b341fca2-1b0d-4643-86f0-115ce4722b0c admin admin] PATH_INFO: `/v3/users/7d37e95d285d4c1d87ab3a4cf075acae` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:53.718697 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b341fca2-1b0d-4643-86f0-115ce4722b0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d37e95d285d4c1d87ab3a4cf075acae)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:53.720679 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b341fca2-1b0d-4643-86f0-115ce4722b0c admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:53.745868 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff84ddc-6652-4dd0-a6c5-9c00a4d8ea6a None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:53.749839 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe465de-bb84-4747-9ddd-c4c8e0f35668 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:53.750509 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe465de-bb84-4747-9ddd-c4c8e0f35668 service neutron] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:53.750789 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe465de-bb84-4747-9ddd-c4c8e0f35668 service neutron] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:53.751063 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe465de-bb84-4747-9ddd-c4c8e0f35668 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:53.762369 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe465de-bb84-4747-9ddd-c4c8e0f35668 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:53.763987 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe465de-bb84-4747-9ddd-c4c8e0f35668 service neutron] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:53.774890 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 976/1945] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:25:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 09 20:25:53.779022 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-b341fca2-1b0d-4643-86f0-115ce4722b0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d37e95d285d4c1d87ab3a4cf075acae'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:53.785889 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-b341fca2-1b0d-4643-86f0-115ce4722b0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d37e95d285d4c1d87ab3a4cf075acae'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:53.795283 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-b341fca2-1b0d-4643-86f0-115ce4722b0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d37e95d285d4c1d87ab3a4cf075acae'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:53.796115 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-b341fca2-1b0d-4643-86f0-115ce4722b0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d37e95d285d4c1d87ab3a4cf075acae'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:53.796922 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-b341fca2-1b0d-4643-86f0-115ce4722b0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d37e95d285d4c1d87ab3a4cf075acae'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:53.816127 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 970/1946] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:25:53 2022] DELETE /identity/v3/users/7d37e95d285d4c1d87ab3a4cf075acae => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:25:54.141634 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe465de-bb84-4747-9ddd-c4c8e0f35668 service neutron] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:54.163125 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe465de-bb84-4747-9ddd-c4c8e0f35668 service neutron] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:54.201157 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b341fca2-1b0d-4643-86f0-115ce4722b0c admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:54.203136 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-b341fca2-1b0d-4643-86f0-115ce4722b0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:54.228038 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7231f3eb-89f4-4af6-ae35-94222abd5c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:54.228931 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231f3eb-89f4-4af6-ae35-94222abd5c94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:54.229223 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231f3eb-89f4-4af6-ae35-94222abd5c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:54.230280 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231f3eb-89f4-4af6-ae35-94222abd5c94 admin admin] PATH_INFO: `/v3/projects/917e1e825ab74cea9aacf9cdc0350bf9` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:54.231743 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7231f3eb-89f4-4af6-ae35-94222abd5c94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=917e1e825ab74cea9aacf9cdc0350bf9)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:54.233986 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7231f3eb-89f4-4af6-ae35-94222abd5c94 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:54.277023 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b341fca2-1b0d-4643-86f0-115ce4722b0c admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:54.284922 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-7231f3eb-89f4-4af6-ae35-94222abd5c94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '917e1e825ab74cea9aacf9cdc0350bf9', 'request_id': 'req-7231f3eb-89f4-4af6-ae35-94222abd5c94'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:54.291217 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-7231f3eb-89f4-4af6-ae35-94222abd5c94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '917e1e825ab74cea9aacf9cdc0350bf9', 'request_id': 'req-7231f3eb-89f4-4af6-ae35-94222abd5c94'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:54.296590 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-7231f3eb-89f4-4af6-ae35-94222abd5c94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '917e1e825ab74cea9aacf9cdc0350bf9', 'request_id': 'req-7231f3eb-89f4-4af6-ae35-94222abd5c94'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:54.309618 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-7231f3eb-89f4-4af6-ae35-94222abd5c94 admin admin] The token cache is being invalidate because project 917e1e825ab74cea9aacf9cdc0350bf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:25:54.309828 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-7231f3eb-89f4-4af6-ae35-94222abd5c94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:54.310481 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-7231f3eb-89f4-4af6-ae35-94222abd5c94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:54.312138 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 977/1947] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:25:54 2022] DELETE /identity/v3/projects/917e1e825ab74cea9aacf9cdc0350bf9 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:25:54.317211 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd31c3-eb34-4fc6-992e-9fd9ad527604 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:54.317500 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd31c3-eb34-4fc6-992e-9fd9ad527604 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:54.317799 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd31c3-eb34-4fc6-992e-9fd9ad527604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:54.337565 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-f1dd31c3-eb34-4fc6-992e-9fd9ad527604 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:25:54.338973 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-f1dd31c3-eb34-4fc6-992e-9fd9ad527604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:54.339173 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dac06a-8ef0-4cd6-9ab9-d6967aa2a80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:54.340080 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dac06a-8ef0-4cd6-9ab9-d6967aa2a80a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:54.340361 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dac06a-8ef0-4cd6-9ab9-d6967aa2a80a admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:54.340634 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dac06a-8ef0-4cd6-9ab9-d6967aa2a80a admin admin] PATH_INFO: `/v3/projects/66d73b5d738e40739df5b0beb6f123d5` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:54.341841 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dac06a-8ef0-4cd6-9ab9-d6967aa2a80a admin admin] RBAC: Authorizing `identity:delete_project(project_id=66d73b5d738e40739df5b0beb6f123d5)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:54.343799 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dac06a-8ef0-4cd6-9ab9-d6967aa2a80a admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:54.351875 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 978/1948] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:25:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:25:54.355138 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb87f48e-7774-4914-b540-c9024dd9567a None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:54.355450 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb87f48e-7774-4914-b540-c9024dd9567a None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:54.355724 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb87f48e-7774-4914-b540-c9024dd9567a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:54.373887 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-eb87f48e-7774-4914-b540-c9024dd9567a None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:25:54.375131 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-eb87f48e-7774-4914-b540-c9024dd9567a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:54.389130 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-26dac06a-8ef0-4cd6-9ab9-d6967aa2a80a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66d73b5d738e40739df5b0beb6f123d5', 'request_id': 'req-26dac06a-8ef0-4cd6-9ab9-d6967aa2a80a'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:54.395062 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-26dac06a-8ef0-4cd6-9ab9-d6967aa2a80a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66d73b5d738e40739df5b0beb6f123d5', 'request_id': 'req-26dac06a-8ef0-4cd6-9ab9-d6967aa2a80a'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:54.400260 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-26dac06a-8ef0-4cd6-9ab9-d6967aa2a80a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66d73b5d738e40739df5b0beb6f123d5', 'request_id': 'req-26dac06a-8ef0-4cd6-9ab9-d6967aa2a80a'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:54.412698 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-26dac06a-8ef0-4cd6-9ab9-d6967aa2a80a admin admin] The token cache is being invalidate because project 66d73b5d738e40739df5b0beb6f123d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:25:54.412982 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-26dac06a-8ef0-4cd6-9ab9-d6967aa2a80a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:54.413599 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-26dac06a-8ef0-4cd6-9ab9-d6967aa2a80a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:54.415492 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 971/1949] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:25:54 2022] DELETE /identity/v3/projects/66d73b5d738e40739df5b0beb6f123d5 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:25:54.420334 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f253d-e531-47e0-b7a6-a91fa15c5c7d None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:54.420615 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f253d-e531-47e0-b7a6-a91fa15c5c7d None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:54.420884 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f253d-e531-47e0-b7a6-a91fa15c5c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:54.436049 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 979/1950] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:25:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:25:54.439671 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-bb9f253d-e531-47e0-b7a6-a91fa15c5c7d None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:25:54.440306 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb87f48e-7774-4914-b540-c9024dd9567a None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:54.441479 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-bb9f253d-e531-47e0-b7a6-a91fa15c5c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:54.450001 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb87f48e-7774-4914-b540-c9024dd9567a None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:54.450233 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 972/1951] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:25:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:25:54.454672 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81637c2-3e9b-4b32-9191-bc6160260d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:54.455312 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81637c2-3e9b-4b32-9191-bc6160260d89 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:54.455616 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81637c2-3e9b-4b32-9191-bc6160260d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:54.455931 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81637c2-3e9b-4b32-9191-bc6160260d89 admin admin] PATH_INFO: `/v3/domains` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:54.456688 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81637c2-3e9b-4b32-9191-bc6160260d89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:25:54.456995 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81637c2-3e9b-4b32-9191-bc6160260d89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:54.457617 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a21ac-d75c-46e8-a7d0-f0ac5283ca88 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:54.457905 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a21ac-d75c-46e8-a7d0-f0ac5283ca88 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:54.458181 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a21ac-d75c-46e8-a7d0-f0ac5283ca88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:54.458559 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81637c2-3e9b-4b32-9191-bc6160260d89 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:54.470324 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 980/1952] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 9 20:25:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:25:54.474245 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81637c2-3e9b-4b32-9191-bc6160260d89 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:54.475842 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-a83a21ac-d75c-46e8-a7d0-f0ac5283ca88 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:25:54.477091 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-a83a21ac-d75c-46e8-a7d0-f0ac5283ca88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:54.484118 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81637c2-3e9b-4b32-9191-bc6160260d89 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:54.485234 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 973/1953] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:25:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:25:54.489220 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7328e856-8280-4f1d-98be-c87066af7769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:54.489353 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83a21ac-d75c-46e8-a7d0-f0ac5283ca88 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:54.489852 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7328e856-8280-4f1d-98be-c87066af7769 admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:54.490128 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7328e856-8280-4f1d-98be-c87066af7769 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:54.490397 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7328e856-8280-4f1d-98be-c87066af7769 admin admin] PATH_INFO: `/v3/projects` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:54.491064 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7328e856-8280-4f1d-98be-c87066af7769 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:54.492974 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7328e856-8280-4f1d-98be-c87066af7769 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:54.498858 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83a21ac-d75c-46e8-a7d0-f0ac5283ca88 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:54.503875 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb9e2c8-4116-4c44-b011-0c8de7cfe14c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:54.504514 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb9e2c8-4116-4c44-b011-0c8de7cfe14c admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:54.504792 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb9e2c8-4116-4c44-b011-0c8de7cfe14c admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:54.505064 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb9e2c8-4116-4c44-b011-0c8de7cfe14c admin admin] PATH_INFO: `/v3/domains` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:54.505811 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb9e2c8-4116-4c44-b011-0c8de7cfe14c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:25:54.506110 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb9e2c8-4116-4c44-b011-0c8de7cfe14c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:54.507800 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb9e2c8-4116-4c44-b011-0c8de7cfe14c admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:54.518427 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 981/1954] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:25:54 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 20:25:54.520225 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 974/1955] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 9 20:25:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:25:54.524288 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb9e2c8-4116-4c44-b011-0c8de7cfe14c admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:54.524432 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7328e856-8280-4f1d-98be-c87066af7769 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:54.534541 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb9e2c8-4116-4c44-b011-0c8de7cfe14c admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:54.589019 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7328e856-8280-4f1d-98be-c87066af7769 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:54.590463 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258f0e3-0b1b-4e5e-af09-9fc0e7f9f04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:54.591115 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258f0e3-0b1b-4e5e-af09-9fc0e7f9f04b admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:54.591415 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258f0e3-0b1b-4e5e-af09-9fc0e7f9f04b admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:54.591688 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258f0e3-0b1b-4e5e-af09-9fc0e7f9f04b admin admin] PATH_INFO: `/v3/projects` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:54.592374 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d258f0e3-0b1b-4e5e-af09-9fc0e7f9f04b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:54.593820 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b433940f-55a4-4d1e-88c0-ed0b461335bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:54.594270 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d258f0e3-0b1b-4e5e-af09-9fc0e7f9f04b admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:54.594505 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b433940f-55a4-4d1e-88c0-ed0b461335bf admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:54.594784 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b433940f-55a4-4d1e-88c0-ed0b461335bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:54.595056 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b433940f-55a4-4d1e-88c0-ed0b461335bf admin admin] PATH_INFO: `/v3/users` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:54.595770 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b433940f-55a4-4d1e-88c0-ed0b461335bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:54.597660 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b433940f-55a4-4d1e-88c0-ed0b461335bf admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:54.621526 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 982/1956] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:25:54 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:25:54.621713 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 975/1957] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:25:54 2022] POST /identity/v3/projects => generated 361 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:25:54.622896 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b433940f-55a4-4d1e-88c0-ed0b461335bf admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:54.624330 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258f0e3-0b1b-4e5e-af09-9fc0e7f9f04b admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:54.632934 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b433940f-55a4-4d1e-88c0-ed0b461335bf admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:54.683372 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258f0e3-0b1b-4e5e-af09-9fc0e7f9f04b admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:54.687703 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f4e167-885e-4e39-9a9a-235985158c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:54.688055 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35264763-05f7-4d27-8203-21fca95b2dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:54.688371 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4e167-885e-4e39-9a9a-235985158c6c admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:54.688653 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4e167-885e-4e39-9a9a-235985158c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:54.688750 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35264763-05f7-4d27-8203-21fca95b2dad admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:54.688927 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4e167-885e-4e39-9a9a-235985158c6c admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:54.689017 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35264763-05f7-4d27-8203-21fca95b2dad admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:54.689219 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35264763-05f7-4d27-8203-21fca95b2dad admin admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:54.689646 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f4e167-885e-4e39-9a9a-235985158c6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:54.689887 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35264763-05f7-4d27-8203-21fca95b2dad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:54.691246 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f4e167-885e-4e39-9a9a-235985158c6c admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:54.691808 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35264763-05f7-4d27-8203-21fca95b2dad admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:54.701590 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 983/1958] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:25:54 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 09 20:25:54.705758 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f4e167-885e-4e39-9a9a-235985158c6c admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:54.711421 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 976/1959] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:25:54 2022] POST /identity/v3/users => generated 281 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 20:25:54.716169 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35264763-05f7-4d27-8203-21fca95b2dad admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:54.720197 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f4e167-885e-4e39-9a9a-235985158c6c admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:54.724898 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e67ccbe-11a8-4343-a2e1-70fad32963d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:54.725567 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e67ccbe-11a8-4343-a2e1-70fad32963d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:54.725681 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35264763-05f7-4d27-8203-21fca95b2dad admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:54.725882 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e67ccbe-11a8-4343-a2e1-70fad32963d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:54.726109 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e67ccbe-11a8-4343-a2e1-70fad32963d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:54.726793 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e67ccbe-11a8-4343-a2e1-70fad32963d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:54.728393 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e67ccbe-11a8-4343-a2e1-70fad32963d1 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:54.730495 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be24634-5335-4ac3-9fd7-ccbe0e373d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:54.731143 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be24634-5335-4ac3-9fd7-ccbe0e373d98 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:54.731460 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be24634-5335-4ac3-9fd7-ccbe0e373d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:54.731738 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be24634-5335-4ac3-9fd7-ccbe0e373d98 admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:54.732459 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be24634-5335-4ac3-9fd7-ccbe0e373d98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:54.734112 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be24634-5335-4ac3-9fd7-ccbe0e373d98 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:54.741543 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 984/1960] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:25:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 09 20:25:54.742324 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e67ccbe-11a8-4343-a2e1-70fad32963d1 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:54.747135 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 977/1961] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:25:54 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 09 20:25:54.747990 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be24634-5335-4ac3-9fd7-ccbe0e373d98 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:54.752263 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e67ccbe-11a8-4343-a2e1-70fad32963d1 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:54.756912 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f0b432-68f2-45a3-9340-d9a7e582eea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:54.757550 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be24634-5335-4ac3-9fd7-ccbe0e373d98 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:54.757767 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f0b432-68f2-45a3-9340-d9a7e582eea9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:54.758046 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f0b432-68f2-45a3-9340-d9a7e582eea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:54.758417 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f0b432-68f2-45a3-9340-d9a7e582eea9 admin admin] PATH_INFO: `/v3/projects/f3ef3781704c4c15a667c32c01b3f0af/users/61d7d51e539b45dea8e0b5d60d6ec4e0/roles/79f90a0bf6ea43d0b3c434e31556253a` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:54.763197 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d59b5e1-1c1c-4a66-85d2-66f6fea055d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:54.763877 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59b5e1-1c1c-4a66-85d2-66f6fea055d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:54.764159 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59b5e1-1c1c-4a66-85d2-66f6fea055d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:54.764460 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59b5e1-1c1c-4a66-85d2-66f6fea055d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:54.765169 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d59b5e1-1c1c-4a66-85d2-66f6fea055d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:54.766795 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d59b5e1-1c1c-4a66-85d2-66f6fea055d8 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:54.774143 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f0b432-68f2-45a3-9340-d9a7e582eea9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3ef3781704c4c15a667c32c01b3f0af, user_id=61d7d51e539b45dea8e0b5d60d6ec4e0, role_id=79f90a0bf6ea43d0b3c434e31556253a)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:54.777495 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f0b432-68f2-45a3-9340-d9a7e582eea9 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:54.777772 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 978/1962] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:25:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 09 20:25:54.781759 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d59b5e1-1c1c-4a66-85d2-66f6fea055d8 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:54.792192 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d59b5e1-1c1c-4a66-85d2-66f6fea055d8 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:54.794934 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 985/1963] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:25:54 2022] PUT /identity/v3/projects/f3ef3781704c4c15a667c32c01b3f0af/users/61d7d51e539b45dea8e0b5d60d6ec4e0/roles/79f90a0bf6ea43d0b3c434e31556253a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:25:54.806160 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c400d-0614-482d-99b0-fb7a79c32a9f None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:54.806446 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c400d-0614-482d-99b0-fb7a79c32a9f None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:54.806723 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c400d-0614-482d-99b0-fb7a79c32a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:54.833546 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-982c400d-0614-482d-99b0-fb7a79c32a9f None None] MFA Rules not processed for user `61d7d51e539b45dea8e0b5d60d6ec4e0`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:25:54.834702 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-982c400d-0614-482d-99b0-fb7a79c32a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:54.850710 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2539979d-ad70-4823-abd2-feb12fef4f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:54.851632 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2539979d-ad70-4823-abd2-feb12fef4f7c admin admin] REQUEST_METHOD: `PUT` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:54.851910 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2539979d-ad70-4823-abd2-feb12fef4f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:54.852176 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2539979d-ad70-4823-abd2-feb12fef4f7c admin admin] PATH_INFO: `/v3/projects/bb78bdcb2ddf4a89b47681d5c8d9e6a5/users/71e80cd5ac6844fbb9d60b917513cf14/roles/79f90a0bf6ea43d0b3c434e31556253a` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:54.866024 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2539979d-ad70-4823-abd2-feb12fef4f7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb78bdcb2ddf4a89b47681d5c8d9e6a5, user_id=71e80cd5ac6844fbb9d60b917513cf14, role_id=79f90a0bf6ea43d0b3c434e31556253a)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:54.868695 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2539979d-ad70-4823-abd2-feb12fef4f7c admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:54.882007 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 979/1964] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:25:54 2022] PUT /identity/v3/projects/bb78bdcb2ddf4a89b47681d5c8d9e6a5/users/71e80cd5ac6844fbb9d60b917513cf14/roles/79f90a0bf6ea43d0b3c434e31556253a => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:25:54.894569 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36314839-2f0b-4247-9a07-2b0bf59406c5 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:54.894880 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36314839-2f0b-4247-9a07-2b0bf59406c5 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:54.895158 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36314839-2f0b-4247-9a07-2b0bf59406c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:54.905139 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 986/1965] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:25:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:25:54.909393 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982c400d-0614-482d-99b0-fb7a79c32a9f None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:54.919427 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982c400d-0614-482d-99b0-fb7a79c32a9f None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:54.921364 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-36314839-2f0b-4247-9a07-2b0bf59406c5 None None] MFA Rules not processed for user `71e80cd5ac6844fbb9d60b917513cf14`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:25:54.922594 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-36314839-2f0b-4247-9a07-2b0bf59406c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:54.977325 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87947cd1-3730-4116-aa13-a9f1066b2b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:54.978162 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87947cd1-3730-4116-aa13-a9f1066b2b2c admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:54.978442 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87947cd1-3730-4116-aa13-a9f1066b2b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:54.979360 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87947cd1-3730-4116-aa13-a9f1066b2b2c admin admin] PATH_INFO: `/v3/projects` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:54.980076 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87947cd1-3730-4116-aa13-a9f1066b2b2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:54.982017 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87947cd1-3730-4116-aa13-a9f1066b2b2c admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:54.988255 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 980/1966] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:25:54 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:25:55.013874 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 987/1967] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:25:54 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 20:25:55.017693 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36314839-2f0b-4247-9a07-2b0bf59406c5 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:55.023631 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87947cd1-3730-4116-aa13-a9f1066b2b2c admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:55.025334 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-87947cd1-3730-4116-aa13-a9f1066b2b2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:55.031659 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36314839-2f0b-4247-9a07-2b0bf59406c5 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:55.088911 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87947cd1-3730-4116-aa13-a9f1066b2b2c admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:55.092759 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848dbabb-56c3-4e5e-8e28-c5bc6a51b57e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d65e731386d44948dcc1ecd40cbda65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:55.093306 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848dbabb-56c3-4e5e-8e28-c5bc6a51b57e service cinder] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:55.093587 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848dbabb-56c3-4e5e-8e28-c5bc6a51b57e service cinder] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:55.093860 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848dbabb-56c3-4e5e-8e28-c5bc6a51b57e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:55.102785 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a9cb7c-2957-4253-b45e-346a535110eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:55.103506 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9cb7c-2957-4253-b45e-346a535110eb admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:55.104675 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9cb7c-2957-4253-b45e-346a535110eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:55.104955 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9cb7c-2957-4253-b45e-346a535110eb admin admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:55.105644 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a9cb7c-2957-4253-b45e-346a535110eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:55.107598 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a9cb7c-2957-4253-b45e-346a535110eb admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:55.134633 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 981/1968] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:25:55 2022] POST /identity/v3/users => generated 292 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:25:55.136010 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a9cb7c-2957-4253-b45e-346a535110eb admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:55.152613 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a9cb7c-2957-4253-b45e-346a535110eb admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:55.160489 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9762d61f-935f-4847-9f09-4841ce3874a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:55.161338 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762d61f-935f-4847-9f09-4841ce3874a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:55.161897 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762d61f-935f-4847-9f09-4841ce3874a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:55.162310 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762d61f-935f-4847-9f09-4841ce3874a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:55.163033 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848dbabb-56c3-4e5e-8e28-c5bc6a51b57e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:55.163806 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9762d61f-935f-4847-9f09-4841ce3874a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:55.164522 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848dbabb-56c3-4e5e-8e28-c5bc6a51b57e service cinder] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:55.165858 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9762d61f-935f-4847-9f09-4841ce3874a4 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:55.175538 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 988/1969] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:25:55 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 09 20:25:55.177110 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 982/1970] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:25:55 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 09 20:25:55.180828 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848dbabb-56c3-4e5e-8e28-c5bc6a51b57e service cinder] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:55.193340 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848dbabb-56c3-4e5e-8e28-c5bc6a51b57e service cinder] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:55.193713 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9762d61f-935f-4847-9f09-4841ce3874a4 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:55.198871 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0dd13-c0a6-4097-9f0b-7e77a47b34e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:55.199567 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0dd13-c0a6-4097-9f0b-7e77a47b34e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:55.199853 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0dd13-c0a6-4097-9f0b-7e77a47b34e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:55.200130 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0dd13-c0a6-4097-9f0b-7e77a47b34e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:55.200855 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc0dd13-c0a6-4097-9f0b-7e77a47b34e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:55.202454 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc0dd13-c0a6-4097-9f0b-7e77a47b34e4 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:55.205983 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9762d61f-935f-4847-9f09-4841ce3874a4 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:55.211174 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa47154f-2f4b-4930-9515-ec5a3286075e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:55.212078 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa47154f-2f4b-4930-9515-ec5a3286075e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:55.212359 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa47154f-2f4b-4930-9515-ec5a3286075e admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:55.212628 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa47154f-2f4b-4930-9515-ec5a3286075e admin admin] PATH_INFO: `/v3/users/71e80cd5ac6844fbb9d60b917513cf14` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:55.213061 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 989/1971] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:25:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 09 20:25:55.216794 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa47154f-2f4b-4930-9515-ec5a3286075e admin admin] RBAC: Authorizing `identity:delete_user(user_id=71e80cd5ac6844fbb9d60b917513cf14)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:55.217135 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0dd13-c0a6-4097-9f0b-7e77a47b34e4 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:55.219600 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa47154f-2f4b-4930-9515-ec5a3286075e admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:55.228645 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0dd13-c0a6-4097-9f0b-7e77a47b34e4 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:55.233564 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48df28d2-e476-490e-83b5-b93dd4baa4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:55.235992 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df28d2-e476-490e-83b5-b93dd4baa4e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:55.236474 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df28d2-e476-490e-83b5-b93dd4baa4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:55.236936 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df28d2-e476-490e-83b5-b93dd4baa4e4 admin admin] PATH_INFO: `/v3/projects/947a40c866974d819e7bc1335be68271/users/432816c480e04d1194e84bb777c2a409/roles/79f90a0bf6ea43d0b3c434e31556253a` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:55.253706 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48df28d2-e476-490e-83b5-b93dd4baa4e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=947a40c866974d819e7bc1335be68271, user_id=432816c480e04d1194e84bb777c2a409, role_id=79f90a0bf6ea43d0b3c434e31556253a)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:55.256423 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48df28d2-e476-490e-83b5-b93dd4baa4e4 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:55.267226 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-fa47154f-2f4b-4930-9515-ec5a3286075e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71e80cd5ac6844fbb9d60b917513cf14'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:55.270398 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 990/1972] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:25:55 2022] PUT /identity/v3/projects/947a40c866974d819e7bc1335be68271/users/432816c480e04d1194e84bb777c2a409/roles/79f90a0bf6ea43d0b3c434e31556253a => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:25:55.275270 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-fa47154f-2f4b-4930-9515-ec5a3286075e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71e80cd5ac6844fbb9d60b917513cf14'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:55.281349 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e1788f-1f12-4a32-93db-0757390d9010 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:55.281694 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e1788f-1f12-4a32-93db-0757390d9010 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:55.282056 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e1788f-1f12-4a32-93db-0757390d9010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:55.283899 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-fa47154f-2f4b-4930-9515-ec5a3286075e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71e80cd5ac6844fbb9d60b917513cf14'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:55.285045 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-fa47154f-2f4b-4930-9515-ec5a3286075e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71e80cd5ac6844fbb9d60b917513cf14'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:55.285850 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-fa47154f-2f4b-4930-9515-ec5a3286075e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71e80cd5ac6844fbb9d60b917513cf14'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:55.303894 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 983/1973] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:25:55 2022] DELETE /identity/v3/users/71e80cd5ac6844fbb9d60b917513cf14 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:25:55.309062 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa22d4e-e87c-42fb-a297-e7f35b5814d4 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:55.309584 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa22d4e-e87c-42fb-a297-e7f35b5814d4 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:55.309990 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa22d4e-e87c-42fb-a297-e7f35b5814d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:55.310743 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-58e1788f-1f12-4a32-93db-0757390d9010 None None] MFA Rules not processed for user `432816c480e04d1194e84bb777c2a409`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:25:55.311981 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-58e1788f-1f12-4a32-93db-0757390d9010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:55.327566 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-8fa22d4e-e87c-42fb-a297-e7f35b5814d4 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:25:55.328758 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-8fa22d4e-e87c-42fb-a297-e7f35b5814d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:55.374352 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 991/1974] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:25:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:25:55.378871 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e1788f-1f12-4a32-93db-0757390d9010 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:55.380823 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-58e1788f-1f12-4a32-93db-0757390d9010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:55.388729 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 984/1975] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:25:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:25:55.396751 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e1788f-1f12-4a32-93db-0757390d9010 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:55.398796 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa22d4e-e87c-42fb-a297-e7f35b5814d4 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:55.400149 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-8fa22d4e-e87c-42fb-a297-e7f35b5814d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:55.402192 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d32b67-967c-4053-9190-8ce729325764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:55.402863 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d32b67-967c-4053-9190-8ce729325764 admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:55.403146 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d32b67-967c-4053-9190-8ce729325764 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:55.403440 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d32b67-967c-4053-9190-8ce729325764 admin admin] PATH_INFO: `/v3/projects` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:55.404127 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d32b67-967c-4053-9190-8ce729325764 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:55.406012 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d32b67-967c-4053-9190-8ce729325764 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:55.435455 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 992/1976] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:25:55 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 20:25:55.436750 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d32b67-967c-4053-9190-8ce729325764 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:55.459605 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa22d4e-e87c-42fb-a297-e7f35b5814d4 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:55.497345 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d32b67-967c-4053-9190-8ce729325764 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:55.502017 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7511bb8e-eaac-4ec9-8156-4da77b820c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:55.502680 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511bb8e-eaac-4ec9-8156-4da77b820c27 admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:55.502968 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511bb8e-eaac-4ec9-8156-4da77b820c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:55.503621 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511bb8e-eaac-4ec9-8156-4da77b820c27 admin admin] PATH_INFO: `/v3/users` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:55.504312 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7511bb8e-eaac-4ec9-8156-4da77b820c27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:55.506231 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7511bb8e-eaac-4ec9-8156-4da77b820c27 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:55.506482 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2603f48-2ea0-45ec-b672-20b704cfb52d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:55.507116 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2603f48-2ea0-45ec-b672-20b704cfb52d service neutron] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:55.507421 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2603f48-2ea0-45ec-b672-20b704cfb52d service neutron] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:55.507684 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2603f48-2ea0-45ec-b672-20b704cfb52d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:55.516912 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2603f48-2ea0-45ec-b672-20b704cfb52d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:55.518338 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2603f48-2ea0-45ec-b672-20b704cfb52d service neutron] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:55.526889 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 993/1977] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:25:55 2022] POST /identity/v3/users => generated 298 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 20:25:55.527972 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 985/1978] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:25:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 09 20:25:55.530908 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7511bb8e-eaac-4ec9-8156-4da77b820c27 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:55.540185 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7511bb8e-eaac-4ec9-8156-4da77b820c27 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:55.545665 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7496c1-a547-46d5-8664-4712cb8229ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:55.546346 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7496c1-a547-46d5-8664-4712cb8229ff admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:55.546632 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7496c1-a547-46d5-8664-4712cb8229ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:55.547562 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7496c1-a547-46d5-8664-4712cb8229ff admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:55.548293 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7496c1-a547-46d5-8664-4712cb8229ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:55.549880 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7496c1-a547-46d5-8664-4712cb8229ff admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:55.560516 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 994/1979] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:25:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 09 20:25:55.564818 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2603f48-2ea0-45ec-b672-20b704cfb52d service neutron] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:55.575117 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2603f48-2ea0-45ec-b672-20b704cfb52d service neutron] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:55.585521 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999ca6a7-37f8-4298-92a0-6f2684bc37b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:55.586534 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ca6a7-37f8-4298-92a0-6f2684bc37b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:55.586898 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ca6a7-37f8-4298-92a0-6f2684bc37b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:55.587180 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ca6a7-37f8-4298-92a0-6f2684bc37b8 admin admin] PATH_INFO: `/v3/projects/c24a69c1600d4366bf73394fc1e6ff53/users/c951ce5cf2e94593a4759b7731d198f1/roles/274130b78e304bb88789c1b349263f3c` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:55.604512 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999ca6a7-37f8-4298-92a0-6f2684bc37b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c24a69c1600d4366bf73394fc1e6ff53, user_id=c951ce5cf2e94593a4759b7731d198f1, role_id=274130b78e304bb88789c1b349263f3c)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:55.607439 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999ca6a7-37f8-4298-92a0-6f2684bc37b8 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:55.620368 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 986/1980] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:25:55 2022] PUT /identity/v3/projects/c24a69c1600d4366bf73394fc1e6ff53/users/c951ce5cf2e94593a4759b7731d198f1/roles/274130b78e304bb88789c1b349263f3c => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:25:55.624614 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7496c1-a547-46d5-8664-4712cb8229ff admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:55.635619 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7496c1-a547-46d5-8664-4712cb8229ff admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:55.692336 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb47d8b-9205-4ae9-a7dc-03396a3c3ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:55.693000 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb47d8b-9205-4ae9-a7dc-03396a3c3ce5 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:55.693282 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb47d8b-9205-4ae9-a7dc-03396a3c3ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:55.693556 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb47d8b-9205-4ae9-a7dc-03396a3c3ce5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:55.694280 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb47d8b-9205-4ae9-a7dc-03396a3c3ce5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:55.695908 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb47d8b-9205-4ae9-a7dc-03396a3c3ce5 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:55.705831 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 995/1981] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:25:55 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:25:55.709927 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999ca6a7-37f8-4298-92a0-6f2684bc37b8 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:55.720616 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999ca6a7-37f8-4298-92a0-6f2684bc37b8 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:55.725217 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e84a25-8ccf-4569-82f1-063745ea7a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:55.726276 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e84a25-8ccf-4569-82f1-063745ea7a49 admin admin] REQUEST_METHOD: `PUT` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:55.726555 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e84a25-8ccf-4569-82f1-063745ea7a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:55.726824 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e84a25-8ccf-4569-82f1-063745ea7a49 admin admin] PATH_INFO: `/v3/projects/c24a69c1600d4366bf73394fc1e6ff53/users/c951ce5cf2e94593a4759b7731d198f1/roles/274130b78e304bb88789c1b349263f3c` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:55.729436 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e84a25-8ccf-4569-82f1-063745ea7a49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c24a69c1600d4366bf73394fc1e6ff53, user_id=c951ce5cf2e94593a4759b7731d198f1, role_id=274130b78e304bb88789c1b349263f3c)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:55.732215 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e84a25-8ccf-4569-82f1-063745ea7a49 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:55.742532 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 987/1982] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:25:55 2022] PUT /identity/v3/projects/c24a69c1600d4366bf73394fc1e6ff53/users/c951ce5cf2e94593a4759b7731d198f1/roles/274130b78e304bb88789c1b349263f3c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:25:55.753262 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b86dc-9922-45f4-a976-66f59185b15a None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:55.753669 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b86dc-9922-45f4-a976-66f59185b15a None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:55.753998 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b86dc-9922-45f4-a976-66f59185b15a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:55.781252 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-ef8b86dc-9922-45f4-a976-66f59185b15a None None] MFA Rules not processed for user `c951ce5cf2e94593a4759b7731d198f1`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:25:55.782895 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-ef8b86dc-9922-45f4-a976-66f59185b15a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:55.808170 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e84a25-8ccf-4569-82f1-063745ea7a49 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:55.810187 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-89e84a25-8ccf-4569-82f1-063745ea7a49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:55.855861 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 996/1983] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:25:55 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:25:55.867121 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8b86dc-9922-45f4-a976-66f59185b15a None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:55.868479 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-ef8b86dc-9922-45f4-a976-66f59185b15a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:55.877344 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e84a25-8ccf-4569-82f1-063745ea7a49 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:55.882029 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bbc8c9-d6e1-471d-83cc-e06005c6cf13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:55.883246 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bbc8c9-d6e1-471d-83cc-e06005c6cf13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:55.883614 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bbc8c9-d6e1-471d-83cc-e06005c6cf13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:55.883793 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bbc8c9-d6e1-471d-83cc-e06005c6cf13 admin admin] PATH_INFO: `/v3/projects/bb78bdcb2ddf4a89b47681d5c8d9e6a5` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:55.885096 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bbc8c9-d6e1-471d-83cc-e06005c6cf13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb78bdcb2ddf4a89b47681d5c8d9e6a5)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:55.887737 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bbc8c9-d6e1-471d-83cc-e06005c6cf13 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:55.926966 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8b86dc-9922-45f4-a976-66f59185b15a None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:55.937417 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-d7bbc8c9-d6e1-471d-83cc-e06005c6cf13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb78bdcb2ddf4a89b47681d5c8d9e6a5', 'request_id': 'req-d7bbc8c9-d6e1-471d-83cc-e06005c6cf13'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:55.943660 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-d7bbc8c9-d6e1-471d-83cc-e06005c6cf13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb78bdcb2ddf4a89b47681d5c8d9e6a5', 'request_id': 'req-d7bbc8c9-d6e1-471d-83cc-e06005c6cf13'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:55.949261 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-d7bbc8c9-d6e1-471d-83cc-e06005c6cf13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb78bdcb2ddf4a89b47681d5c8d9e6a5', 'request_id': 'req-d7bbc8c9-d6e1-471d-83cc-e06005c6cf13'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:55.962598 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-d7bbc8c9-d6e1-471d-83cc-e06005c6cf13 admin admin] The token cache is being invalidate because project bb78bdcb2ddf4a89b47681d5c8d9e6a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:25:55.962894 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-d7bbc8c9-d6e1-471d-83cc-e06005c6cf13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:55.964215 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-d7bbc8c9-d6e1-471d-83cc-e06005c6cf13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:25:55.966153 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 988/1984] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:25:55 2022] DELETE /identity/v3/projects/bb78bdcb2ddf4a89b47681d5c8d9e6a5 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:25:55.970707 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6431777a-9f03-41f2-a321-778361cf01d3 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:55.970998 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6431777a-9f03-41f2-a321-778361cf01d3 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:55.971262 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6431777a-9f03-41f2-a321-778361cf01d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:55.979564 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85104ca3-4b59-4cf3-89a5-f51e9527b3f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d65e731386d44948dcc1ecd40cbda65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:55.980231 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85104ca3-4b59-4cf3-89a5-f51e9527b3f3 service cinder] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:55.980545 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85104ca3-4b59-4cf3-89a5-f51e9527b3f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:55.981084 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85104ca3-4b59-4cf3-89a5-f51e9527b3f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:55.983000 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-85104ca3-4b59-4cf3-89a5-f51e9527b3f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:55.990664 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-6431777a-9f03-41f2-a321-778361cf01d3 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:25:55.991902 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-6431777a-9f03-41f2-a321-778361cf01d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:56.045406 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85104ca3-4b59-4cf3-89a5-f51e9527b3f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:56.046956 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85104ca3-4b59-4cf3-89a5-f51e9527b3f3 service cinder] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:56.055518 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 989/1985] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:25:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:25:56.058063 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 997/1986] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:25:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 09 20:25:56.062877 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b6379e-3ba2-4339-9959-c413291ce682 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:56.063191 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b6379e-3ba2-4339-9959-c413291ce682 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:56.063489 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b6379e-3ba2-4339-9959-c413291ce682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:56.081961 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-89b6379e-3ba2-4339-9959-c413291ce682 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:25:56.083263 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-89b6379e-3ba2-4339-9959-c413291ce682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:56.095670 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 990/1987] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:25:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:25:56.097055 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85104ca3-4b59-4cf3-89a5-f51e9527b3f3 service cinder] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:56.108375 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85104ca3-4b59-4cf3-89a5-f51e9527b3f3 service cinder] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:56.113040 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa7db3f-f8e2-40e3-ac2c-c049a9de6bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:56.113692 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7db3f-f8e2-40e3-ac2c-c049a9de6bd8 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:56.113973 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7db3f-f8e2-40e3-ac2c-c049a9de6bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:56.114251 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7db3f-f8e2-40e3-ac2c-c049a9de6bd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:56.115006 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa7db3f-f8e2-40e3-ac2c-c049a9de6bd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:25:56.115318 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa7db3f-f8e2-40e3-ac2c-c049a9de6bd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:56.116993 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa7db3f-f8e2-40e3-ac2c-c049a9de6bd8 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:56.129076 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 998/1988] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 9 20:25:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:25:56.133425 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b6379e-3ba2-4339-9959-c413291ce682 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:56.143021 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b6379e-3ba2-4339-9959-c413291ce682 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:56.147659 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f750df-d531-4f50-b82f-bb99199c8617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:56.148293 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f750df-d531-4f50-b82f-bb99199c8617 admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:56.148568 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f750df-d531-4f50-b82f-bb99199c8617 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:56.148833 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f750df-d531-4f50-b82f-bb99199c8617 admin admin] PATH_INFO: `/v3/projects` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:56.149509 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f750df-d531-4f50-b82f-bb99199c8617 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:56.152113 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f750df-d531-4f50-b82f-bb99199c8617 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:56.189284 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 991/1989] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:25:56 2022] POST /identity/v3/projects => generated 375 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:25:56.193423 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa7db3f-f8e2-40e3-ac2c-c049a9de6bd8 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:56.204482 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa7db3f-f8e2-40e3-ac2c-c049a9de6bd8 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:56.274400 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6241a89-95d2-41ae-8816-0b90c7db1332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:56.275173 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6241a89-95d2-41ae-8816-0b90c7db1332 admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:56.275623 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6241a89-95d2-41ae-8816-0b90c7db1332 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:56.275950 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6241a89-95d2-41ae-8816-0b90c7db1332 admin admin] PATH_INFO: `/v3/users` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:56.276831 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6241a89-95d2-41ae-8816-0b90c7db1332 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:56.279122 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6241a89-95d2-41ae-8816-0b90c7db1332 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:56.309055 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 999/1990] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:25:56 2022] POST /identity/v3/users => generated 288 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 20:25:56.310690 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f750df-d531-4f50-b82f-bb99199c8617 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:56.323829 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f750df-d531-4f50-b82f-bb99199c8617 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:56.335090 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52537d76-d2e0-4e79-8ff7-3c22672dfb4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:56.335818 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52537d76-d2e0-4e79-8ff7-3c22672dfb4c admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:56.336143 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52537d76-d2e0-4e79-8ff7-3c22672dfb4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:56.336449 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52537d76-d2e0-4e79-8ff7-3c22672dfb4c admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:56.337387 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52537d76-d2e0-4e79-8ff7-3c22672dfb4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:56.340554 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52537d76-d2e0-4e79-8ff7-3c22672dfb4c admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:56.353428 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 992/1991] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:25:56 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:25:56.358371 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6241a89-95d2-41ae-8816-0b90c7db1332 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:56.382081 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6241a89-95d2-41ae-8816-0b90c7db1332 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:56.391364 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e17fb-6faa-4662-a9b1-b5bc434e09bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:56.392698 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e17fb-6faa-4662-a9b1-b5bc434e09bc admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:56.393295 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e17fb-6faa-4662-a9b1-b5bc434e09bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:56.393774 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e17fb-6faa-4662-a9b1-b5bc434e09bc admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:56.394893 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8e17fb-6faa-4662-a9b1-b5bc434e09bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:56.397203 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8e17fb-6faa-4662-a9b1-b5bc434e09bc admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:56.411954 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1000/1992] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:25:56 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 09 20:25:56.420548 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52537d76-d2e0-4e79-8ff7-3c22672dfb4c admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:56.433920 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52537d76-d2e0-4e79-8ff7-3c22672dfb4c admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:56.440125 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db9129-2d5b-441c-9b29-f03b69536a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:56.441640 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db9129-2d5b-441c-9b29-f03b69536a1d admin admin] REQUEST_METHOD: `PUT` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:56.441640 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db9129-2d5b-441c-9b29-f03b69536a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:56.441640 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db9129-2d5b-441c-9b29-f03b69536a1d admin admin] PATH_INFO: `/v3/projects/eba30264aaa040bd81db11c5d63462ea/users/18d17a4a83584496b50c9a4dcd125e2c/roles/79f90a0bf6ea43d0b3c434e31556253a` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:56.461726 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6db9129-2d5b-441c-9b29-f03b69536a1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=eba30264aaa040bd81db11c5d63462ea, user_id=18d17a4a83584496b50c9a4dcd125e2c, role_id=79f90a0bf6ea43d0b3c434e31556253a)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:56.465472 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6db9129-2d5b-441c-9b29-f03b69536a1d admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:56.484597 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 993/1993] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:25:56 2022] PUT /identity/v3/projects/eba30264aaa040bd81db11c5d63462ea/users/18d17a4a83584496b50c9a4dcd125e2c/roles/79f90a0bf6ea43d0b3c434e31556253a => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:25:56.496796 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1825b4de-b7bc-4191-9c77-05ab27226623 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:56.497078 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1825b4de-b7bc-4191-9c77-05ab27226623 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:56.497356 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1825b4de-b7bc-4191-9c77-05ab27226623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:56.536557 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-1825b4de-b7bc-4191-9c77-05ab27226623 None None] MFA Rules not processed for user `18d17a4a83584496b50c9a4dcd125e2c`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:25:56.538225 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-1825b4de-b7bc-4191-9c77-05ab27226623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:56.629177 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1001/1994] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:25:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:25:56.636749 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db9129-2d5b-441c-9b29-f03b69536a1d admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:56.740009 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db9129-2d5b-441c-9b29-f03b69536a1d admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:56.745360 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9bc1b7-274f-47cd-948e-83caa95dbb08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:56.746026 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9bc1b7-274f-47cd-948e-83caa95dbb08 admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:56.746312 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9bc1b7-274f-47cd-948e-83caa95dbb08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:56.746585 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9bc1b7-274f-47cd-948e-83caa95dbb08 admin admin] PATH_INFO: `/v3/projects` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:56.747267 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9bc1b7-274f-47cd-948e-83caa95dbb08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:56.749226 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9bc1b7-274f-47cd-948e-83caa95dbb08 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:56.776401 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 994/1995] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:25:56 2022] POST /identity/v3/projects => generated 375 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:25:56.780408 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1825b4de-b7bc-4191-9c77-05ab27226623 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:56.790755 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1825b4de-b7bc-4191-9c77-05ab27226623 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:56.844801 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f565bac3-c7b8-47d0-9907-768cd4afa237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:56.845453 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565bac3-c7b8-47d0-9907-768cd4afa237 admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:56.845729 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565bac3-c7b8-47d0-9907-768cd4afa237 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:56.845997 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565bac3-c7b8-47d0-9907-768cd4afa237 admin admin] PATH_INFO: `/v3/users` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:56.846678 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f565bac3-c7b8-47d0-9907-768cd4afa237 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:56.848600 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f565bac3-c7b8-47d0-9907-768cd4afa237 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:56.867129 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1002/1996] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:25:56 2022] POST /identity/v3/users => generated 288 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:25:56.871121 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9bc1b7-274f-47cd-948e-83caa95dbb08 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:56.881307 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9bc1b7-274f-47cd-948e-83caa95dbb08 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:56.887511 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26e552c-bc03-4326-b639-c4cf73a437c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:56.888218 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e552c-bc03-4326-b639-c4cf73a437c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:56.888507 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e552c-bc03-4326-b639-c4cf73a437c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:56.888782 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e552c-bc03-4326-b639-c4cf73a437c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:56.889504 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26e552c-bc03-4326-b639-c4cf73a437c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:56.891100 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26e552c-bc03-4326-b639-c4cf73a437c4 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:56.902567 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 995/1997] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:25:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:25:56.906514 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f565bac3-c7b8-47d0-9907-768cd4afa237 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:56.916268 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f565bac3-c7b8-47d0-9907-768cd4afa237 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:56.921209 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bc2a64-a004-4a2b-a06b-5823add77402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:56.921854 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc2a64-a004-4a2b-a06b-5823add77402 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:56.922131 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc2a64-a004-4a2b-a06b-5823add77402 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:56.922401 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc2a64-a004-4a2b-a06b-5823add77402 admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:56.923115 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bc2a64-a004-4a2b-a06b-5823add77402 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:56.924725 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bc2a64-a004-4a2b-a06b-5823add77402 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:56.935228 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1003/1998] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:25:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:25:56.939327 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26e552c-bc03-4326-b639-c4cf73a437c4 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:56.949703 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26e552c-bc03-4326-b639-c4cf73a437c4 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:56.954260 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25028f5b-23a9-4acb-9141-ea27ae8f1678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:56.955118 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25028f5b-23a9-4acb-9141-ea27ae8f1678 admin admin] REQUEST_METHOD: `PUT` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:56.955405 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25028f5b-23a9-4acb-9141-ea27ae8f1678 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:56.955738 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25028f5b-23a9-4acb-9141-ea27ae8f1678 admin admin] PATH_INFO: `/v3/projects/c3bff9cee9564dba9ebfa1511686ab3f/users/20c3a840fc59442c98f0617bb73fda64/roles/79f90a0bf6ea43d0b3c434e31556253a` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:56.971086 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25028f5b-23a9-4acb-9141-ea27ae8f1678 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3bff9cee9564dba9ebfa1511686ab3f, user_id=20c3a840fc59442c98f0617bb73fda64, role_id=79f90a0bf6ea43d0b3c434e31556253a)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:56.973755 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25028f5b-23a9-4acb-9141-ea27ae8f1678 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:56.987550 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 996/1999] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:25:56 2022] PUT /identity/v3/projects/c3bff9cee9564dba9ebfa1511686ab3f/users/20c3a840fc59442c98f0617bb73fda64/roles/79f90a0bf6ea43d0b3c434e31556253a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:25:56.997660 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd786c3-d370-43ba-a936-698afa419f69 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:56.997980 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd786c3-d370-43ba-a936-698afa419f69 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:56.998237 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd786c3-d370-43ba-a936-698afa419f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:57.024801 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-8cd786c3-d370-43ba-a936-698afa419f69 None None] MFA Rules not processed for user `20c3a840fc59442c98f0617bb73fda64`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:25:57.026644 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-8cd786c3-d370-43ba-a936-698afa419f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:57.100291 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1004/2000] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:25:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:25:57.103664 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25028f5b-23a9-4acb-9141-ea27ae8f1678 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:57.173141 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25028f5b-23a9-4acb-9141-ea27ae8f1678 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:57.177893 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbe91c9-863b-4ee4-92c4-1686576f2e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:57.178549 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe91c9-863b-4ee4-92c4-1686576f2e7a admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:57.178827 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe91c9-863b-4ee4-92c4-1686576f2e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:57.179213 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe91c9-863b-4ee4-92c4-1686576f2e7a admin admin] PATH_INFO: `/v3/projects` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:57.179943 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbe91c9-863b-4ee4-92c4-1686576f2e7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:57.182641 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbe91c9-863b-4ee4-92c4-1686576f2e7a admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:57.208672 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 997/2001] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:25:57 2022] POST /identity/v3/projects => generated 375 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:25:57.212758 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd786c3-d370-43ba-a936-698afa419f69 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:57.225013 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd786c3-d370-43ba-a936-698afa419f69 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:57.287161 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985a73be-fea8-475e-bc97-85d1d4caa4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:57.287878 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985a73be-fea8-475e-bc97-85d1d4caa4c8 admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:57.288187 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985a73be-fea8-475e-bc97-85d1d4caa4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:57.288460 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985a73be-fea8-475e-bc97-85d1d4caa4c8 admin admin] PATH_INFO: `/v3/users` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:57.289168 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985a73be-fea8-475e-bc97-85d1d4caa4c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:57.291168 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985a73be-fea8-475e-bc97-85d1d4caa4c8 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:57.312407 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1005/2002] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:25:57 2022] POST /identity/v3/users => generated 294 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 20:25:57.316462 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbe91c9-863b-4ee4-92c4-1686576f2e7a admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:57.327270 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbe91c9-863b-4ee4-92c4-1686576f2e7a admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:57.336348 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e14f00c-d244-4cd8-b624-811c35e43505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:57.337126 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14f00c-d244-4cd8-b624-811c35e43505 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:57.337502 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14f00c-d244-4cd8-b624-811c35e43505 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:57.337889 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14f00c-d244-4cd8-b624-811c35e43505 admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:57.339113 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e14f00c-d244-4cd8-b624-811c35e43505 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:57.340902 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e14f00c-d244-4cd8-b624-811c35e43505 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:57.352299 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 998/2003] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:25:57 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:25:57.356519 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985a73be-fea8-475e-bc97-85d1d4caa4c8 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:57.367039 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985a73be-fea8-475e-bc97-85d1d4caa4c8 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:57.372890 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e7034-7c5f-47c5-9819-023a3d5484d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:57.373786 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e7034-7c5f-47c5-9819-023a3d5484d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:57.374064 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e7034-7c5f-47c5-9819-023a3d5484d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:57.374334 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e7034-7c5f-47c5-9819-023a3d5484d4 admin admin] PATH_INFO: `/v3/projects/48a552b764c243149e02e857ce99411b/users/431bbe72a418436cbabe9c516f14bb47/roles/274130b78e304bb88789c1b349263f3c` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:57.390942 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43e7034-7c5f-47c5-9819-023a3d5484d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48a552b764c243149e02e857ce99411b, user_id=431bbe72a418436cbabe9c516f14bb47, role_id=274130b78e304bb88789c1b349263f3c)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:57.393618 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43e7034-7c5f-47c5-9819-023a3d5484d4 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:57.412142 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1006/2004] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:25:57 2022] PUT /identity/v3/projects/48a552b764c243149e02e857ce99411b/users/431bbe72a418436cbabe9c516f14bb47/roles/274130b78e304bb88789c1b349263f3c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:25:57.413291 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e14f00c-d244-4cd8-b624-811c35e43505 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:57.423898 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e14f00c-d244-4cd8-b624-811c35e43505 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:57.484928 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912926bd-87d0-41b3-ad2f-28693e1d83d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:57.485724 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912926bd-87d0-41b3-ad2f-28693e1d83d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:57.486001 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912926bd-87d0-41b3-ad2f-28693e1d83d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:57.486268 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912926bd-87d0-41b3-ad2f-28693e1d83d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:57.486985 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912926bd-87d0-41b3-ad2f-28693e1d83d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:57.488738 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912926bd-87d0-41b3-ad2f-28693e1d83d2 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:57.499548 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 999/2005] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:25:57 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:25:57.504255 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e7034-7c5f-47c5-9819-023a3d5484d4 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:57.516775 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e7034-7c5f-47c5-9819-023a3d5484d4 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:57.521460 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6661b798-e22b-43f3-8105-bafb38557dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:57.522337 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6661b798-e22b-43f3-8105-bafb38557dba admin admin] REQUEST_METHOD: `PUT` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:57.522619 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6661b798-e22b-43f3-8105-bafb38557dba admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:57.522889 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6661b798-e22b-43f3-8105-bafb38557dba admin admin] PATH_INFO: `/v3/projects/48a552b764c243149e02e857ce99411b/users/431bbe72a418436cbabe9c516f14bb47/roles/274130b78e304bb88789c1b349263f3c` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:57.527351 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6661b798-e22b-43f3-8105-bafb38557dba admin admin] RBAC: Authorizing `identity:create_grant(project_id=48a552b764c243149e02e857ce99411b, user_id=431bbe72a418436cbabe9c516f14bb47, role_id=274130b78e304bb88789c1b349263f3c)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:57.530352 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6661b798-e22b-43f3-8105-bafb38557dba admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:57.543086 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1007/2006] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:25:57 2022] PUT /identity/v3/projects/48a552b764c243149e02e857ce99411b/users/431bbe72a418436cbabe9c516f14bb47/roles/274130b78e304bb88789c1b349263f3c => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:25:57.553176 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a75b09-12c5-433e-b2a2-a1be50cba99a None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:57.553465 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a75b09-12c5-433e-b2a2-a1be50cba99a None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:57.553734 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a75b09-12c5-433e-b2a2-a1be50cba99a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:57.584365 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-95a75b09-12c5-433e-b2a2-a1be50cba99a None None] MFA Rules not processed for user `431bbe72a418436cbabe9c516f14bb47`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:25:57.585612 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-95a75b09-12c5-433e-b2a2-a1be50cba99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:57.644688 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6661b798-e22b-43f3-8105-bafb38557dba admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:57.646516 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-6661b798-e22b-43f3-8105-bafb38557dba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:57.673598 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1000/2007] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:25:57 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:25:57.681328 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a75b09-12c5-433e-b2a2-a1be50cba99a None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:57.684068 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-95a75b09-12c5-433e-b2a2-a1be50cba99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:57.719360 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6661b798-e22b-43f3-8105-bafb38557dba admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:57.723133 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24987e3-ba0a-44a3-aa33-ec05869b743c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d65e731386d44948dcc1ecd40cbda65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:57.723883 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24987e3-ba0a-44a3-aa33-ec05869b743c service cinder] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:57.724242 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24987e3-ba0a-44a3-aa33-ec05869b743c service cinder] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:57.724582 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24987e3-ba0a-44a3-aa33-ec05869b743c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:57.726426 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-e24987e3-ba0a-44a3-aa33-ec05869b743c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:57.743702 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a75b09-12c5-433e-b2a2-a1be50cba99a None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:57.747361 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3215e19-1940-48b0-9291-ac0c630e8ed8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d65e731386d44948dcc1ecd40cbda65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:57.748022 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3215e19-1940-48b0-9291-ac0c630e8ed8 service cinder] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:57.748300 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3215e19-1940-48b0-9291-ac0c630e8ed8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:57.748568 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3215e19-1940-48b0-9291-ac0c630e8ed8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:57.786495 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24987e3-ba0a-44a3-aa33-ec05869b743c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:57.787962 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24987e3-ba0a-44a3-aa33-ec05869b743c service cinder] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:57.797570 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1008/2008] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:25:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 09 20:25:57.807949 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3215e19-1940-48b0-9291-ac0c630e8ed8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:57.809427 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3215e19-1940-48b0-9291-ac0c630e8ed8 service cinder] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:57.819135 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1001/2009] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:25:57 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:25:58.387461 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24987e3-ba0a-44a3-aa33-ec05869b743c service cinder] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:58.395691 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24987e3-ba0a-44a3-aa33-ec05869b743c service cinder] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:58.399327 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6206decb-2613-4094-80af-712a10222cd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d65e731386d44948dcc1ecd40cbda65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:58.400000 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6206decb-2613-4094-80af-712a10222cd2 service cinder] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:58.400283 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6206decb-2613-4094-80af-712a10222cd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:58.401281 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6206decb-2613-4094-80af-712a10222cd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:58.403048 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-6206decb-2613-4094-80af-712a10222cd2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:25:58.463624 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6206decb-2613-4094-80af-712a10222cd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:58.465065 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6206decb-2613-4094-80af-712a10222cd2 service cinder] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:58.474377 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1009/2010] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:25:58 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:25:59.333659 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3215e19-1940-48b0-9291-ac0c630e8ed8 service cinder] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:59.342449 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3215e19-1940-48b0-9291-ac0c630e8ed8 service cinder] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:59.346000 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5dec47-546c-4772-b706-528a18cec63b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d65e731386d44948dcc1ecd40cbda65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:59.346621 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5dec47-546c-4772-b706-528a18cec63b service cinder] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:59.346897 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5dec47-546c-4772-b706-528a18cec63b service cinder] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:59.347160 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5dec47-546c-4772-b706-528a18cec63b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:25:59.404562 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5dec47-546c-4772-b706-528a18cec63b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:25:59.405923 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5dec47-546c-4772-b706-528a18cec63b service cinder] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:25:59.415038 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1002/2011] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:25:59 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:25:59.975166 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6206decb-2613-4094-80af-712a10222cd2 service cinder] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:25:59.985867 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6206decb-2613-4094-80af-712a10222cd2 service cinder] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:25:59.990879 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6fe5c3-7948-45f0-ad22-1b13f44e7cff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d65e731386d44948dcc1ecd40cbda65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:25:59.991643 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6fe5c3-7948-45f0-ad22-1b13f44e7cff service cinder] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:25:59.991996 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6fe5c3-7948-45f0-ad22-1b13f44e7cff service cinder] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:25:59.992343 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6fe5c3-7948-45f0-ad22-1b13f44e7cff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:00.002982 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6fe5c3-7948-45f0-ad22-1b13f44e7cff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:00.004826 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6fe5c3-7948-45f0-ad22-1b13f44e7cff service cinder] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:00.017001 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1010/2012] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:25:59 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:26:02.484820 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5dec47-546c-4772-b706-528a18cec63b service cinder] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:02.486262 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-9e5dec47-546c-4772-b706-528a18cec63b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:26:02.561997 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5dec47-546c-4772-b706-528a18cec63b service cinder] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:02.573667 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d251c7-3d1c-4efc-9be6-92b6fb64b27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:02.574763 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d251c7-3d1c-4efc-9be6-92b6fb64b27f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:02.575210 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d251c7-3d1c-4efc-9be6-92b6fb64b27f admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:02.575595 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d251c7-3d1c-4efc-9be6-92b6fb64b27f admin admin] PATH_INFO: `/v3/users/61d7d51e539b45dea8e0b5d60d6ec4e0` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:02.576914 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d251c7-3d1c-4efc-9be6-92b6fb64b27f admin admin] RBAC: Authorizing `identity:delete_user(user_id=61d7d51e539b45dea8e0b5d60d6ec4e0)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:02.579608 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d251c7-3d1c-4efc-9be6-92b6fb64b27f admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:02.629927 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-76d251c7-3d1c-4efc-9be6-92b6fb64b27f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61d7d51e539b45dea8e0b5d60d6ec4e0'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:02.637262 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-76d251c7-3d1c-4efc-9be6-92b6fb64b27f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61d7d51e539b45dea8e0b5d60d6ec4e0'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:02.645071 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-76d251c7-3d1c-4efc-9be6-92b6fb64b27f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61d7d51e539b45dea8e0b5d60d6ec4e0'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:02.645667 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-76d251c7-3d1c-4efc-9be6-92b6fb64b27f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61d7d51e539b45dea8e0b5d60d6ec4e0'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:02.646396 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-76d251c7-3d1c-4efc-9be6-92b6fb64b27f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61d7d51e539b45dea8e0b5d60d6ec4e0'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:02.664611 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1003/2013] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:26:02 2022] DELETE /identity/v3/users/61d7d51e539b45dea8e0b5d60d6ec4e0 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:26:02.669048 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338beec-d4e9-4f7a-a31f-402b97c503cf None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:02.669521 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338beec-d4e9-4f7a-a31f-402b97c503cf None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:02.669738 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338beec-d4e9-4f7a-a31f-402b97c503cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:02.687683 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-4338beec-d4e9-4f7a-a31f-402b97c503cf None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:26:02.688986 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-4338beec-d4e9-4f7a-a31f-402b97c503cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:26:02.753263 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1011/2014] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:26:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:26:02.766632 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d251c7-3d1c-4efc-9be6-92b6fb64b27f admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:02.768119 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-76d251c7-3d1c-4efc-9be6-92b6fb64b27f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:26:02.826371 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d251c7-3d1c-4efc-9be6-92b6fb64b27f admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:02.830717 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffc1a27-f123-47b7-b314-e222237e7a42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:02.831369 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc1a27-f123-47b7-b314-e222237e7a42 service neutron] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:02.831726 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc1a27-f123-47b7-b314-e222237e7a42 service neutron] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:02.831967 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc1a27-f123-47b7-b314-e222237e7a42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:02.842344 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffc1a27-f123-47b7-b314-e222237e7a42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:02.844075 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffc1a27-f123-47b7-b314-e222237e7a42 service neutron] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:02.855485 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1004/2015] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:26:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 09 20:26:03.129358 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4338beec-d4e9-4f7a-a31f-402b97c503cf None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:03.130860 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-4338beec-d4e9-4f7a-a31f-402b97c503cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:26:03.146784 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4338beec-d4e9-4f7a-a31f-402b97c503cf None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:03.152562 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ddd1c-76b7-4963-954f-fb2d42889a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:03.153436 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ddd1c-76b7-4963-954f-fb2d42889a53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:03.153715 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ddd1c-76b7-4963-954f-fb2d42889a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:03.153987 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ddd1c-76b7-4963-954f-fb2d42889a53 admin admin] PATH_INFO: `/v3/projects/f3ef3781704c4c15a667c32c01b3f0af` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:03.155414 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084ddd1c-76b7-4963-954f-fb2d42889a53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3ef3781704c4c15a667c32c01b3f0af)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:03.157590 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084ddd1c-76b7-4963-954f-fb2d42889a53 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:03.206469 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-084ddd1c-76b7-4963-954f-fb2d42889a53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3ef3781704c4c15a667c32c01b3f0af', 'request_id': 'req-084ddd1c-76b7-4963-954f-fb2d42889a53'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:03.212633 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-084ddd1c-76b7-4963-954f-fb2d42889a53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3ef3781704c4c15a667c32c01b3f0af', 'request_id': 'req-084ddd1c-76b7-4963-954f-fb2d42889a53'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:03.218336 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-084ddd1c-76b7-4963-954f-fb2d42889a53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3ef3781704c4c15a667c32c01b3f0af', 'request_id': 'req-084ddd1c-76b7-4963-954f-fb2d42889a53'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:03.230458 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-084ddd1c-76b7-4963-954f-fb2d42889a53 admin admin] The token cache is being invalidate because project f3ef3781704c4c15a667c32c01b3f0af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:26:03.230746 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-084ddd1c-76b7-4963-954f-fb2d42889a53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:03.231489 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-084ddd1c-76b7-4963-954f-fb2d42889a53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:03.233165 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1012/2016] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:26:03 2022] DELETE /identity/v3/projects/f3ef3781704c4c15a667c32c01b3f0af => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:26:03.238960 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffc1a27-f123-47b7-b314-e222237e7a42 service neutron] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:03.249129 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffc1a27-f123-47b7-b314-e222237e7a42 service neutron] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:03.305542 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8d19b0-f5ad-4b60-b5a7-b745a42bfe52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:03.307074 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8d19b0-f5ad-4b60-b5a7-b745a42bfe52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:03.307237 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8d19b0-f5ad-4b60-b5a7-b745a42bfe52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:03.307517 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8d19b0-f5ad-4b60-b5a7-b745a42bfe52 admin admin] PATH_INFO: `/v3/users/432816c480e04d1194e84bb777c2a409` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:03.308855 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8d19b0-f5ad-4b60-b5a7-b745a42bfe52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=432816c480e04d1194e84bb777c2a409)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:03.310999 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8d19b0-f5ad-4b60-b5a7-b745a42bfe52 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:03.360666 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-8a8d19b0-f5ad-4b60-b5a7-b745a42bfe52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '432816c480e04d1194e84bb777c2a409'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:03.370853 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-8a8d19b0-f5ad-4b60-b5a7-b745a42bfe52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '432816c480e04d1194e84bb777c2a409'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:03.380543 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-8a8d19b0-f5ad-4b60-b5a7-b745a42bfe52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '432816c480e04d1194e84bb777c2a409'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:03.381146 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-8a8d19b0-f5ad-4b60-b5a7-b745a42bfe52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '432816c480e04d1194e84bb777c2a409'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:03.381750 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-8a8d19b0-f5ad-4b60-b5a7-b745a42bfe52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '432816c480e04d1194e84bb777c2a409'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:03.403501 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1005/2017] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:26:03 2022] DELETE /identity/v3/users/432816c480e04d1194e84bb777c2a409 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:26:03.781976 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ddd1c-76b7-4963-954f-fb2d42889a53 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:03.783662 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-084ddd1c-76b7-4963-954f-fb2d42889a53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:26:03.801542 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ddd1c-76b7-4963-954f-fb2d42889a53 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:03.864764 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b1decc-0258-4eed-ba84-980f051abe80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:03.864764 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1decc-0258-4eed-ba84-980f051abe80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:03.864764 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1decc-0258-4eed-ba84-980f051abe80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:03.864764 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1decc-0258-4eed-ba84-980f051abe80 admin admin] PATH_INFO: `/v3/projects/947a40c866974d819e7bc1335be68271` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:03.865794 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b1decc-0258-4eed-ba84-980f051abe80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=947a40c866974d819e7bc1335be68271)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:03.867760 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b1decc-0258-4eed-ba84-980f051abe80 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:03.919349 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-53b1decc-0258-4eed-ba84-980f051abe80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '947a40c866974d819e7bc1335be68271', 'request_id': 'req-53b1decc-0258-4eed-ba84-980f051abe80'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:03.925794 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-53b1decc-0258-4eed-ba84-980f051abe80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '947a40c866974d819e7bc1335be68271', 'request_id': 'req-53b1decc-0258-4eed-ba84-980f051abe80'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:03.934734 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-53b1decc-0258-4eed-ba84-980f051abe80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '947a40c866974d819e7bc1335be68271', 'request_id': 'req-53b1decc-0258-4eed-ba84-980f051abe80'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:03.948392 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-53b1decc-0258-4eed-ba84-980f051abe80 admin admin] The token cache is being invalidate because project 947a40c866974d819e7bc1335be68271 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:26:03.948687 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-53b1decc-0258-4eed-ba84-980f051abe80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:03.949524 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-53b1decc-0258-4eed-ba84-980f051abe80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:03.952705 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1013/2018] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:26:03 2022] DELETE /identity/v3/projects/947a40c866974d819e7bc1335be68271 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:26:03.956378 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8d19b0-f5ad-4b60-b5a7-b745a42bfe52 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:03.957764 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-8a8d19b0-f5ad-4b60-b5a7-b745a42bfe52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:26:03.976770 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8d19b0-f5ad-4b60-b5a7-b745a42bfe52 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:03.989684 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b1decc-0258-4eed-ba84-980f051abe80 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:03.991069 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-53b1decc-0258-4eed-ba84-980f051abe80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:26:04.050570 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2061b4f5-65fb-4269-821f-68728f6025f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:04.051460 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061b4f5-65fb-4269-821f-68728f6025f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:04.051742 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061b4f5-65fb-4269-821f-68728f6025f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:04.052010 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061b4f5-65fb-4269-821f-68728f6025f9 admin admin] PATH_INFO: `/v3/users/c951ce5cf2e94593a4759b7731d198f1` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:04.053204 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2061b4f5-65fb-4269-821f-68728f6025f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c951ce5cf2e94593a4759b7731d198f1)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:04.055147 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2061b4f5-65fb-4269-821f-68728f6025f9 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:04.069386 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b1decc-0258-4eed-ba84-980f051abe80 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:04.075439 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa3070-ef2b-40db-8167-4e0fb196e79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:04.076343 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa3070-ef2b-40db-8167-4e0fb196e79a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:04.076659 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa3070-ef2b-40db-8167-4e0fb196e79a admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:04.076938 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa3070-ef2b-40db-8167-4e0fb196e79a admin admin] PATH_INFO: `/v3/users/18d17a4a83584496b50c9a4dcd125e2c` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:04.078153 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aa3070-ef2b-40db-8167-4e0fb196e79a admin admin] RBAC: Authorizing `identity:delete_user(user_id=18d17a4a83584496b50c9a4dcd125e2c)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:04.080290 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aa3070-ef2b-40db-8167-4e0fb196e79a admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:04.102936 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-2061b4f5-65fb-4269-821f-68728f6025f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c951ce5cf2e94593a4759b7731d198f1'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:04.112351 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-2061b4f5-65fb-4269-821f-68728f6025f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c951ce5cf2e94593a4759b7731d198f1'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:04.120086 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-2061b4f5-65fb-4269-821f-68728f6025f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c951ce5cf2e94593a4759b7731d198f1'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:04.121051 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-2061b4f5-65fb-4269-821f-68728f6025f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c951ce5cf2e94593a4759b7731d198f1'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:04.121532 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-2061b4f5-65fb-4269-821f-68728f6025f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c951ce5cf2e94593a4759b7731d198f1'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:04.132439 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-89aa3070-ef2b-40db-8167-4e0fb196e79a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18d17a4a83584496b50c9a4dcd125e2c'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:04.133097 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-89aa3070-ef2b-40db-8167-4e0fb196e79a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18d17a4a83584496b50c9a4dcd125e2c'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:04.140311 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1006/2019] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:26:03 2022] DELETE /identity/v3/users/c951ce5cf2e94593a4759b7731d198f1 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:26:04.141006 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2061b4f5-65fb-4269-821f-68728f6025f9 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:04.142386 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-2061b4f5-65fb-4269-821f-68728f6025f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:26:04.144358 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-89aa3070-ef2b-40db-8167-4e0fb196e79a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18d17a4a83584496b50c9a4dcd125e2c'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:04.145112 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-89aa3070-ef2b-40db-8167-4e0fb196e79a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18d17a4a83584496b50c9a4dcd125e2c'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:04.153473 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-89aa3070-ef2b-40db-8167-4e0fb196e79a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18d17a4a83584496b50c9a4dcd125e2c'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:04.173575 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1014/2020] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:26:03 2022] DELETE /identity/v3/users/18d17a4a83584496b50c9a4dcd125e2c => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:26:04.178280 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91f49a7-9bbd-4334-bf7a-0ecdbeee4956 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:04.178280 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91f49a7-9bbd-4334-bf7a-0ecdbeee4956 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:04.178508 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91f49a7-9bbd-4334-bf7a-0ecdbeee4956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:04.197081 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-d91f49a7-9bbd-4334-bf7a-0ecdbeee4956 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:26:04.198885 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-d91f49a7-9bbd-4334-bf7a-0ecdbeee4956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:26:04.210272 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2061b4f5-65fb-4269-821f-68728f6025f9 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:04.266648 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1015/2021] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:26:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:26:04.280396 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91f49a7-9bbd-4334-bf7a-0ecdbeee4956 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:04.281947 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-d91f49a7-9bbd-4334-bf7a-0ecdbeee4956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:26:04.282218 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44382496-233a-48d3-ab3b-7ab4ed879c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:04.283079 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44382496-233a-48d3-ab3b-7ab4ed879c1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:04.283483 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44382496-233a-48d3-ab3b-7ab4ed879c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:04.283766 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44382496-233a-48d3-ab3b-7ab4ed879c1b admin admin] PATH_INFO: `/v3/users/c6ed7ee782974e199e6202aca7b6e9e3` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:04.285042 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44382496-233a-48d3-ab3b-7ab4ed879c1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6ed7ee782974e199e6202aca7b6e9e3)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:04.287080 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44382496-233a-48d3-ab3b-7ab4ed879c1b admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:04.342950 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-44382496-233a-48d3-ab3b-7ab4ed879c1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6ed7ee782974e199e6202aca7b6e9e3'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:04.351042 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91f49a7-9bbd-4334-bf7a-0ecdbeee4956 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:04.352641 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-44382496-233a-48d3-ab3b-7ab4ed879c1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6ed7ee782974e199e6202aca7b6e9e3'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:04.358461 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f57aaf-2f3e-42df-b718-fd93842bbb27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:04.359139 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f57aaf-2f3e-42df-b718-fd93842bbb27 service neutron] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:04.359520 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f57aaf-2f3e-42df-b718-fd93842bbb27 service neutron] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:04.359850 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f57aaf-2f3e-42df-b718-fd93842bbb27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:04.362707 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-44382496-233a-48d3-ab3b-7ab4ed879c1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6ed7ee782974e199e6202aca7b6e9e3'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:04.363672 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-44382496-233a-48d3-ab3b-7ab4ed879c1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6ed7ee782974e199e6202aca7b6e9e3'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:04.364234 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-44382496-233a-48d3-ab3b-7ab4ed879c1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6ed7ee782974e199e6202aca7b6e9e3'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:04.370487 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f57aaf-2f3e-42df-b718-fd93842bbb27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:04.371971 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f57aaf-2f3e-42df-b718-fd93842bbb27 service neutron] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:04.382369 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1016/2022] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:26:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 09 20:26:04.383292 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1007/2023] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:26:04 2022] DELETE /identity/v3/users/c6ed7ee782974e199e6202aca7b6e9e3 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:26:04.531902 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f57aaf-2f3e-42df-b718-fd93842bbb27 service neutron] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:04.534899 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-29f57aaf-2f3e-42df-b718-fd93842bbb27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:26:04.587347 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f57aaf-2f3e-42df-b718-fd93842bbb27 service neutron] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:04.612344 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44382496-233a-48d3-ab3b-7ab4ed879c1b admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:04.613779 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-44382496-233a-48d3-ab3b-7ab4ed879c1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:26:04.663540 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfec6e57-cde3-4239-bd62-f3e7e82386a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:04.664411 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec6e57-cde3-4239-bd62-f3e7e82386a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:04.664688 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec6e57-cde3-4239-bd62-f3e7e82386a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:04.664947 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec6e57-cde3-4239-bd62-f3e7e82386a1 admin admin] PATH_INFO: `/v3/projects/c24a69c1600d4366bf73394fc1e6ff53` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:04.666373 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfec6e57-cde3-4239-bd62-f3e7e82386a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c24a69c1600d4366bf73394fc1e6ff53)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:04.668464 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfec6e57-cde3-4239-bd62-f3e7e82386a1 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:04.705161 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44382496-233a-48d3-ab3b-7ab4ed879c1b admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:04.723668 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-bfec6e57-cde3-4239-bd62-f3e7e82386a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c24a69c1600d4366bf73394fc1e6ff53', 'request_id': 'req-bfec6e57-cde3-4239-bd62-f3e7e82386a1'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:04.733564 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-bfec6e57-cde3-4239-bd62-f3e7e82386a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c24a69c1600d4366bf73394fc1e6ff53', 'request_id': 'req-bfec6e57-cde3-4239-bd62-f3e7e82386a1'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:04.740362 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-bfec6e57-cde3-4239-bd62-f3e7e82386a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c24a69c1600d4366bf73394fc1e6ff53', 'request_id': 'req-bfec6e57-cde3-4239-bd62-f3e7e82386a1'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:04.769786 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-bfec6e57-cde3-4239-bd62-f3e7e82386a1 admin admin] The token cache is being invalidate because project c24a69c1600d4366bf73394fc1e6ff53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:26:04.770103 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-bfec6e57-cde3-4239-bd62-f3e7e82386a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:04.770915 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-bfec6e57-cde3-4239-bd62-f3e7e82386a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:04.772535 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342552f3-6104-4105-9b40-2999231e8b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:04.773112 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1017/2024] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:26:04 2022] DELETE /identity/v3/projects/c24a69c1600d4366bf73394fc1e6ff53 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:26:04.773501 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342552f3-6104-4105-9b40-2999231e8b3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:04.773843 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342552f3-6104-4105-9b40-2999231e8b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:04.774116 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342552f3-6104-4105-9b40-2999231e8b3d admin admin] PATH_INFO: `/v3/projects/b9825a892fe14e409eb97a504d3c8b92` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:04.775874 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342552f3-6104-4105-9b40-2999231e8b3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9825a892fe14e409eb97a504d3c8b92)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:04.778164 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342552f3-6104-4105-9b40-2999231e8b3d admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:04.779439 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4973276-4f5e-4ac7-9f0c-b8721006ab9c None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:04.779794 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4973276-4f5e-4ac7-9f0c-b8721006ab9c None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:04.780076 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4973276-4f5e-4ac7-9f0c-b8721006ab9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:04.807869 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-c4973276-4f5e-4ac7-9f0c-b8721006ab9c None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:26:04.809543 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-c4973276-4f5e-4ac7-9f0c-b8721006ab9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:26:04.820893 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1018/2025] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:26:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:26:04.828307 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4973276-4f5e-4ac7-9f0c-b8721006ab9c None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:04.828307 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-c4973276-4f5e-4ac7-9f0c-b8721006ab9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:26:04.841681 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4973276-4f5e-4ac7-9f0c-b8721006ab9c None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:04.841982 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-342552f3-6104-4105-9b40-2999231e8b3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9825a892fe14e409eb97a504d3c8b92', 'request_id': 'req-342552f3-6104-4105-9b40-2999231e8b3d'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:04.849935 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-342552f3-6104-4105-9b40-2999231e8b3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9825a892fe14e409eb97a504d3c8b92', 'request_id': 'req-342552f3-6104-4105-9b40-2999231e8b3d'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:04.855917 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-342552f3-6104-4105-9b40-2999231e8b3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9825a892fe14e409eb97a504d3c8b92', 'request_id': 'req-342552f3-6104-4105-9b40-2999231e8b3d'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:04.873368 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-342552f3-6104-4105-9b40-2999231e8b3d admin admin] The token cache is being invalidate because project b9825a892fe14e409eb97a504d3c8b92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:26:04.873649 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-342552f3-6104-4105-9b40-2999231e8b3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:04.874284 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-342552f3-6104-4105-9b40-2999231e8b3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:04.876220 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1008/2026] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:26:04 2022] DELETE /identity/v3/projects/b9825a892fe14e409eb97a504d3c8b92 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:26:04.877811 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e144559-cdff-4195-a41a-4275a7f0d2e2 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:04.877938 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e144559-cdff-4195-a41a-4275a7f0d2e2 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:04.878175 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e144559-cdff-4195-a41a-4275a7f0d2e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:04.898266 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-7e144559-cdff-4195-a41a-4275a7f0d2e2 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:26:04.899800 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-7e144559-cdff-4195-a41a-4275a7f0d2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:26:04.911155 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e87a59-edda-48a0-8bb3-98ca47897b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:04.912249 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e87a59-edda-48a0-8bb3-98ca47897b48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:04.912689 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e87a59-edda-48a0-8bb3-98ca47897b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:04.913109 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e87a59-edda-48a0-8bb3-98ca47897b48 admin admin] PATH_INFO: `/v3/projects/eba30264aaa040bd81db11c5d63462ea` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:04.914463 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e87a59-edda-48a0-8bb3-98ca47897b48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eba30264aaa040bd81db11c5d63462ea)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:04.916783 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e87a59-edda-48a0-8bb3-98ca47897b48 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:04.964448 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1009/2027] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:26:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:26:04.964983 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-e9e87a59-edda-48a0-8bb3-98ca47897b48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eba30264aaa040bd81db11c5d63462ea', 'request_id': 'req-e9e87a59-edda-48a0-8bb3-98ca47897b48'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:04.965802 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fcc52b-0b88-4c97-b424-d3f5fb09f630 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:04.966087 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fcc52b-0b88-4c97-b424-d3f5fb09f630 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:04.966352 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fcc52b-0b88-4c97-b424-d3f5fb09f630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:04.971071 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-e9e87a59-edda-48a0-8bb3-98ca47897b48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eba30264aaa040bd81db11c5d63462ea', 'request_id': 'req-e9e87a59-edda-48a0-8bb3-98ca47897b48'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:04.976907 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-e9e87a59-edda-48a0-8bb3-98ca47897b48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eba30264aaa040bd81db11c5d63462ea', 'request_id': 'req-e9e87a59-edda-48a0-8bb3-98ca47897b48'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:04.985755 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-b8fcc52b-0b88-4c97-b424-d3f5fb09f630 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:26:04.986393 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-b8fcc52b-0b88-4c97-b424-d3f5fb09f630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:26:04.989999 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-e9e87a59-edda-48a0-8bb3-98ca47897b48 admin admin] The token cache is being invalidate because project eba30264aaa040bd81db11c5d63462ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:26:04.990283 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-e9e87a59-edda-48a0-8bb3-98ca47897b48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:04.990926 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-e9e87a59-edda-48a0-8bb3-98ca47897b48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:04.992762 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1019/2028] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:26:04 2022] DELETE /identity/v3/projects/eba30264aaa040bd81db11c5d63462ea => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:26:04.993453 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e87a59-edda-48a0-8bb3-98ca47897b48 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:04.995683 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-e9e87a59-edda-48a0-8bb3-98ca47897b48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:26:05.053685 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1010/2029] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:26:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:26:05.054528 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fcc52b-0b88-4c97-b424-d3f5fb09f630 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:05.061994 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-b8fcc52b-0b88-4c97-b424-d3f5fb09f630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:26:05.067187 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e87a59-edda-48a0-8bb3-98ca47897b48 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:05.072248 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b0540-734a-43bf-bd00-fd89fdb944f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:05.072997 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b0540-734a-43bf-bd00-fd89fdb944f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:05.073325 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b0540-734a-43bf-bd00-fd89fdb944f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:05.073597 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b0540-734a-43bf-bd00-fd89fdb944f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:05.073739 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fcc52b-0b88-4c97-b424-d3f5fb09f630 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:05.074377 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5b0540-734a-43bf-bd00-fd89fdb944f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:26:05.074712 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5b0540-734a-43bf-bd00-fd89fdb944f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:05.076375 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5b0540-734a-43bf-bd00-fd89fdb944f6 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:05.078550 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbba163-218f-4412-b908-40337171ede5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:05.079458 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbba163-218f-4412-b908-40337171ede5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:05.079736 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbba163-218f-4412-b908-40337171ede5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:05.080003 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbba163-218f-4412-b908-40337171ede5 admin admin] PATH_INFO: `/v3/users/20c3a840fc59442c98f0617bb73fda64` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:05.081185 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbba163-218f-4412-b908-40337171ede5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20c3a840fc59442c98f0617bb73fda64)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:05.083215 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbba163-218f-4412-b908-40337171ede5 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:05.089362 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1020/2030] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 9 20:26:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:26:05.090891 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7598018a-48d9-485f-bd27-f4ceb5244a18 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:05.091274 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7598018a-48d9-485f-bd27-f4ceb5244a18 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:05.091582 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7598018a-48d9-485f-bd27-f4ceb5244a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:05.112329 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-7598018a-48d9-485f-bd27-f4ceb5244a18 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:26:05.113449 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-7598018a-48d9-485f-bd27-f4ceb5244a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:26:05.122140 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1021/2031] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:26:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:26:05.123135 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7598018a-48d9-485f-bd27-f4ceb5244a18 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:05.137156 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7598018a-48d9-485f-bd27-f4ceb5244a18 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:05.137504 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-bdbba163-218f-4412-b908-40337171ede5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20c3a840fc59442c98f0617bb73fda64'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:05.142437 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b395e0-3643-4e0e-add3-4414791257f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:05.143186 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b395e0-3643-4e0e-add3-4414791257f7 admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:05.143604 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b395e0-3643-4e0e-add3-4414791257f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:05.143885 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b395e0-3643-4e0e-add3-4414791257f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:05.144573 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b395e0-3643-4e0e-add3-4414791257f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:05.144810 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-bdbba163-218f-4412-b908-40337171ede5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20c3a840fc59442c98f0617bb73fda64'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:05.146567 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b395e0-3643-4e0e-add3-4414791257f7 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:05.153424 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-bdbba163-218f-4412-b908-40337171ede5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20c3a840fc59442c98f0617bb73fda64'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:05.154056 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-bdbba163-218f-4412-b908-40337171ede5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20c3a840fc59442c98f0617bb73fda64'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:05.154699 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-bdbba163-218f-4412-b908-40337171ede5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20c3a840fc59442c98f0617bb73fda64'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:05.176017 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1022/2032] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:26:05 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:26:05.176218 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1011/2033] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:26:05 2022] DELETE /identity/v3/users/20c3a840fc59442c98f0617bb73fda64 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:26:05.176313 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b395e0-3643-4e0e-add3-4414791257f7 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:05.177094 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbba163-218f-4412-b908-40337171ede5 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:05.177902 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-a6b395e0-3643-4e0e-add3-4414791257f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:26:05.178474 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-bdbba163-218f-4412-b908-40337171ede5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:26:05.251050 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b395e0-3643-4e0e-add3-4414791257f7 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:05.254910 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbba163-218f-4412-b908-40337171ede5 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:05.260495 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d886b75d-3b43-43ed-a42e-3db6a8110438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:05.261739 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d886b75d-3b43-43ed-a42e-3db6a8110438 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:05.262101 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d886b75d-3b43-43ed-a42e-3db6a8110438 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:05.262351 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d886b75d-3b43-43ed-a42e-3db6a8110438 admin admin] PATH_INFO: `/v3/domains` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:05.263254 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d886b75d-3b43-43ed-a42e-3db6a8110438 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:26:05.263359 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d89702-7940-4290-8aa5-a123f308e90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:05.263617 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d886b75d-3b43-43ed-a42e-3db6a8110438 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:05.264196 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d89702-7940-4290-8aa5-a123f308e90d admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:05.264322 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d89702-7940-4290-8aa5-a123f308e90d admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:05.264647 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d89702-7940-4290-8aa5-a123f308e90d admin admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:05.265215 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d886b75d-3b43-43ed-a42e-3db6a8110438 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:05.265394 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d89702-7940-4290-8aa5-a123f308e90d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:05.267314 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d89702-7940-4290-8aa5-a123f308e90d admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:05.281924 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1023/2034] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 9 20:26:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:26:05.283380 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d886b75d-3b43-43ed-a42e-3db6a8110438 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:05.294840 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d886b75d-3b43-43ed-a42e-3db6a8110438 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:05.295251 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1012/2035] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:26:05 2022] POST /identity/v3/users => generated 293 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 20:26:05.299368 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d89702-7940-4290-8aa5-a123f308e90d admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:05.300063 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66020ff1-bc92-4731-be7d-f1abf52f9da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:05.300741 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66020ff1-bc92-4731-be7d-f1abf52f9da7 admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:05.301012 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66020ff1-bc92-4731-be7d-f1abf52f9da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:05.301284 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66020ff1-bc92-4731-be7d-f1abf52f9da7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:05.301976 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66020ff1-bc92-4731-be7d-f1abf52f9da7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:05.304039 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66020ff1-bc92-4731-be7d-f1abf52f9da7 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:05.310836 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d89702-7940-4290-8aa5-a123f308e90d admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:05.322764 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7486a5d3-c817-4593-8695-ef30a25cf2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:05.324047 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7486a5d3-c817-4593-8695-ef30a25cf2df admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:05.324371 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7486a5d3-c817-4593-8695-ef30a25cf2df admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:05.324647 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7486a5d3-c817-4593-8695-ef30a25cf2df admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:05.325402 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7486a5d3-c817-4593-8695-ef30a25cf2df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:05.327587 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7486a5d3-c817-4593-8695-ef30a25cf2df admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:05.333731 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1024/2036] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:26:05 2022] POST /identity/v3/projects => generated 367 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 20:26:05.338108 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66020ff1-bc92-4731-be7d-f1abf52f9da7 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:05.347347 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1013/2037] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:26:05 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 09 20:26:05.348759 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7486a5d3-c817-4593-8695-ef30a25cf2df admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:05.364373 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7486a5d3-c817-4593-8695-ef30a25cf2df admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:05.417814 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66020ff1-bc92-4731-be7d-f1abf52f9da7 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:05.422811 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7f70aa-ecea-4a94-bf9a-b3c1cb47622a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:05.423567 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f70aa-ecea-4a94-bf9a-b3c1cb47622a admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:05.423856 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f70aa-ecea-4a94-bf9a-b3c1cb47622a admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:05.424131 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f70aa-ecea-4a94-bf9a-b3c1cb47622a admin admin] PATH_INFO: `/v3/users` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:05.424828 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7f70aa-ecea-4a94-bf9a-b3c1cb47622a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:05.426947 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7f70aa-ecea-4a94-bf9a-b3c1cb47622a admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:05.428401 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141c1f4e-d780-4a2d-867d-506f19c7deb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:05.429079 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141c1f4e-d780-4a2d-867d-506f19c7deb9 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:05.429359 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141c1f4e-d780-4a2d-867d-506f19c7deb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:05.429626 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141c1f4e-d780-4a2d-867d-506f19c7deb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:05.430347 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141c1f4e-d780-4a2d-867d-506f19c7deb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:05.432532 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141c1f4e-d780-4a2d-867d-506f19c7deb9 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:05.447434 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1014/2038] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:26:05 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:26:05.449215 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141c1f4e-d780-4a2d-867d-506f19c7deb9 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:05.453399 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1025/2039] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:26:05 2022] POST /identity/v3/users => generated 284 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:26:05.457313 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7f70aa-ecea-4a94-bf9a-b3c1cb47622a admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:05.461132 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141c1f4e-d780-4a2d-867d-506f19c7deb9 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:05.468643 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0ca3b2-68e9-4506-a69d-e5aba911514f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:05.470303 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ca3b2-68e9-4506-a69d-e5aba911514f admin admin] REQUEST_METHOD: `PUT` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:05.470670 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ca3b2-68e9-4506-a69d-e5aba911514f admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:05.471089 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ca3b2-68e9-4506-a69d-e5aba911514f admin admin] PATH_INFO: `/v3/projects/d73d90ae96e544949864cc805763f040/users/271d2631fec84b269ade9fcdb840dcb9/roles/79f90a0bf6ea43d0b3c434e31556253a` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:05.471228 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7f70aa-ecea-4a94-bf9a-b3c1cb47622a admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:05.480572 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d9c320-7802-48be-bb97-195a75642ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:05.480572 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9c320-7802-48be-bb97-195a75642ac6 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:05.481060 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9c320-7802-48be-bb97-195a75642ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:05.481336 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9c320-7802-48be-bb97-195a75642ac6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:05.482082 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d9c320-7802-48be-bb97-195a75642ac6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:05.483783 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d9c320-7802-48be-bb97-195a75642ac6 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:05.489217 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0ca3b2-68e9-4506-a69d-e5aba911514f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d73d90ae96e544949864cc805763f040, user_id=271d2631fec84b269ade9fcdb840dcb9, role_id=79f90a0bf6ea43d0b3c434e31556253a)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:05.492995 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0ca3b2-68e9-4506-a69d-e5aba911514f admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:05.495876 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1026/2040] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:26:05 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 09 20:26:05.499909 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d9c320-7802-48be-bb97-195a75642ac6 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:05.520358 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1015/2041] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:26:05 2022] PUT /identity/v3/projects/d73d90ae96e544949864cc805763f040/users/271d2631fec84b269ade9fcdb840dcb9/roles/79f90a0bf6ea43d0b3c434e31556253a => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:26:05.520571 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d9c320-7802-48be-bb97-195a75642ac6 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:05.524858 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d26e8-3147-488c-8792-de8ac786dc38 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:05.525169 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d26e8-3147-488c-8792-de8ac786dc38 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:05.526043 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d26e8-3147-488c-8792-de8ac786dc38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:05.562961 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-653d26e8-3147-488c-8792-de8ac786dc38 None None] MFA Rules not processed for user `271d2631fec84b269ade9fcdb840dcb9`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:26:05.565209 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-653d26e8-3147-488c-8792-de8ac786dc38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:26:05.593243 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd399990-e5b2-4daf-b276-304f39b0984a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:05.594046 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd399990-e5b2-4daf-b276-304f39b0984a admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:05.594373 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd399990-e5b2-4daf-b276-304f39b0984a admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:05.594860 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd399990-e5b2-4daf-b276-304f39b0984a admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:05.595436 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd399990-e5b2-4daf-b276-304f39b0984a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:05.597231 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd399990-e5b2-4daf-b276-304f39b0984a admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:05.617360 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1027/2042] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:26:05 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 09 20:26:05.618023 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd399990-e5b2-4daf-b276-304f39b0984a admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:05.629435 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd399990-e5b2-4daf-b276-304f39b0984a admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:05.634476 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed554d4-fee5-4916-9b3d-8d668a9dc632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:05.635893 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed554d4-fee5-4916-9b3d-8d668a9dc632 admin admin] REQUEST_METHOD: `PUT` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:05.636280 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed554d4-fee5-4916-9b3d-8d668a9dc632 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:05.636909 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed554d4-fee5-4916-9b3d-8d668a9dc632 admin admin] PATH_INFO: `/v3/projects/2890140c65fd4f859f624db92785f3be/users/37848306f5c3444db3522e235e76a8b7/roles/79f90a0bf6ea43d0b3c434e31556253a` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:05.654332 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1016/2043] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:26:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:26:05.662024 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653d26e8-3147-488c-8792-de8ac786dc38 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:05.663501 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-653d26e8-3147-488c-8792-de8ac786dc38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:26:05.663599 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed554d4-fee5-4916-9b3d-8d668a9dc632 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2890140c65fd4f859f624db92785f3be, user_id=37848306f5c3444db3522e235e76a8b7, role_id=79f90a0bf6ea43d0b3c434e31556253a)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:05.666853 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed554d4-fee5-4916-9b3d-8d668a9dc632 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:05.685212 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1028/2044] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:26:05 2022] PUT /identity/v3/projects/2890140c65fd4f859f624db92785f3be/users/37848306f5c3444db3522e235e76a8b7/roles/79f90a0bf6ea43d0b3c434e31556253a => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:26:05.696256 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9847aa2-0809-4441-8693-6e9138526b0a None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:05.696533 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9847aa2-0809-4441-8693-6e9138526b0a None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:05.696803 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9847aa2-0809-4441-8693-6e9138526b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:05.729521 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-d9847aa2-0809-4441-8693-6e9138526b0a None None] MFA Rules not processed for user `37848306f5c3444db3522e235e76a8b7`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:26:05.731056 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-d9847aa2-0809-4441-8693-6e9138526b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:26:05.734112 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653d26e8-3147-488c-8792-de8ac786dc38 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:05.796908 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc3d07a-5d2e-4a9e-98f8-92ccb94e0ad9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d65e731386d44948dcc1ecd40cbda65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:05.797655 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc3d07a-5d2e-4a9e-98f8-92ccb94e0ad9 service cinder] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:05.797862 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc3d07a-5d2e-4a9e-98f8-92ccb94e0ad9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:05.798132 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc3d07a-5d2e-4a9e-98f8-92ccb94e0ad9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:05.808852 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1029/2045] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:26:05 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:26:05.809705 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9847aa2-0809-4441-8693-6e9138526b0a None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:05.811168 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-d9847aa2-0809-4441-8693-6e9138526b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:26:05.860967 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc3d07a-5d2e-4a9e-98f8-92ccb94e0ad9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:05.862642 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc3d07a-5d2e-4a9e-98f8-92ccb94e0ad9 service cinder] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:05.872498 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1017/2046] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:26:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 09 20:26:05.873486 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc3d07a-5d2e-4a9e-98f8-92ccb94e0ad9 service cinder] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:05.874841 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-0cc3d07a-5d2e-4a9e-98f8-92ccb94e0ad9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:26:05.876931 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9847aa2-0809-4441-8693-6e9138526b0a None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:05.881650 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da121788-5942-4fde-9bd0-120c44e127b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:05.882630 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da121788-5942-4fde-9bd0-120c44e127b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:05.882748 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da121788-5942-4fde-9bd0-120c44e127b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:05.883014 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da121788-5942-4fde-9bd0-120c44e127b3 admin admin] PATH_INFO: `/v3/projects/c3bff9cee9564dba9ebfa1511686ab3f` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:05.884261 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da121788-5942-4fde-9bd0-120c44e127b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3bff9cee9564dba9ebfa1511686ab3f)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:05.887116 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da121788-5942-4fde-9bd0-120c44e127b3 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:05.887330 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc3d07a-5d2e-4a9e-98f8-92ccb94e0ad9 service cinder] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:05.892613 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22692f0f-ad47-4405-addf-9fe049152d37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d65e731386d44948dcc1ecd40cbda65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:05.893095 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22692f0f-ad47-4405-addf-9fe049152d37 service cinder] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:05.893483 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22692f0f-ad47-4405-addf-9fe049152d37 service cinder] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:05.894115 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22692f0f-ad47-4405-addf-9fe049152d37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:05.904910 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22692f0f-ad47-4405-addf-9fe049152d37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:05.906450 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22692f0f-ad47-4405-addf-9fe049152d37 service cinder] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:05.915836 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1018/2047] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:26:05 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:26:05.954561 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-da121788-5942-4fde-9bd0-120c44e127b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3bff9cee9564dba9ebfa1511686ab3f', 'request_id': 'req-da121788-5942-4fde-9bd0-120c44e127b3'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:05.961536 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-da121788-5942-4fde-9bd0-120c44e127b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3bff9cee9564dba9ebfa1511686ab3f', 'request_id': 'req-da121788-5942-4fde-9bd0-120c44e127b3'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:05.968852 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-da121788-5942-4fde-9bd0-120c44e127b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3bff9cee9564dba9ebfa1511686ab3f', 'request_id': 'req-da121788-5942-4fde-9bd0-120c44e127b3'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:05.988385 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-da121788-5942-4fde-9bd0-120c44e127b3 admin admin] The token cache is being invalidate because project c3bff9cee9564dba9ebfa1511686ab3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:26:05.988671 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-da121788-5942-4fde-9bd0-120c44e127b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:05.989336 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-da121788-5942-4fde-9bd0-120c44e127b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:05.995215 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1030/2048] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:26:05 2022] DELETE /identity/v3/projects/c3bff9cee9564dba9ebfa1511686ab3f => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:26:05.996407 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22692f0f-ad47-4405-addf-9fe049152d37 service cinder] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:06.011881 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22692f0f-ad47-4405-addf-9fe049152d37 service cinder] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:06.099596 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677ca2f2-7d59-4865-bbfd-365e5c59667d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:06.100547 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ca2f2-7d59-4865-bbfd-365e5c59667d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:06.100891 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ca2f2-7d59-4865-bbfd-365e5c59667d admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:06.101168 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ca2f2-7d59-4865-bbfd-365e5c59667d admin admin] PATH_INFO: `/v3/users/431bbe72a418436cbabe9c516f14bb47` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:06.102531 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677ca2f2-7d59-4865-bbfd-365e5c59667d admin admin] RBAC: Authorizing `identity:delete_user(user_id=431bbe72a418436cbabe9c516f14bb47)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:06.105173 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677ca2f2-7d59-4865-bbfd-365e5c59667d admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:06.170355 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-677ca2f2-7d59-4865-bbfd-365e5c59667d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '431bbe72a418436cbabe9c516f14bb47'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:06.179999 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-677ca2f2-7d59-4865-bbfd-365e5c59667d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '431bbe72a418436cbabe9c516f14bb47'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:06.192506 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-677ca2f2-7d59-4865-bbfd-365e5c59667d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '431bbe72a418436cbabe9c516f14bb47'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:06.193487 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-677ca2f2-7d59-4865-bbfd-365e5c59667d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '431bbe72a418436cbabe9c516f14bb47'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:06.194313 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-677ca2f2-7d59-4865-bbfd-365e5c59667d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '431bbe72a418436cbabe9c516f14bb47'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:06.234395 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1019/2049] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:26:05 2022] DELETE /identity/v3/users/431bbe72a418436cbabe9c516f14bb47 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:26:06.525603 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da121788-5942-4fde-9bd0-120c44e127b3 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:06.527273 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-da121788-5942-4fde-9bd0-120c44e127b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:26:06.540756 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da121788-5942-4fde-9bd0-120c44e127b3 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:06.610107 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f9694a-4103-40a5-abc3-39e856b318ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:06.610992 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9694a-4103-40a5-abc3-39e856b318ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:06.611273 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9694a-4103-40a5-abc3-39e856b318ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:06.611580 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9694a-4103-40a5-abc3-39e856b318ac admin admin] PATH_INFO: `/v3/projects/48a552b764c243149e02e857ce99411b` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:06.612793 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f9694a-4103-40a5-abc3-39e856b318ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=48a552b764c243149e02e857ce99411b)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:06.614736 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f9694a-4103-40a5-abc3-39e856b318ac admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:06.663018 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-85f9694a-4103-40a5-abc3-39e856b318ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48a552b764c243149e02e857ce99411b', 'request_id': 'req-85f9694a-4103-40a5-abc3-39e856b318ac'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:06.669614 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-85f9694a-4103-40a5-abc3-39e856b318ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48a552b764c243149e02e857ce99411b', 'request_id': 'req-85f9694a-4103-40a5-abc3-39e856b318ac'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:06.674693 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-85f9694a-4103-40a5-abc3-39e856b318ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48a552b764c243149e02e857ce99411b', 'request_id': 'req-85f9694a-4103-40a5-abc3-39e856b318ac'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:06.687215 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-85f9694a-4103-40a5-abc3-39e856b318ac admin admin] The token cache is being invalidate because project 48a552b764c243149e02e857ce99411b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:26:06.687595 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-85f9694a-4103-40a5-abc3-39e856b318ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:06.688187 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-85f9694a-4103-40a5-abc3-39e856b318ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:06.689731 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1031/2050] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:26:06 2022] DELETE /identity/v3/projects/48a552b764c243149e02e857ce99411b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:26:08.504534 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677ca2f2-7d59-4865-bbfd-365e5c59667d admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:08.505960 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-677ca2f2-7d59-4865-bbfd-365e5c59667d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:26:08.518867 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677ca2f2-7d59-4865-bbfd-365e5c59667d admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:08.581408 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1299d583-49b7-4c30-a66a-1a194bdc25e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:08.582186 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299d583-49b7-4c30-a66a-1a194bdc25e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:08.582621 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299d583-49b7-4c30-a66a-1a194bdc25e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:08.582890 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299d583-49b7-4c30-a66a-1a194bdc25e4 admin admin] PATH_INFO: `/v3/users/271d2631fec84b269ade9fcdb840dcb9` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:08.584091 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1299d583-49b7-4c30-a66a-1a194bdc25e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=271d2631fec84b269ade9fcdb840dcb9)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:08.586015 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1299d583-49b7-4c30-a66a-1a194bdc25e4 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:08.634119 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-1299d583-49b7-4c30-a66a-1a194bdc25e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '271d2631fec84b269ade9fcdb840dcb9'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:08.641402 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-1299d583-49b7-4c30-a66a-1a194bdc25e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '271d2631fec84b269ade9fcdb840dcb9'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:08.648973 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-1299d583-49b7-4c30-a66a-1a194bdc25e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '271d2631fec84b269ade9fcdb840dcb9'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:08.649706 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-1299d583-49b7-4c30-a66a-1a194bdc25e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '271d2631fec84b269ade9fcdb840dcb9'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:08.651773 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-1299d583-49b7-4c30-a66a-1a194bdc25e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '271d2631fec84b269ade9fcdb840dcb9'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:08.673127 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1020/2051] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:26:08 2022] DELETE /identity/v3/users/271d2631fec84b269ade9fcdb840dcb9 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:26:08.678152 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001f2d7-88e6-4af3-873d-3899fc83deba None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:08.678945 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001f2d7-88e6-4af3-873d-3899fc83deba None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:08.679281 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001f2d7-88e6-4af3-873d-3899fc83deba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:08.713473 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-0001f2d7-88e6-4af3-873d-3899fc83deba None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:26:08.715021 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-0001f2d7-88e6-4af3-873d-3899fc83deba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:26:08.783811 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1032/2052] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:26:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:26:08.794075 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1299d583-49b7-4c30-a66a-1a194bdc25e4 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:08.795639 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-1299d583-49b7-4c30-a66a-1a194bdc25e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:26:08.852756 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1299d583-49b7-4c30-a66a-1a194bdc25e4 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:08.856691 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029f117f-c401-41f2-815c-3f4ebc7de442 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:08.857606 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f117f-c401-41f2-815c-3f4ebc7de442 service neutron] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:08.858010 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f117f-c401-41f2-815c-3f4ebc7de442 service neutron] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:08.858393 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f117f-c401-41f2-815c-3f4ebc7de442 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:08.867284 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029f117f-c401-41f2-815c-3f4ebc7de442 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:08.868736 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029f117f-c401-41f2-815c-3f4ebc7de442 service neutron] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:08.878121 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1021/2053] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:26:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:26:09.150959 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0001f2d7-88e6-4af3-873d-3899fc83deba None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:09.152439 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-0001f2d7-88e6-4af3-873d-3899fc83deba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:26:09.164973 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0001f2d7-88e6-4af3-873d-3899fc83deba None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:09.171000 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32025db-cebc-494e-b6b8-c3500ab793b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:09.171883 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32025db-cebc-494e-b6b8-c3500ab793b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:09.172205 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32025db-cebc-494e-b6b8-c3500ab793b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:09.172467 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32025db-cebc-494e-b6b8-c3500ab793b5 admin admin] PATH_INFO: `/v3/projects/d73d90ae96e544949864cc805763f040` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:09.173660 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32025db-cebc-494e-b6b8-c3500ab793b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d73d90ae96e544949864cc805763f040)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:09.175623 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32025db-cebc-494e-b6b8-c3500ab793b5 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:09.220170 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-b32025db-cebc-494e-b6b8-c3500ab793b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd73d90ae96e544949864cc805763f040', 'request_id': 'req-b32025db-cebc-494e-b6b8-c3500ab793b5'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:09.226183 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-b32025db-cebc-494e-b6b8-c3500ab793b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd73d90ae96e544949864cc805763f040', 'request_id': 'req-b32025db-cebc-494e-b6b8-c3500ab793b5'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:09.232522 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-b32025db-cebc-494e-b6b8-c3500ab793b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd73d90ae96e544949864cc805763f040', 'request_id': 'req-b32025db-cebc-494e-b6b8-c3500ab793b5'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:09.246477 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-b32025db-cebc-494e-b6b8-c3500ab793b5 admin admin] The token cache is being invalidate because project d73d90ae96e544949864cc805763f040 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:26:09.246756 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-b32025db-cebc-494e-b6b8-c3500ab793b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:09.247374 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-b32025db-cebc-494e-b6b8-c3500ab793b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:09.249076 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1033/2054] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:26:09 2022] DELETE /identity/v3/projects/d73d90ae96e544949864cc805763f040 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:26:09.254268 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117c2b0-9dfb-49ab-a1b8-e81cf7c4b120 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:09.254782 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117c2b0-9dfb-49ab-a1b8-e81cf7c4b120 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:09.255269 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117c2b0-9dfb-49ab-a1b8-e81cf7c4b120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:09.278324 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-9117c2b0-9dfb-49ab-a1b8-e81cf7c4b120 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:26:09.279566 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-9117c2b0-9dfb-49ab-a1b8-e81cf7c4b120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:26:09.338345 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1022/2055] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:26:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:26:09.346881 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b7ef8-b061-415a-a75f-190c2bd49032 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:09.347162 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b7ef8-b061-415a-a75f-190c2bd49032 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:09.347463 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b7ef8-b061-415a-a75f-190c2bd49032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:09.365112 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-2f1b7ef8-b061-415a-a75f-190c2bd49032 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:26:09.366304 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-2f1b7ef8-b061-415a-a75f-190c2bd49032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:26:09.374690 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1034/2056] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:26:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:26:09.378929 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9117c2b0-9dfb-49ab-a1b8-e81cf7c4b120 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:09.389389 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9117c2b0-9dfb-49ab-a1b8-e81cf7c4b120 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:09.394175 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25b0bd6-c930-43bf-8d87-e232e4f9c21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:09.394718 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b0bd6-c930-43bf-8d87-e232e4f9c21f admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:09.394998 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b0bd6-c930-43bf-8d87-e232e4f9c21f admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:09.395290 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b0bd6-c930-43bf-8d87-e232e4f9c21f admin admin] PATH_INFO: `/v3/domains` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:09.396109 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25b0bd6-c930-43bf-8d87-e232e4f9c21f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:26:09.396417 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25b0bd6-c930-43bf-8d87-e232e4f9c21f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:09.398013 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25b0bd6-c930-43bf-8d87-e232e4f9c21f admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:09.409471 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1023/2057] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 9 20:26:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:26:09.413793 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1b7ef8-b061-415a-a75f-190c2bd49032 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:09.422939 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1b7ef8-b061-415a-a75f-190c2bd49032 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:09.427995 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d7ea6d-adb6-40d4-8d7e-0f8689a223d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:09.428744 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7ea6d-adb6-40d4-8d7e-0f8689a223d2 admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:09.429028 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7ea6d-adb6-40d4-8d7e-0f8689a223d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:09.429341 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7ea6d-adb6-40d4-8d7e-0f8689a223d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:09.430041 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d7ea6d-adb6-40d4-8d7e-0f8689a223d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:09.432540 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d7ea6d-adb6-40d4-8d7e-0f8689a223d2 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:09.457664 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1035/2058] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:26:09 2022] POST /identity/v3/projects => generated 371 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:26:09.461732 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25b0bd6-c930-43bf-8d87-e232e4f9c21f admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:09.471576 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25b0bd6-c930-43bf-8d87-e232e4f9c21f admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:09.529023 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619afe76-ca69-40f3-a825-f8b5f7b7245d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:09.529748 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619afe76-ca69-40f3-a825-f8b5f7b7245d admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:09.530108 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619afe76-ca69-40f3-a825-f8b5f7b7245d admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:09.530375 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619afe76-ca69-40f3-a825-f8b5f7b7245d admin admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:09.531069 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619afe76-ca69-40f3-a825-f8b5f7b7245d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:09.533020 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619afe76-ca69-40f3-a825-f8b5f7b7245d admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:09.556276 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1024/2059] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:26:09 2022] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:26:09.558315 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d7ea6d-adb6-40d4-8d7e-0f8689a223d2 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:09.570281 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d7ea6d-adb6-40d4-8d7e-0f8689a223d2 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:09.574303 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fccee7-deae-47fb-8420-242d3443c4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:09.574960 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fccee7-deae-47fb-8420-242d3443c4ae admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:09.575237 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fccee7-deae-47fb-8420-242d3443c4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:09.575543 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fccee7-deae-47fb-8420-242d3443c4ae admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:09.576321 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fccee7-deae-47fb-8420-242d3443c4ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:09.577951 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fccee7-deae-47fb-8420-242d3443c4ae admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:09.589223 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1036/2060] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:26:09.593314 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619afe76-ca69-40f3-a825-f8b5f7b7245d admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:09.603800 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619afe76-ca69-40f3-a825-f8b5f7b7245d admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:09.609075 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14909582-a0fa-4873-9bdc-643f958e6420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:09.609739 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14909582-a0fa-4873-9bdc-643f958e6420 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:09.610018 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14909582-a0fa-4873-9bdc-643f958e6420 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:09.610291 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14909582-a0fa-4873-9bdc-643f958e6420 admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:09.611012 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14909582-a0fa-4873-9bdc-643f958e6420 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:09.612720 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14909582-a0fa-4873-9bdc-643f958e6420 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:09.623141 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1025/2061] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:26:09.627412 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fccee7-deae-47fb-8420-242d3443c4ae admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:09.638079 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fccee7-deae-47fb-8420-242d3443c4ae admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:09.643446 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ef22b6-2e3f-4aa4-aca0-af83a40a1e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:09.644600 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ef22b6-2e3f-4aa4-aca0-af83a40a1e8f admin admin] REQUEST_METHOD: `PUT` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:09.644973 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ef22b6-2e3f-4aa4-aca0-af83a40a1e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:09.645306 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ef22b6-2e3f-4aa4-aca0-af83a40a1e8f admin admin] PATH_INFO: `/v3/projects/b7e836339ae447f0b6c9cb4647d5553b/users/5175d6860a0a436691aefb541ef0bd91/roles/79f90a0bf6ea43d0b3c434e31556253a` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:09.661427 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ef22b6-2e3f-4aa4-aca0-af83a40a1e8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7e836339ae447f0b6c9cb4647d5553b, user_id=5175d6860a0a436691aefb541ef0bd91, role_id=79f90a0bf6ea43d0b3c434e31556253a)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:09.664090 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ef22b6-2e3f-4aa4-aca0-af83a40a1e8f admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:09.676994 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1037/2062] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:26:09 2022] PUT /identity/v3/projects/b7e836339ae447f0b6c9cb4647d5553b/users/5175d6860a0a436691aefb541ef0bd91/roles/79f90a0bf6ea43d0b3c434e31556253a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:26:09.688059 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488b611-e4dd-4a4d-894f-7027fab4081c None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:09.688347 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488b611-e4dd-4a4d-894f-7027fab4081c None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:09.689104 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488b611-e4dd-4a4d-894f-7027fab4081c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:09.717549 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-1488b611-e4dd-4a4d-894f-7027fab4081c None None] MFA Rules not processed for user `5175d6860a0a436691aefb541ef0bd91`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:26:09.718962 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-1488b611-e4dd-4a4d-894f-7027fab4081c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:26:09.785194 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1026/2063] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:26:09 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:26:09.796892 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ef22b6-2e3f-4aa4-aca0-af83a40a1e8f admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:09.798630 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-61ef22b6-2e3f-4aa4-aca0-af83a40a1e8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:26:09.857617 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ef22b6-2e3f-4aa4-aca0-af83a40a1e8f admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:09.861590 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2063b439-7d95-448a-8acc-d74bef1dbb5f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65db5d9a86fd48acb5874df0165c0ef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:09.862240 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063b439-7d95-448a-8acc-d74bef1dbb5f service glance] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:09.862518 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063b439-7d95-448a-8acc-d74bef1dbb5f service glance] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:09.862787 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063b439-7d95-448a-8acc-d74bef1dbb5f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:09.871899 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2063b439-7d95-448a-8acc-d74bef1dbb5f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:09.873320 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2063b439-7d95-448a-8acc-d74bef1dbb5f service glance] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:09.882114 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1038/2064] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:26:09 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:26:15.412438 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1488b611-e4dd-4a4d-894f-7027fab4081c None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:15.413869 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-1488b611-e4dd-4a4d-894f-7027fab4081c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:26:15.476672 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1488b611-e4dd-4a4d-894f-7027fab4081c None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:15.481792 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10930df9-2fcb-4037-8b6a-195c1b8a7804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:15.482741 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10930df9-2fcb-4037-8b6a-195c1b8a7804 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:15.483029 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10930df9-2fcb-4037-8b6a-195c1b8a7804 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:15.483309 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10930df9-2fcb-4037-8b6a-195c1b8a7804 admin admin] PATH_INFO: `/v3/users/37848306f5c3444db3522e235e76a8b7` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:15.484553 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10930df9-2fcb-4037-8b6a-195c1b8a7804 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37848306f5c3444db3522e235e76a8b7)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:15.486603 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10930df9-2fcb-4037-8b6a-195c1b8a7804 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:15.534041 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-10930df9-2fcb-4037-8b6a-195c1b8a7804 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37848306f5c3444db3522e235e76a8b7'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:15.541194 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-10930df9-2fcb-4037-8b6a-195c1b8a7804 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37848306f5c3444db3522e235e76a8b7'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:15.549172 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-10930df9-2fcb-4037-8b6a-195c1b8a7804 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37848306f5c3444db3522e235e76a8b7'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:15.549776 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-10930df9-2fcb-4037-8b6a-195c1b8a7804 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37848306f5c3444db3522e235e76a8b7'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:15.550396 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-10930df9-2fcb-4037-8b6a-195c1b8a7804 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37848306f5c3444db3522e235e76a8b7'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:15.572013 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1027/2065] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:26:15 2022] DELETE /identity/v3/users/37848306f5c3444db3522e235e76a8b7 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:26:15.576437 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896140e9-cb3c-4712-87a8-641592440ef1 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:15.577062 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896140e9-cb3c-4712-87a8-641592440ef1 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:15.577062 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896140e9-cb3c-4712-87a8-641592440ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:15.595000 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-896140e9-cb3c-4712-87a8-641592440ef1 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:26:15.596230 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-896140e9-cb3c-4712-87a8-641592440ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:26:15.654324 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1039/2066] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:26:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:26:15.663948 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10930df9-2fcb-4037-8b6a-195c1b8a7804 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:15.665365 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-10930df9-2fcb-4037-8b6a-195c1b8a7804 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:26:15.721207 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10930df9-2fcb-4037-8b6a-195c1b8a7804 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:15.724834 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4549576-4129-49a3-a6dc-95416a908e34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:15.725462 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4549576-4129-49a3-a6dc-95416a908e34 service neutron] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:15.725740 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4549576-4129-49a3-a6dc-95416a908e34 service neutron] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:15.726008 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4549576-4129-49a3-a6dc-95416a908e34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:15.736583 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4549576-4129-49a3-a6dc-95416a908e34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:15.738282 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4549576-4129-49a3-a6dc-95416a908e34 service neutron] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:15.749421 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1028/2067] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:26:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:26:16.020052 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896140e9-cb3c-4712-87a8-641592440ef1 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:16.026998 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-896140e9-cb3c-4712-87a8-641592440ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:26:16.038734 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896140e9-cb3c-4712-87a8-641592440ef1 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:16.044088 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c04706-2b49-4879-801e-f4f050de1f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:16.044921 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c04706-2b49-4879-801e-f4f050de1f08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:16.051885 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c04706-2b49-4879-801e-f4f050de1f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:16.051885 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c04706-2b49-4879-801e-f4f050de1f08 admin admin] PATH_INFO: `/v3/projects/2890140c65fd4f859f624db92785f3be` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:16.053200 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c04706-2b49-4879-801e-f4f050de1f08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2890140c65fd4f859f624db92785f3be)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:16.055100 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c04706-2b49-4879-801e-f4f050de1f08 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:16.108664 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-c0c04706-2b49-4879-801e-f4f050de1f08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2890140c65fd4f859f624db92785f3be', 'request_id': 'req-c0c04706-2b49-4879-801e-f4f050de1f08'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:16.114646 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-c0c04706-2b49-4879-801e-f4f050de1f08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2890140c65fd4f859f624db92785f3be', 'request_id': 'req-c0c04706-2b49-4879-801e-f4f050de1f08'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:16.119882 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-c0c04706-2b49-4879-801e-f4f050de1f08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2890140c65fd4f859f624db92785f3be', 'request_id': 'req-c0c04706-2b49-4879-801e-f4f050de1f08'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:16.135766 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-c0c04706-2b49-4879-801e-f4f050de1f08 admin admin] The token cache is being invalidate because project 2890140c65fd4f859f624db92785f3be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:26:16.136046 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-c0c04706-2b49-4879-801e-f4f050de1f08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:16.136907 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-c0c04706-2b49-4879-801e-f4f050de1f08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:16.138442 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1040/2068] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:26:16 2022] DELETE /identity/v3/projects/2890140c65fd4f859f624db92785f3be => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:26:16.143314 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7abbaa-66ea-49c6-93d8-747b68e7985d None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:16.143633 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7abbaa-66ea-49c6-93d8-747b68e7985d None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:16.143910 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7abbaa-66ea-49c6-93d8-747b68e7985d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:16.162765 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-ef7abbaa-66ea-49c6-93d8-747b68e7985d None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:26:16.164024 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-ef7abbaa-66ea-49c6-93d8-747b68e7985d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:26:16.223561 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1029/2069] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:26:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:26:16.232105 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e4b31-8aae-450f-88b7-1ddcb34b87a2 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:16.232395 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e4b31-8aae-450f-88b7-1ddcb34b87a2 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:16.232670 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e4b31-8aae-450f-88b7-1ddcb34b87a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:16.251078 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-154e4b31-8aae-450f-88b7-1ddcb34b87a2 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:26:16.252425 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-154e4b31-8aae-450f-88b7-1ddcb34b87a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:26:16.262404 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1041/2070] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:26:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:26:16.266793 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7abbaa-66ea-49c6-93d8-747b68e7985d None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:16.276306 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7abbaa-66ea-49c6-93d8-747b68e7985d None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:16.281480 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef21a83-68b1-4f8b-9908-79f41f8425fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:16.282116 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef21a83-68b1-4f8b-9908-79f41f8425fd admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:16.282391 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef21a83-68b1-4f8b-9908-79f41f8425fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:16.282658 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef21a83-68b1-4f8b-9908-79f41f8425fd admin admin] PATH_INFO: `/v3/domains` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:16.283367 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef21a83-68b1-4f8b-9908-79f41f8425fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:26:16.283695 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef21a83-68b1-4f8b-9908-79f41f8425fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:16.285286 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef21a83-68b1-4f8b-9908-79f41f8425fd admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:16.296211 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1030/2071] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 9 20:26:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:26:16.300494 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e4b31-8aae-450f-88b7-1ddcb34b87a2 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:16.309896 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e4b31-8aae-450f-88b7-1ddcb34b87a2 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:16.314770 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc889062-be25-4f15-abd1-9b366e9eb95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:16.315582 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc889062-be25-4f15-abd1-9b366e9eb95a admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:16.315863 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc889062-be25-4f15-abd1-9b366e9eb95a admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:16.316132 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc889062-be25-4f15-abd1-9b366e9eb95a admin admin] PATH_INFO: `/v3/projects` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:16.316819 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc889062-be25-4f15-abd1-9b366e9eb95a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:16.318698 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc889062-be25-4f15-abd1-9b366e9eb95a admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:16.344476 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1042/2072] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:26:16 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:26:16.348682 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef21a83-68b1-4f8b-9908-79f41f8425fd admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:16.359675 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef21a83-68b1-4f8b-9908-79f41f8425fd admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:16.417398 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83a4f54-a164-4af1-b77a-f3c7b86be9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:16.418097 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a4f54-a164-4af1-b77a-f3c7b86be9fe admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:16.418319 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a4f54-a164-4af1-b77a-f3c7b86be9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:16.418584 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a4f54-a164-4af1-b77a-f3c7b86be9fe admin admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:16.419267 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83a4f54-a164-4af1-b77a-f3c7b86be9fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:16.421214 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83a4f54-a164-4af1-b77a-f3c7b86be9fe admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:16.442165 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1031/2073] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:26:16 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:26:16.446322 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc889062-be25-4f15-abd1-9b366e9eb95a admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:16.456591 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc889062-be25-4f15-abd1-9b366e9eb95a admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:16.461585 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68a7c62-4d16-4fe7-8ef7-eabadd8fcf00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:16.462276 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a7c62-4d16-4fe7-8ef7-eabadd8fcf00 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:16.462604 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a7c62-4d16-4fe7-8ef7-eabadd8fcf00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:16.462882 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a7c62-4d16-4fe7-8ef7-eabadd8fcf00 admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:16.463665 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68a7c62-4d16-4fe7-8ef7-eabadd8fcf00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:16.465282 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68a7c62-4d16-4fe7-8ef7-eabadd8fcf00 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:16.476723 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1043/2074] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:26:16.480814 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83a4f54-a164-4af1-b77a-f3c7b86be9fe admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:16.490883 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83a4f54-a164-4af1-b77a-f3c7b86be9fe admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:16.496544 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d442c72b-ff3b-4532-a886-cf982f80d533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:16.497191 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d442c72b-ff3b-4532-a886-cf982f80d533 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:16.497469 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d442c72b-ff3b-4532-a886-cf982f80d533 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:16.497739 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d442c72b-ff3b-4532-a886-cf982f80d533 admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:16.498455 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d442c72b-ff3b-4532-a886-cf982f80d533 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:16.500121 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d442c72b-ff3b-4532-a886-cf982f80d533 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:16.510740 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1032/2075] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:26:16.514967 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68a7c62-4d16-4fe7-8ef7-eabadd8fcf00 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:16.525532 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68a7c62-4d16-4fe7-8ef7-eabadd8fcf00 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:16.531826 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d63ef71-4fce-4844-a6a5-2484a513a1e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:16.531826 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d63ef71-4fce-4844-a6a5-2484a513a1e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:16.531826 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d63ef71-4fce-4844-a6a5-2484a513a1e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:16.532153 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d63ef71-4fce-4844-a6a5-2484a513a1e7 admin admin] PATH_INFO: `/v3/projects/51a86af0ab2c4285976dd1b3608e7b30/users/b3470d63ecfc48218a1ddeb9b0dd4fe2/roles/79f90a0bf6ea43d0b3c434e31556253a` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:16.546845 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d63ef71-4fce-4844-a6a5-2484a513a1e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51a86af0ab2c4285976dd1b3608e7b30, user_id=b3470d63ecfc48218a1ddeb9b0dd4fe2, role_id=79f90a0bf6ea43d0b3c434e31556253a)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:16.549504 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d63ef71-4fce-4844-a6a5-2484a513a1e7 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:16.570009 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1044/2076] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:26:16 2022] PUT /identity/v3/projects/51a86af0ab2c4285976dd1b3608e7b30/users/b3470d63ecfc48218a1ddeb9b0dd4fe2/roles/79f90a0bf6ea43d0b3c434e31556253a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:26:16.577369 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d0ebd-32e2-4298-80a6-235edd8bd781 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:16.577669 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d0ebd-32e2-4298-80a6-235edd8bd781 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:16.577950 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d0ebd-32e2-4298-80a6-235edd8bd781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:16.605343 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-430d0ebd-32e2-4298-80a6-235edd8bd781 None None] MFA Rules not processed for user `b3470d63ecfc48218a1ddeb9b0dd4fe2`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:26:16.606724 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-430d0ebd-32e2-4298-80a6-235edd8bd781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:26:16.689588 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1033/2077] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:26:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:26:16.694027 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d63ef71-4fce-4844-a6a5-2484a513a1e7 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:16.754098 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d63ef71-4fce-4844-a6a5-2484a513a1e7 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:16.758627 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34041b5-005a-46c2-a5ba-23725168acfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:16.759461 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34041b5-005a-46c2-a5ba-23725168acfe admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:16.759666 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34041b5-005a-46c2-a5ba-23725168acfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:16.759944 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34041b5-005a-46c2-a5ba-23725168acfe admin admin] PATH_INFO: `/v3/projects` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:16.760622 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34041b5-005a-46c2-a5ba-23725168acfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:16.762802 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34041b5-005a-46c2-a5ba-23725168acfe admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:16.788751 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1045/2078] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:26:16 2022] POST /identity/v3/projects => generated 371 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:26:16.793179 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d0ebd-32e2-4298-80a6-235edd8bd781 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:16.804811 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d0ebd-32e2-4298-80a6-235edd8bd781 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:16.862127 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e63e317-e031-4a8f-bf9c-0d398e471023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:16.862788 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63e317-e031-4a8f-bf9c-0d398e471023 admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:16.863066 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63e317-e031-4a8f-bf9c-0d398e471023 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:16.863338 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63e317-e031-4a8f-bf9c-0d398e471023 admin admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:16.864131 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e63e317-e031-4a8f-bf9c-0d398e471023 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:16.866055 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e63e317-e031-4a8f-bf9c-0d398e471023 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:16.887223 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1034/2079] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:26:16 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:26:16.891245 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34041b5-005a-46c2-a5ba-23725168acfe admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:16.901964 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34041b5-005a-46c2-a5ba-23725168acfe admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:16.906582 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99242187-6684-4d2b-9f16-99cbb9426f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:16.907228 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99242187-6684-4d2b-9f16-99cbb9426f91 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:16.907540 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99242187-6684-4d2b-9f16-99cbb9426f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:16.907814 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99242187-6684-4d2b-9f16-99cbb9426f91 admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:16.908525 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99242187-6684-4d2b-9f16-99cbb9426f91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:16.910102 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99242187-6684-4d2b-9f16-99cbb9426f91 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:16.921052 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1046/2080] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:26:16.925105 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e63e317-e031-4a8f-bf9c-0d398e471023 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:16.935020 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e63e317-e031-4a8f-bf9c-0d398e471023 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:16.939804 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1841d2fd-763a-44d6-9130-39bd8e632987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:16.940819 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1841d2fd-763a-44d6-9130-39bd8e632987 admin admin] REQUEST_METHOD: `PUT` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:16.941089 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1841d2fd-763a-44d6-9130-39bd8e632987 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:16.941370 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1841d2fd-763a-44d6-9130-39bd8e632987 admin admin] PATH_INFO: `/v3/projects/1ded35847d6d4581abcd8a8403e69535/users/299337b71ba4449cb89ef3a61fb4e514/roles/274130b78e304bb88789c1b349263f3c` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:16.957327 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1841d2fd-763a-44d6-9130-39bd8e632987 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ded35847d6d4581abcd8a8403e69535, user_id=299337b71ba4449cb89ef3a61fb4e514, role_id=274130b78e304bb88789c1b349263f3c)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:16.960032 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1841d2fd-763a-44d6-9130-39bd8e632987 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:16.972589 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1035/2081] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:26:16 2022] PUT /identity/v3/projects/1ded35847d6d4581abcd8a8403e69535/users/299337b71ba4449cb89ef3a61fb4e514/roles/274130b78e304bb88789c1b349263f3c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:26:16.976519 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99242187-6684-4d2b-9f16-99cbb9426f91 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:16.986998 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99242187-6684-4d2b-9f16-99cbb9426f91 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:17.043569 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fecbd5a-f7be-497b-afb7-e7655d63d670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:17.044137 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fecbd5a-f7be-497b-afb7-e7655d63d670 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:17.044412 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fecbd5a-f7be-497b-afb7-e7655d63d670 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:17.044683 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fecbd5a-f7be-497b-afb7-e7655d63d670 admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:17.045382 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fecbd5a-f7be-497b-afb7-e7655d63d670 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:17.046961 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fecbd5a-f7be-497b-afb7-e7655d63d670 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:17.056808 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1047/2082] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:26:17.060866 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1841d2fd-763a-44d6-9130-39bd8e632987 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:17.071078 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1841d2fd-763a-44d6-9130-39bd8e632987 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:17.078011 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ced4e-ca1a-40c2-9cd4-f457dac8561b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:17.078905 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ced4e-ca1a-40c2-9cd4-f457dac8561b admin admin] REQUEST_METHOD: `PUT` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:17.079164 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ced4e-ca1a-40c2-9cd4-f457dac8561b admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:17.079467 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ced4e-ca1a-40c2-9cd4-f457dac8561b admin admin] PATH_INFO: `/v3/projects/1ded35847d6d4581abcd8a8403e69535/users/299337b71ba4449cb89ef3a61fb4e514/roles/274130b78e304bb88789c1b349263f3c` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:17.081445 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6ced4e-ca1a-40c2-9cd4-f457dac8561b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ded35847d6d4581abcd8a8403e69535, user_id=299337b71ba4449cb89ef3a61fb4e514, role_id=274130b78e304bb88789c1b349263f3c)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:17.084087 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6ced4e-ca1a-40c2-9cd4-f457dac8561b admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:17.094951 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1036/2083] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:26:17 2022] PUT /identity/v3/projects/1ded35847d6d4581abcd8a8403e69535/users/299337b71ba4449cb89ef3a61fb4e514/roles/274130b78e304bb88789c1b349263f3c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:26:17.106469 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c23b8-2a6b-4238-bdd3-199cf5bc8434 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:17.106885 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c23b8-2a6b-4238-bdd3-199cf5bc8434 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:17.107169 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c23b8-2a6b-4238-bdd3-199cf5bc8434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:17.135774 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-8d7c23b8-2a6b-4238-bdd3-199cf5bc8434 None None] MFA Rules not processed for user `299337b71ba4449cb89ef3a61fb4e514`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:26:17.137231 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-8d7c23b8-2a6b-4238-bdd3-199cf5bc8434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:26:17.207681 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1048/2084] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:26:17 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:26:17.220324 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ced4e-ca1a-40c2-9cd4-f457dac8561b admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:17.221997 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-ec6ced4e-ca1a-40c2-9cd4-f457dac8561b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:26:17.278200 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ced4e-ca1a-40c2-9cd4-f457dac8561b admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:17.281793 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24b22d2-a61a-496e-9712-1143e0af2350 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d65e731386d44948dcc1ecd40cbda65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:17.282425 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b22d2-a61a-496e-9712-1143e0af2350 service cinder] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:17.282699 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b22d2-a61a-496e-9712-1143e0af2350 service cinder] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:17.282989 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b22d2-a61a-496e-9712-1143e0af2350 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:17.292113 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24b22d2-a61a-496e-9712-1143e0af2350 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:17.293790 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24b22d2-a61a-496e-9712-1143e0af2350 service cinder] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:17.304070 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1037/2085] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:26:17 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:26:17.675719 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7c23b8-2a6b-4238-bdd3-199cf5bc8434 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:17.746849 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7c23b8-2a6b-4238-bdd3-199cf5bc8434 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:17.751365 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def8bc98-1335-4129-99ea-0ca9b665ce80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:17.752246 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def8bc98-1335-4129-99ea-0ca9b665ce80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:17.752524 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def8bc98-1335-4129-99ea-0ca9b665ce80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:17.752851 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def8bc98-1335-4129-99ea-0ca9b665ce80 admin admin] PATH_INFO: `/v3/users/b3470d63ecfc48218a1ddeb9b0dd4fe2` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:17.754341 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def8bc98-1335-4129-99ea-0ca9b665ce80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3470d63ecfc48218a1ddeb9b0dd4fe2)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:17.757217 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def8bc98-1335-4129-99ea-0ca9b665ce80 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:17.808221 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-def8bc98-1335-4129-99ea-0ca9b665ce80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3470d63ecfc48218a1ddeb9b0dd4fe2'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:17.808946 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-def8bc98-1335-4129-99ea-0ca9b665ce80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3470d63ecfc48218a1ddeb9b0dd4fe2'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:17.817333 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-def8bc98-1335-4129-99ea-0ca9b665ce80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3470d63ecfc48218a1ddeb9b0dd4fe2'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:17.818218 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-def8bc98-1335-4129-99ea-0ca9b665ce80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3470d63ecfc48218a1ddeb9b0dd4fe2'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:17.827634 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-def8bc98-1335-4129-99ea-0ca9b665ce80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3470d63ecfc48218a1ddeb9b0dd4fe2'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:17.845670 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1049/2086] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:26:17 2022] DELETE /identity/v3/users/b3470d63ecfc48218a1ddeb9b0dd4fe2 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:26:17.851109 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf3c154-c1c8-4c73-9ad9-e51edc828d41 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:17.851581 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf3c154-c1c8-4c73-9ad9-e51edc828d41 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:17.851670 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf3c154-c1c8-4c73-9ad9-e51edc828d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:17.871892 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-baf3c154-c1c8-4c73-9ad9-e51edc828d41 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:26:17.873100 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-baf3c154-c1c8-4c73-9ad9-e51edc828d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:26:17.932502 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1038/2087] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:26:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:26:17.942840 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def8bc98-1335-4129-99ea-0ca9b665ce80 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:17.944257 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-def8bc98-1335-4129-99ea-0ca9b665ce80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:26:18.006630 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def8bc98-1335-4129-99ea-0ca9b665ce80 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:18.010857 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b9515c-f30e-487d-b9bc-ce406620a705 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:18.011796 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b9515c-f30e-487d-b9bc-ce406620a705 service neutron] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:18.012083 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b9515c-f30e-487d-b9bc-ce406620a705 service neutron] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:18.012356 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b9515c-f30e-487d-b9bc-ce406620a705 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:18.023803 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b9515c-f30e-487d-b9bc-ce406620a705 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:18.025289 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b9515c-f30e-487d-b9bc-ce406620a705 service neutron] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:18.036464 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1050/2088] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:26:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:26:18.314231 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf3c154-c1c8-4c73-9ad9-e51edc828d41 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:18.316062 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-baf3c154-c1c8-4c73-9ad9-e51edc828d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:26:18.330473 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf3c154-c1c8-4c73-9ad9-e51edc828d41 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:18.336293 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d07a5a-92d0-48f4-864e-f078fc5af156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:18.337166 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d07a5a-92d0-48f4-864e-f078fc5af156 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:18.337510 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d07a5a-92d0-48f4-864e-f078fc5af156 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:18.337775 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d07a5a-92d0-48f4-864e-f078fc5af156 admin admin] PATH_INFO: `/v3/projects/51a86af0ab2c4285976dd1b3608e7b30` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:18.338996 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d07a5a-92d0-48f4-864e-f078fc5af156 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51a86af0ab2c4285976dd1b3608e7b30)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:18.341018 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d07a5a-92d0-48f4-864e-f078fc5af156 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:18.393018 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-82d07a5a-92d0-48f4-864e-f078fc5af156 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51a86af0ab2c4285976dd1b3608e7b30', 'request_id': 'req-82d07a5a-92d0-48f4-864e-f078fc5af156'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:18.399252 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-82d07a5a-92d0-48f4-864e-f078fc5af156 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51a86af0ab2c4285976dd1b3608e7b30', 'request_id': 'req-82d07a5a-92d0-48f4-864e-f078fc5af156'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:18.405506 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-82d07a5a-92d0-48f4-864e-f078fc5af156 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51a86af0ab2c4285976dd1b3608e7b30', 'request_id': 'req-82d07a5a-92d0-48f4-864e-f078fc5af156'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:18.417395 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-82d07a5a-92d0-48f4-864e-f078fc5af156 admin admin] The token cache is being invalidate because project 51a86af0ab2c4285976dd1b3608e7b30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:26:18.417679 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-82d07a5a-92d0-48f4-864e-f078fc5af156 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:18.418286 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-82d07a5a-92d0-48f4-864e-f078fc5af156 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:18.419858 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1039/2089] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:26:18 2022] DELETE /identity/v3/projects/51a86af0ab2c4285976dd1b3608e7b30 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:26:18.423772 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b9515c-f30e-487d-b9bc-ce406620a705 service neutron] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:18.435157 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b9515c-f30e-487d-b9bc-ce406620a705 service neutron] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:18.491496 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9d91ee-73b9-4bf8-8eb8-d9e7b9f51fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:18.492348 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d91ee-73b9-4bf8-8eb8-d9e7b9f51fcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:18.492624 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d91ee-73b9-4bf8-8eb8-d9e7b9f51fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:18.492893 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d91ee-73b9-4bf8-8eb8-d9e7b9f51fcc admin admin] PATH_INFO: `/v3/users/299337b71ba4449cb89ef3a61fb4e514` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:18.494692 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9d91ee-73b9-4bf8-8eb8-d9e7b9f51fcc admin admin] RBAC: Authorizing `identity:delete_user(user_id=299337b71ba4449cb89ef3a61fb4e514)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:18.496613 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9d91ee-73b9-4bf8-8eb8-d9e7b9f51fcc admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:18.543334 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-9d9d91ee-73b9-4bf8-8eb8-d9e7b9f51fcc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '299337b71ba4449cb89ef3a61fb4e514'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:18.544007 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-9d9d91ee-73b9-4bf8-8eb8-d9e7b9f51fcc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '299337b71ba4449cb89ef3a61fb4e514'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:18.550454 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-9d9d91ee-73b9-4bf8-8eb8-d9e7b9f51fcc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '299337b71ba4449cb89ef3a61fb4e514'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:18.551116 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-9d9d91ee-73b9-4bf8-8eb8-d9e7b9f51fcc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '299337b71ba4449cb89ef3a61fb4e514'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:18.559070 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-9d9d91ee-73b9-4bf8-8eb8-d9e7b9f51fcc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '299337b71ba4449cb89ef3a61fb4e514'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:18.576084 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1051/2090] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:26:18 2022] DELETE /identity/v3/users/299337b71ba4449cb89ef3a61fb4e514 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:26:18.872969 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d07a5a-92d0-48f4-864e-f078fc5af156 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:18.874411 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-82d07a5a-92d0-48f4-864e-f078fc5af156 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:26:18.898353 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d07a5a-92d0-48f4-864e-f078fc5af156 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:18.967858 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8770ffa6-4f93-4ff1-b7a3-f1cea3512583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:18.968808 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770ffa6-4f93-4ff1-b7a3-f1cea3512583 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:18.969100 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770ffa6-4f93-4ff1-b7a3-f1cea3512583 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:18.969375 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770ffa6-4f93-4ff1-b7a3-f1cea3512583 admin admin] PATH_INFO: `/v3/projects/1ded35847d6d4581abcd8a8403e69535` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:18.970733 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8770ffa6-4f93-4ff1-b7a3-f1cea3512583 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ded35847d6d4581abcd8a8403e69535)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:18.972714 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8770ffa6-4f93-4ff1-b7a3-f1cea3512583 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:19.022882 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-8770ffa6-4f93-4ff1-b7a3-f1cea3512583 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ded35847d6d4581abcd8a8403e69535', 'request_id': 'req-8770ffa6-4f93-4ff1-b7a3-f1cea3512583'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:19.030531 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-8770ffa6-4f93-4ff1-b7a3-f1cea3512583 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ded35847d6d4581abcd8a8403e69535', 'request_id': 'req-8770ffa6-4f93-4ff1-b7a3-f1cea3512583'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:19.036743 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-8770ffa6-4f93-4ff1-b7a3-f1cea3512583 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ded35847d6d4581abcd8a8403e69535', 'request_id': 'req-8770ffa6-4f93-4ff1-b7a3-f1cea3512583'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:19.060652 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-8770ffa6-4f93-4ff1-b7a3-f1cea3512583 admin admin] The token cache is being invalidate because project 1ded35847d6d4581abcd8a8403e69535 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:26:19.060652 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-8770ffa6-4f93-4ff1-b7a3-f1cea3512583 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:19.060652 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-8770ffa6-4f93-4ff1-b7a3-f1cea3512583 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:19.060652 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1040/2091] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:26:18 2022] DELETE /identity/v3/projects/1ded35847d6d4581abcd8a8403e69535 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:26:19.065594 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4bdf40-f0f6-47e1-a435-ae038c5b62ab None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:19.066129 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4bdf40-f0f6-47e1-a435-ae038c5b62ab None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:19.066129 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4bdf40-f0f6-47e1-a435-ae038c5b62ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:19.084348 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-fd4bdf40-f0f6-47e1-a435-ae038c5b62ab None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:26:19.085968 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-fd4bdf40-f0f6-47e1-a435-ae038c5b62ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:26:19.147328 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1052/2092] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:26:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:26:19.155964 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2352b43d-7c50-4544-9fb4-91a064a87ffc None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:19.158934 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2352b43d-7c50-4544-9fb4-91a064a87ffc None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:19.159254 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2352b43d-7c50-4544-9fb4-91a064a87ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:19.177577 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-2352b43d-7c50-4544-9fb4-91a064a87ffc None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:26:19.178811 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-2352b43d-7c50-4544-9fb4-91a064a87ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:26:19.187553 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1041/2093] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:26:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:26:19.192017 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4bdf40-f0f6-47e1-a435-ae038c5b62ab None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:19.203920 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4bdf40-f0f6-47e1-a435-ae038c5b62ab None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:19.208910 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7913740-58b1-4f2f-9c1a-369e4ff0bdd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:19.209575 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7913740-58b1-4f2f-9c1a-369e4ff0bdd3 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:19.209854 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7913740-58b1-4f2f-9c1a-369e4ff0bdd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:19.210126 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7913740-58b1-4f2f-9c1a-369e4ff0bdd3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:19.210859 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7913740-58b1-4f2f-9c1a-369e4ff0bdd3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:26:19.211169 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7913740-58b1-4f2f-9c1a-369e4ff0bdd3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:19.212891 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7913740-58b1-4f2f-9c1a-369e4ff0bdd3 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:19.224548 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1053/2094] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 9 20:26:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:26:19.228913 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2352b43d-7c50-4544-9fb4-91a064a87ffc None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:19.244140 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2352b43d-7c50-4544-9fb4-91a064a87ffc None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:19.249100 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f80334-78cd-44e6-95a4-b07f5fc03a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:19.249757 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f80334-78cd-44e6-95a4-b07f5fc03a59 admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:19.250036 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f80334-78cd-44e6-95a4-b07f5fc03a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:19.250317 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f80334-78cd-44e6-95a4-b07f5fc03a59 admin admin] PATH_INFO: `/v3/projects` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:19.251039 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f80334-78cd-44e6-95a4-b07f5fc03a59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:19.253024 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f80334-78cd-44e6-95a4-b07f5fc03a59 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:19.282998 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1042/2095] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:26:19 2022] POST /identity/v3/projects => generated 365 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:26:19.286981 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7913740-58b1-4f2f-9c1a-369e4ff0bdd3 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:19.297534 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7913740-58b1-4f2f-9c1a-369e4ff0bdd3 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:19.354732 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c78cd6-141d-4e0b-b5f0-ba77c86528c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:19.355308 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c78cd6-141d-4e0b-b5f0-ba77c86528c8 admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:19.355652 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c78cd6-141d-4e0b-b5f0-ba77c86528c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:19.355923 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c78cd6-141d-4e0b-b5f0-ba77c86528c8 admin admin] PATH_INFO: `/v3/users` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:19.356609 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c78cd6-141d-4e0b-b5f0-ba77c86528c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:19.358559 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c78cd6-141d-4e0b-b5f0-ba77c86528c8 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:19.386670 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1054/2096] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:26:19 2022] POST /identity/v3/users => generated 283 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:26:19.390751 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f80334-78cd-44e6-95a4-b07f5fc03a59 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:19.400860 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f80334-78cd-44e6-95a4-b07f5fc03a59 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:19.405475 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c9748-18de-40a0-8d45-c42d4a5bba61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:19.406119 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c9748-18de-40a0-8d45-c42d4a5bba61 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:19.406398 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c9748-18de-40a0-8d45-c42d4a5bba61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:19.406724 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c9748-18de-40a0-8d45-c42d4a5bba61 admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:19.407475 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482c9748-18de-40a0-8d45-c42d4a5bba61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:19.409077 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482c9748-18de-40a0-8d45-c42d4a5bba61 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:19.421289 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1043/2097] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:26:19.425379 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c78cd6-141d-4e0b-b5f0-ba77c86528c8 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:19.436143 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c78cd6-141d-4e0b-b5f0-ba77c86528c8 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:19.440641 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881d1a3f-f17f-424c-95a7-20865faed345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:19.441282 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d1a3f-f17f-424c-95a7-20865faed345 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:19.441556 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d1a3f-f17f-424c-95a7-20865faed345 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:19.441822 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d1a3f-f17f-424c-95a7-20865faed345 admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:19.442537 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881d1a3f-f17f-424c-95a7-20865faed345 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:19.444146 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881d1a3f-f17f-424c-95a7-20865faed345 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:19.453858 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1055/2098] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:26:19.458367 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c9748-18de-40a0-8d45-c42d4a5bba61 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:19.468188 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c9748-18de-40a0-8d45-c42d4a5bba61 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:19.472901 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac85ae4e-6fb9-410c-98e0-0bd60520bbad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:19.473854 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85ae4e-6fb9-410c-98e0-0bd60520bbad admin admin] REQUEST_METHOD: `PUT` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:19.474162 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85ae4e-6fb9-410c-98e0-0bd60520bbad admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:19.474459 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85ae4e-6fb9-410c-98e0-0bd60520bbad admin admin] PATH_INFO: `/v3/projects/6d114cd4be8748248ebf4f3001ebefc6/users/17739ab426fe48bf93c3625de88da5de/roles/79f90a0bf6ea43d0b3c434e31556253a` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:19.489857 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac85ae4e-6fb9-410c-98e0-0bd60520bbad admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d114cd4be8748248ebf4f3001ebefc6, user_id=17739ab426fe48bf93c3625de88da5de, role_id=79f90a0bf6ea43d0b3c434e31556253a)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:19.492803 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac85ae4e-6fb9-410c-98e0-0bd60520bbad admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:19.506893 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1044/2099] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:26:19 2022] PUT /identity/v3/projects/6d114cd4be8748248ebf4f3001ebefc6/users/17739ab426fe48bf93c3625de88da5de/roles/79f90a0bf6ea43d0b3c434e31556253a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:26:19.517596 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab313f94-cb7a-4264-a7d5-fda046d30c72 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:19.517882 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab313f94-cb7a-4264-a7d5-fda046d30c72 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:19.518157 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab313f94-cb7a-4264-a7d5-fda046d30c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:19.544769 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-ab313f94-cb7a-4264-a7d5-fda046d30c72 None None] MFA Rules not processed for user `17739ab426fe48bf93c3625de88da5de`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:26:19.545941 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-ab313f94-cb7a-4264-a7d5-fda046d30c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:26:19.626568 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1056/2100] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:26:19 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:26:19.631638 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac85ae4e-6fb9-410c-98e0-0bd60520bbad admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:19.698469 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac85ae4e-6fb9-410c-98e0-0bd60520bbad admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:19.704586 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73ab33f-7c50-4cc6-ab62-eca472506a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:19.705452 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ab33f-7c50-4cc6-ab62-eca472506a20 admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:19.705728 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ab33f-7c50-4cc6-ab62-eca472506a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:19.705996 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ab33f-7c50-4cc6-ab62-eca472506a20 admin admin] PATH_INFO: `/v3/projects` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:19.706666 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73ab33f-7c50-4cc6-ab62-eca472506a20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:19.708586 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73ab33f-7c50-4cc6-ab62-eca472506a20 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:19.735448 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1045/2101] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:26:19 2022] POST /identity/v3/projects => generated 363 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 20:26:19.740168 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab313f94-cb7a-4264-a7d5-fda046d30c72 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:19.751964 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab313f94-cb7a-4264-a7d5-fda046d30c72 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:19.810110 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f142a750-35c6-4438-9679-23300ec85854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:19.810777 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142a750-35c6-4438-9679-23300ec85854 admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:19.811059 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142a750-35c6-4438-9679-23300ec85854 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:19.811329 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142a750-35c6-4438-9679-23300ec85854 admin admin] PATH_INFO: `/v3/users` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:19.812168 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f142a750-35c6-4438-9679-23300ec85854 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:19.813972 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f142a750-35c6-4438-9679-23300ec85854 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:19.835447 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1057/2102] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:26:19 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:26:19.839650 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73ab33f-7c50-4cc6-ab62-eca472506a20 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:19.852245 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73ab33f-7c50-4cc6-ab62-eca472506a20 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:19.858932 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7146dd-8480-45ca-8ddc-43b24390667c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:19.859635 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7146dd-8480-45ca-8ddc-43b24390667c admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:19.859915 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7146dd-8480-45ca-8ddc-43b24390667c admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:19.860181 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7146dd-8480-45ca-8ddc-43b24390667c admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:19.860904 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7146dd-8480-45ca-8ddc-43b24390667c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:19.862513 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7146dd-8480-45ca-8ddc-43b24390667c admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:19.874571 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1046/2103] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:26:19.878867 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f142a750-35c6-4438-9679-23300ec85854 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:19.891771 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f142a750-35c6-4438-9679-23300ec85854 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:19.897544 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e3576-c8fa-47cb-8114-0dba209949ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:19.898533 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e3576-c8fa-47cb-8114-0dba209949ef admin admin] REQUEST_METHOD: `PUT` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:19.898990 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e3576-c8fa-47cb-8114-0dba209949ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:19.899280 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e3576-c8fa-47cb-8114-0dba209949ef admin admin] PATH_INFO: `/v3/projects/4c49ef680d734e5e9e108109804943cc/users/af3fc1a66f1c4d8c9b1f3ebf5f5833e7/roles/274130b78e304bb88789c1b349263f3c` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:19.915038 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1e3576-c8fa-47cb-8114-0dba209949ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c49ef680d734e5e9e108109804943cc, user_id=af3fc1a66f1c4d8c9b1f3ebf5f5833e7, role_id=274130b78e304bb88789c1b349263f3c)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:19.917896 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1e3576-c8fa-47cb-8114-0dba209949ef admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:19.932563 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1058/2104] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:26:19 2022] PUT /identity/v3/projects/4c49ef680d734e5e9e108109804943cc/users/af3fc1a66f1c4d8c9b1f3ebf5f5833e7/roles/274130b78e304bb88789c1b349263f3c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:26:19.936560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7146dd-8480-45ca-8ddc-43b24390667c admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:19.949260 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7146dd-8480-45ca-8ddc-43b24390667c admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:20.007560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d8622d-fd6e-4759-8f43-380443525f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:20.008224 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d8622d-fd6e-4759-8f43-380443525f39 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:20.008715 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d8622d-fd6e-4759-8f43-380443525f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:20.009684 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d8622d-fd6e-4759-8f43-380443525f39 admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:20.010971 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d8622d-fd6e-4759-8f43-380443525f39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:20.013741 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d8622d-fd6e-4759-8f43-380443525f39 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:20.025109 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1047/2105] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 09 20:26:20.029416 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e3576-c8fa-47cb-8114-0dba209949ef admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:20.039564 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e3576-c8fa-47cb-8114-0dba209949ef admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:20.048922 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c9b9e2-4240-4268-b3e6-45d86349da11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:20.049818 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c9b9e2-4240-4268-b3e6-45d86349da11 admin admin] REQUEST_METHOD: `PUT` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:20.050086 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c9b9e2-4240-4268-b3e6-45d86349da11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:20.050383 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c9b9e2-4240-4268-b3e6-45d86349da11 admin admin] PATH_INFO: `/v3/projects/4c49ef680d734e5e9e108109804943cc/users/af3fc1a66f1c4d8c9b1f3ebf5f5833e7/roles/274130b78e304bb88789c1b349263f3c` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:20.052450 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c9b9e2-4240-4268-b3e6-45d86349da11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c49ef680d734e5e9e108109804943cc, user_id=af3fc1a66f1c4d8c9b1f3ebf5f5833e7, role_id=274130b78e304bb88789c1b349263f3c)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:20.055868 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c9b9e2-4240-4268-b3e6-45d86349da11 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:20.067910 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1059/2106] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:26:20 2022] PUT /identity/v3/projects/4c49ef680d734e5e9e108109804943cc/users/af3fc1a66f1c4d8c9b1f3ebf5f5833e7/roles/274130b78e304bb88789c1b349263f3c => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:26:20.080474 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6dfc2b-4ddd-4722-82ca-4699cf67dabb None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:20.081081 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6dfc2b-4ddd-4722-82ca-4699cf67dabb None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:20.081496 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6dfc2b-4ddd-4722-82ca-4699cf67dabb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:20.117309 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-dc6dfc2b-4ddd-4722-82ca-4699cf67dabb None None] MFA Rules not processed for user `af3fc1a66f1c4d8c9b1f3ebf5f5833e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:26:20.119435 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-dc6dfc2b-4ddd-4722-82ca-4699cf67dabb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:26:20.192793 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1048/2107] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:26:20 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:26:20.204992 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c9b9e2-4240-4268-b3e6-45d86349da11 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:20.207534 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-64c9b9e2-4240-4268-b3e6-45d86349da11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:26:20.269563 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c9b9e2-4240-4268-b3e6-45d86349da11 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:20.273151 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4120ed-9fce-40e3-aacf-c92803ac8b2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d65e731386d44948dcc1ecd40cbda65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:20.273783 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4120ed-9fce-40e3-aacf-c92803ac8b2d service cinder] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:20.274062 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4120ed-9fce-40e3-aacf-c92803ac8b2d service cinder] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:20.274331 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4120ed-9fce-40e3-aacf-c92803ac8b2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:20.285138 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4120ed-9fce-40e3-aacf-c92803ac8b2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:20.286601 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4120ed-9fce-40e3-aacf-c92803ac8b2d service cinder] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:20.297152 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1060/2108] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:26:20 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:26:20.371975 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6dfc2b-4ddd-4722-82ca-4699cf67dabb None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:20.381299 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6dfc2b-4ddd-4722-82ca-4699cf67dabb None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:20.384971 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d9b198-2847-4bf3-97e6-126b309c1a04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d65e731386d44948dcc1ecd40cbda65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:20.385591 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9b198-2847-4bf3-97e6-126b309c1a04 service cinder] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:20.385868 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9b198-2847-4bf3-97e6-126b309c1a04 service cinder] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:20.386139 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9b198-2847-4bf3-97e6-126b309c1a04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:20.443917 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d9b198-2847-4bf3-97e6-126b309c1a04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:20.445275 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d9b198-2847-4bf3-97e6-126b309c1a04 service cinder] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:20.454208 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1049/2109] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:26:20 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:26:23.195780 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4120ed-9fce-40e3-aacf-c92803ac8b2d service cinder] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:23.255483 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4120ed-9fce-40e3-aacf-c92803ac8b2d service cinder] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:23.260649 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66894a7-ee0f-4634-ad70-b48a8133d0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:23.261739 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66894a7-ee0f-4634-ad70-b48a8133d0d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:23.262015 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66894a7-ee0f-4634-ad70-b48a8133d0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:23.262286 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66894a7-ee0f-4634-ad70-b48a8133d0d8 admin admin] PATH_INFO: `/v3/users/17739ab426fe48bf93c3625de88da5de` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:23.263472 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66894a7-ee0f-4634-ad70-b48a8133d0d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17739ab426fe48bf93c3625de88da5de)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:23.265613 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66894a7-ee0f-4634-ad70-b48a8133d0d8 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:23.312115 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-f66894a7-ee0f-4634-ad70-b48a8133d0d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17739ab426fe48bf93c3625de88da5de'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:23.312754 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-f66894a7-ee0f-4634-ad70-b48a8133d0d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17739ab426fe48bf93c3625de88da5de'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:23.319203 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-f66894a7-ee0f-4634-ad70-b48a8133d0d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17739ab426fe48bf93c3625de88da5de'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:23.319843 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-f66894a7-ee0f-4634-ad70-b48a8133d0d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17739ab426fe48bf93c3625de88da5de'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:23.328071 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-f66894a7-ee0f-4634-ad70-b48a8133d0d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17739ab426fe48bf93c3625de88da5de'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:23.344664 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1061/2110] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:26:23 2022] DELETE /identity/v3/users/17739ab426fe48bf93c3625de88da5de => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:26:23.349139 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa980215-9192-4493-a590-1f774ccf26f0 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:23.349610 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa980215-9192-4493-a590-1f774ccf26f0 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:23.349698 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa980215-9192-4493-a590-1f774ccf26f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:23.367634 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-aa980215-9192-4493-a590-1f774ccf26f0 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:26:23.368903 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-aa980215-9192-4493-a590-1f774ccf26f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:26:23.427542 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1050/2111] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:26:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:26:23.437547 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66894a7-ee0f-4634-ad70-b48a8133d0d8 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:23.438936 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-f66894a7-ee0f-4634-ad70-b48a8133d0d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:26:23.495174 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66894a7-ee0f-4634-ad70-b48a8133d0d8 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:23.498763 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d4ab9a-0032-4d1c-acb7-b708e9413290 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:23.499408 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4ab9a-0032-4d1c-acb7-b708e9413290 service neutron] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:23.499705 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4ab9a-0032-4d1c-acb7-b708e9413290 service neutron] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:23.499979 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4ab9a-0032-4d1c-acb7-b708e9413290 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:23.508719 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d4ab9a-0032-4d1c-acb7-b708e9413290 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:23.510849 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d4ab9a-0032-4d1c-acb7-b708e9413290 service neutron] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:23.520457 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1062/2112] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:26:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:26:23.782897 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa980215-9192-4493-a590-1f774ccf26f0 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:23.786011 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-aa980215-9192-4493-a590-1f774ccf26f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:26:23.807177 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa980215-9192-4493-a590-1f774ccf26f0 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:23.817597 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60d39ec-628d-4fe4-952f-4ad9697c9e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:23.819602 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d39ec-628d-4fe4-952f-4ad9697c9e81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:23.820049 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d39ec-628d-4fe4-952f-4ad9697c9e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:23.820458 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d39ec-628d-4fe4-952f-4ad9697c9e81 admin admin] PATH_INFO: `/v3/projects/6d114cd4be8748248ebf4f3001ebefc6` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:23.822503 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60d39ec-628d-4fe4-952f-4ad9697c9e81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d114cd4be8748248ebf4f3001ebefc6)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:23.824810 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60d39ec-628d-4fe4-952f-4ad9697c9e81 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:23.872450 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-b60d39ec-628d-4fe4-952f-4ad9697c9e81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d114cd4be8748248ebf4f3001ebefc6', 'request_id': 'req-b60d39ec-628d-4fe4-952f-4ad9697c9e81'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:23.878275 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-b60d39ec-628d-4fe4-952f-4ad9697c9e81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d114cd4be8748248ebf4f3001ebefc6', 'request_id': 'req-b60d39ec-628d-4fe4-952f-4ad9697c9e81'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:23.883666 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-b60d39ec-628d-4fe4-952f-4ad9697c9e81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d114cd4be8748248ebf4f3001ebefc6', 'request_id': 'req-b60d39ec-628d-4fe4-952f-4ad9697c9e81'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:23.895479 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-b60d39ec-628d-4fe4-952f-4ad9697c9e81 admin admin] The token cache is being invalidate because project 6d114cd4be8748248ebf4f3001ebefc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:26:23.895806 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-b60d39ec-628d-4fe4-952f-4ad9697c9e81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:23.896602 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-b60d39ec-628d-4fe4-952f-4ad9697c9e81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:23.898819 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1051/2113] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:26:23 2022] DELETE /identity/v3/projects/6d114cd4be8748248ebf4f3001ebefc6 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:26:23.903227 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d4ab9a-0032-4d1c-acb7-b708e9413290 service neutron] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:23.912554 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d4ab9a-0032-4d1c-acb7-b708e9413290 service neutron] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:23.968136 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b1a9ae-1dd7-4849-b844-99fe24638709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:23.969000 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b1a9ae-1dd7-4849-b844-99fe24638709 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:23.969275 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b1a9ae-1dd7-4849-b844-99fe24638709 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:23.969551 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b1a9ae-1dd7-4849-b844-99fe24638709 admin admin] PATH_INFO: `/v3/users/af3fc1a66f1c4d8c9b1f3ebf5f5833e7` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:23.970739 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b1a9ae-1dd7-4849-b844-99fe24638709 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af3fc1a66f1c4d8c9b1f3ebf5f5833e7)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:23.973218 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b1a9ae-1dd7-4849-b844-99fe24638709 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:24.027629 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-b2b1a9ae-1dd7-4849-b844-99fe24638709 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af3fc1a66f1c4d8c9b1f3ebf5f5833e7'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:24.028852 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-b2b1a9ae-1dd7-4849-b844-99fe24638709 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af3fc1a66f1c4d8c9b1f3ebf5f5833e7'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:24.039848 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-b2b1a9ae-1dd7-4849-b844-99fe24638709 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af3fc1a66f1c4d8c9b1f3ebf5f5833e7'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:24.042973 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-b2b1a9ae-1dd7-4849-b844-99fe24638709 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af3fc1a66f1c4d8c9b1f3ebf5f5833e7'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:24.059559 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-b2b1a9ae-1dd7-4849-b844-99fe24638709 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af3fc1a66f1c4d8c9b1f3ebf5f5833e7'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:24.079346 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1063/2114] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:26:23 2022] DELETE /identity/v3/users/af3fc1a66f1c4d8c9b1f3ebf5f5833e7 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:26:24.402092 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60d39ec-628d-4fe4-952f-4ad9697c9e81 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:24.404331 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-b60d39ec-628d-4fe4-952f-4ad9697c9e81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:26:24.444186 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60d39ec-628d-4fe4-952f-4ad9697c9e81 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:24.509909 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e0ce5-101b-472a-8378-42e9f4618cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:24.510823 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e0ce5-101b-472a-8378-42e9f4618cc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:24.511097 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e0ce5-101b-472a-8378-42e9f4618cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:24.511634 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e0ce5-101b-472a-8378-42e9f4618cc0 admin admin] PATH_INFO: `/v3/projects/4c49ef680d734e5e9e108109804943cc` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:24.512879 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2e0ce5-101b-472a-8378-42e9f4618cc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c49ef680d734e5e9e108109804943cc)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:24.514830 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2e0ce5-101b-472a-8378-42e9f4618cc0 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:24.560453 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-ac2e0ce5-101b-472a-8378-42e9f4618cc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c49ef680d734e5e9e108109804943cc', 'request_id': 'req-ac2e0ce5-101b-472a-8378-42e9f4618cc0'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:24.568041 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-ac2e0ce5-101b-472a-8378-42e9f4618cc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c49ef680d734e5e9e108109804943cc', 'request_id': 'req-ac2e0ce5-101b-472a-8378-42e9f4618cc0'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:24.576353 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-ac2e0ce5-101b-472a-8378-42e9f4618cc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c49ef680d734e5e9e108109804943cc', 'request_id': 'req-ac2e0ce5-101b-472a-8378-42e9f4618cc0'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:24.590902 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-ac2e0ce5-101b-472a-8378-42e9f4618cc0 admin admin] The token cache is being invalidate because project 4c49ef680d734e5e9e108109804943cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:26:24.591210 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-ac2e0ce5-101b-472a-8378-42e9f4618cc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:24.592395 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-ac2e0ce5-101b-472a-8378-42e9f4618cc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:24.593955 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1052/2115] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:26:24 2022] DELETE /identity/v3/projects/4c49ef680d734e5e9e108109804943cc => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:26:24.599328 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f2675-1147-4977-8347-de675fd8cd8e None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:24.599850 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f2675-1147-4977-8347-de675fd8cd8e None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:24.600057 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f2675-1147-4977-8347-de675fd8cd8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:24.619968 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-2a3f2675-1147-4977-8347-de675fd8cd8e None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:26:24.621339 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-2a3f2675-1147-4977-8347-de675fd8cd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:26:24.686824 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1064/2116] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:26:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:26:24.694733 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fb0414-6261-49a2-828a-fb924ec196d1 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:24.695017 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fb0414-6261-49a2-828a-fb924ec196d1 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:24.695292 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fb0414-6261-49a2-828a-fb924ec196d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:24.715124 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-d4fb0414-6261-49a2-828a-fb924ec196d1 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:26:24.716377 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-d4fb0414-6261-49a2-828a-fb924ec196d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:26:24.724941 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1053/2117] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:26:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:26:24.730006 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3f2675-1147-4977-8347-de675fd8cd8e None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:24.739931 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3f2675-1147-4977-8347-de675fd8cd8e None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:24.745755 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d310d8-1edd-47e6-a758-4f908df12c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:24.746405 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d310d8-1edd-47e6-a758-4f908df12c87 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:24.746686 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d310d8-1edd-47e6-a758-4f908df12c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:24.746960 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d310d8-1edd-47e6-a758-4f908df12c87 admin admin] PATH_INFO: `/v3/domains` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:24.747712 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d310d8-1edd-47e6-a758-4f908df12c87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:26:24.748035 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d310d8-1edd-47e6-a758-4f908df12c87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:24.749634 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d310d8-1edd-47e6-a758-4f908df12c87 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:24.762071 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1065/2118] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 9 20:26:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:26:24.766547 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fb0414-6261-49a2-828a-fb924ec196d1 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:24.777420 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fb0414-6261-49a2-828a-fb924ec196d1 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:24.782657 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fce3d47-563b-4b46-9d2c-7a680c352c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:24.783462 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce3d47-563b-4b46-9d2c-7a680c352c85 admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:24.783688 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce3d47-563b-4b46-9d2c-7a680c352c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:24.783979 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce3d47-563b-4b46-9d2c-7a680c352c85 admin admin] PATH_INFO: `/v3/projects` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:24.784726 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fce3d47-563b-4b46-9d2c-7a680c352c85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:24.786942 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fce3d47-563b-4b46-9d2c-7a680c352c85 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:24.818500 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1054/2119] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:26:24 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 20:26:24.819980 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d310d8-1edd-47e6-a758-4f908df12c87 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:24.829888 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d310d8-1edd-47e6-a758-4f908df12c87 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:24.886226 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae30881d-e26d-4afc-8705-1caa0aac3afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:24.887152 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae30881d-e26d-4afc-8705-1caa0aac3afd admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:24.887482 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae30881d-e26d-4afc-8705-1caa0aac3afd admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:24.887761 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae30881d-e26d-4afc-8705-1caa0aac3afd admin admin] PATH_INFO: `/v3/users` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:24.888454 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae30881d-e26d-4afc-8705-1caa0aac3afd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:24.890375 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae30881d-e26d-4afc-8705-1caa0aac3afd admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:24.912897 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1066/2120] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:26:24 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:26:24.918234 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fce3d47-563b-4b46-9d2c-7a680c352c85 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:24.929776 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fce3d47-563b-4b46-9d2c-7a680c352c85 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:24.934776 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60afabf7-9456-4444-84e1-6688e5001304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:24.935458 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60afabf7-9456-4444-84e1-6688e5001304 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:24.935736 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60afabf7-9456-4444-84e1-6688e5001304 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:24.936008 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60afabf7-9456-4444-84e1-6688e5001304 admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:24.936744 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60afabf7-9456-4444-84e1-6688e5001304 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:24.938337 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60afabf7-9456-4444-84e1-6688e5001304 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:24.951461 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1055/2121] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:26:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:26:24.952740 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae30881d-e26d-4afc-8705-1caa0aac3afd admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:24.963112 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae30881d-e26d-4afc-8705-1caa0aac3afd admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:24.967778 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c038cb05-bf9d-4b71-ad90-7c42eeaa4cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:24.968432 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c038cb05-bf9d-4b71-ad90-7c42eeaa4cff admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:24.968715 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c038cb05-bf9d-4b71-ad90-7c42eeaa4cff admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:24.968983 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c038cb05-bf9d-4b71-ad90-7c42eeaa4cff admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:24.969824 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c038cb05-bf9d-4b71-ad90-7c42eeaa4cff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:24.971486 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c038cb05-bf9d-4b71-ad90-7c42eeaa4cff admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:24.982863 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1067/2122] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:26:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:26:24.986940 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60afabf7-9456-4444-84e1-6688e5001304 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:24.997420 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60afabf7-9456-4444-84e1-6688e5001304 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:25.008520 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b149c5-4bab-4922-b3a8-7e12973d5e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:25.009564 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b149c5-4bab-4922-b3a8-7e12973d5e10 admin admin] REQUEST_METHOD: `PUT` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:25.009879 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b149c5-4bab-4922-b3a8-7e12973d5e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:25.010329 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b149c5-4bab-4922-b3a8-7e12973d5e10 admin admin] PATH_INFO: `/v3/projects/7cabe25dc5ef447e9ce5c6898298ffeb/users/4957fc6d9df04de6a744dd3312b3671c/roles/79f90a0bf6ea43d0b3c434e31556253a` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:25.030270 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b149c5-4bab-4922-b3a8-7e12973d5e10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cabe25dc5ef447e9ce5c6898298ffeb, user_id=4957fc6d9df04de6a744dd3312b3671c, role_id=79f90a0bf6ea43d0b3c434e31556253a)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:25.035418 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b149c5-4bab-4922-b3a8-7e12973d5e10 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:25.051266 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1056/2123] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:26:24 2022] PUT /identity/v3/projects/7cabe25dc5ef447e9ce5c6898298ffeb/users/4957fc6d9df04de6a744dd3312b3671c/roles/79f90a0bf6ea43d0b3c434e31556253a => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:26:25.062671 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63731edd-ec11-43c8-9cfd-63ce64c77ac5 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:25.063226 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63731edd-ec11-43c8-9cfd-63ce64c77ac5 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:25.063544 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63731edd-ec11-43c8-9cfd-63ce64c77ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:25.092917 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-63731edd-ec11-43c8-9cfd-63ce64c77ac5 None None] MFA Rules not processed for user `4957fc6d9df04de6a744dd3312b3671c`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:26:25.094112 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-63731edd-ec11-43c8-9cfd-63ce64c77ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:26:25.158893 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1068/2124] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:26:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:26:25.170501 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b149c5-4bab-4922-b3a8-7e12973d5e10 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:25.172205 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-81b149c5-4bab-4922-b3a8-7e12973d5e10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:26:25.225646 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b149c5-4bab-4922-b3a8-7e12973d5e10 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:25.229916 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810ae367-872b-4a80-9cd8-06d35add7cdf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d65e731386d44948dcc1ecd40cbda65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:25.230540 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ae367-872b-4a80-9cd8-06d35add7cdf service cinder] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:25.230813 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ae367-872b-4a80-9cd8-06d35add7cdf service cinder] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:25.231079 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ae367-872b-4a80-9cd8-06d35add7cdf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:25.239046 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810ae367-872b-4a80-9cd8-06d35add7cdf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:25.240485 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810ae367-872b-4a80-9cd8-06d35add7cdf service cinder] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:25.248967 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1057/2125] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:26:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:26:36.754343 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63731edd-ec11-43c8-9cfd-63ce64c77ac5 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:36.756499 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-63731edd-ec11-43c8-9cfd-63ce64c77ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:26:36.825394 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63731edd-ec11-43c8-9cfd-63ce64c77ac5 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:36.830140 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcc4c8a-183d-495f-aea8-4e887683192e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:36.831002 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc4c8a-183d-495f-aea8-4e887683192e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:36.831276 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc4c8a-183d-495f-aea8-4e887683192e admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:36.831572 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc4c8a-183d-495f-aea8-4e887683192e admin admin] PATH_INFO: `/v3/users/e3a48e36f64847ef9f609733789d3a28` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:36.832780 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcc4c8a-183d-495f-aea8-4e887683192e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3a48e36f64847ef9f609733789d3a28)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:36.834702 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcc4c8a-183d-495f-aea8-4e887683192e admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:36.877761 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-6dcc4c8a-183d-495f-aea8-4e887683192e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3a48e36f64847ef9f609733789d3a28'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:36.878399 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-6dcc4c8a-183d-495f-aea8-4e887683192e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3a48e36f64847ef9f609733789d3a28'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:36.885209 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-6dcc4c8a-183d-495f-aea8-4e887683192e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3a48e36f64847ef9f609733789d3a28'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:36.885838 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-6dcc4c8a-183d-495f-aea8-4e887683192e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3a48e36f64847ef9f609733789d3a28'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:36.893267 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-6dcc4c8a-183d-495f-aea8-4e887683192e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3a48e36f64847ef9f609733789d3a28'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:36.910867 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1069/2126] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:26:36 2022] DELETE /identity/v3/users/e3a48e36f64847ef9f609733789d3a28 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:26:36.916025 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eb3397-6464-4051-b3c7-98d50e5fa0ca None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:36.916517 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eb3397-6464-4051-b3c7-98d50e5fa0ca None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:36.916604 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eb3397-6464-4051-b3c7-98d50e5fa0ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:36.932940 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-55eb3397-6464-4051-b3c7-98d50e5fa0ca None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:26:36.934125 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-55eb3397-6464-4051-b3c7-98d50e5fa0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:26:36.990588 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1058/2127] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:26:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:26:37.000334 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcc4c8a-183d-495f-aea8-4e887683192e admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:37.001722 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-6dcc4c8a-183d-495f-aea8-4e887683192e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:26:37.055845 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcc4c8a-183d-495f-aea8-4e887683192e admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:37.059432 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a791b5-3597-4f95-90b0-ea293bd8228b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:37.060063 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a791b5-3597-4f95-90b0-ea293bd8228b service neutron] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:37.060338 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a791b5-3597-4f95-90b0-ea293bd8228b service neutron] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:37.060607 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a791b5-3597-4f95-90b0-ea293bd8228b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:37.069390 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a791b5-3597-4f95-90b0-ea293bd8228b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:37.070813 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a791b5-3597-4f95-90b0-ea293bd8228b service neutron] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:37.080077 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1070/2128] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:26:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 09 20:26:37.365778 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eb3397-6464-4051-b3c7-98d50e5fa0ca None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:37.367377 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-55eb3397-6464-4051-b3c7-98d50e5fa0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:26:37.380126 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eb3397-6464-4051-b3c7-98d50e5fa0ca None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:37.385529 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb73a13-4276-4e3d-a2ba-6f0fbcda767a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:37.386654 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb73a13-4276-4e3d-a2ba-6f0fbcda767a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:37.386948 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb73a13-4276-4e3d-a2ba-6f0fbcda767a admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:37.387218 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb73a13-4276-4e3d-a2ba-6f0fbcda767a admin admin] PATH_INFO: `/v3/projects/5336a0aabecd430fb4334fd3a98b0e7c` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:37.388442 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb73a13-4276-4e3d-a2ba-6f0fbcda767a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5336a0aabecd430fb4334fd3a98b0e7c)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:37.390376 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb73a13-4276-4e3d-a2ba-6f0fbcda767a admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:37.453111 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-bcb73a13-4276-4e3d-a2ba-6f0fbcda767a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5336a0aabecd430fb4334fd3a98b0e7c', 'request_id': 'req-bcb73a13-4276-4e3d-a2ba-6f0fbcda767a'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:37.459207 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-bcb73a13-4276-4e3d-a2ba-6f0fbcda767a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5336a0aabecd430fb4334fd3a98b0e7c', 'request_id': 'req-bcb73a13-4276-4e3d-a2ba-6f0fbcda767a'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:37.465304 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-bcb73a13-4276-4e3d-a2ba-6f0fbcda767a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5336a0aabecd430fb4334fd3a98b0e7c', 'request_id': 'req-bcb73a13-4276-4e3d-a2ba-6f0fbcda767a'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:37.477434 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-bcb73a13-4276-4e3d-a2ba-6f0fbcda767a admin admin] The token cache is being invalidate because project 5336a0aabecd430fb4334fd3a98b0e7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:26:37.477948 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-bcb73a13-4276-4e3d-a2ba-6f0fbcda767a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:37.478497 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-bcb73a13-4276-4e3d-a2ba-6f0fbcda767a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:37.480053 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1059/2129] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:26:37 2022] DELETE /identity/v3/projects/5336a0aabecd430fb4334fd3a98b0e7c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:26:37.484906 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a70b992-37ff-4324-8a41-a71905f42322 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:37.485193 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a70b992-37ff-4324-8a41-a71905f42322 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:37.485467 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a70b992-37ff-4324-8a41-a71905f42322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:37.502686 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-7a70b992-37ff-4324-8a41-a71905f42322 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:26:37.503932 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-7a70b992-37ff-4324-8a41-a71905f42322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:26:37.560829 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1071/2130] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:26:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:26:37.568559 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd95810-d797-4754-a12d-acfada183304 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:37.568842 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd95810-d797-4754-a12d-acfada183304 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:37.569115 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd95810-d797-4754-a12d-acfada183304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:37.588387 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-9cd95810-d797-4754-a12d-acfada183304 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:26:37.589628 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-9cd95810-d797-4754-a12d-acfada183304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:26:37.597280 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1060/2131] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:26:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:26:37.601475 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a70b992-37ff-4324-8a41-a71905f42322 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:37.611086 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a70b992-37ff-4324-8a41-a71905f42322 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:37.615602 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f99d4-0119-44ff-b6f4-d5384d6fd264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:37.616237 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f99d4-0119-44ff-b6f4-d5384d6fd264 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:37.616512 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f99d4-0119-44ff-b6f4-d5384d6fd264 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:37.616781 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f99d4-0119-44ff-b6f4-d5384d6fd264 admin admin] PATH_INFO: `/v3/domains` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:37.617494 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257f99d4-0119-44ff-b6f4-d5384d6fd264 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:26:37.617802 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257f99d4-0119-44ff-b6f4-d5384d6fd264 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:37.619543 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257f99d4-0119-44ff-b6f4-d5384d6fd264 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:37.630435 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1072/2132] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 9 20:26:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:26:37.635325 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd95810-d797-4754-a12d-acfada183304 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:37.644491 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd95810-d797-4754-a12d-acfada183304 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:37.650166 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce9f075-ebae-451b-bf81-130a670c3dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:37.650970 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9f075-ebae-451b-bf81-130a670c3dda admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:37.651256 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9f075-ebae-451b-bf81-130a670c3dda admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:37.651567 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9f075-ebae-451b-bf81-130a670c3dda admin admin] PATH_INFO: `/v3/projects` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:37.652252 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce9f075-ebae-451b-bf81-130a670c3dda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:37.654160 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce9f075-ebae-451b-bf81-130a670c3dda admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:37.682135 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1061/2133] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:26:37 2022] POST /identity/v3/projects => generated 369 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:26:37.686032 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f99d4-0119-44ff-b6f4-d5384d6fd264 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:37.696019 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f99d4-0119-44ff-b6f4-d5384d6fd264 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:37.702052 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce9f075-ebae-451b-bf81-130a670c3dda admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:37.704833 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-0ce9f075-ebae-451b-bf81-130a670c3dda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:26:37.761975 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca156ba2-361f-43eb-ba16-a5e391304d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:37.762628 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca156ba2-361f-43eb-ba16-a5e391304d9b admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:37.762905 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca156ba2-361f-43eb-ba16-a5e391304d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:37.763172 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca156ba2-361f-43eb-ba16-a5e391304d9b admin admin] PATH_INFO: `/v3/users` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:37.763878 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca156ba2-361f-43eb-ba16-a5e391304d9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:37.765788 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca156ba2-361f-43eb-ba16-a5e391304d9b admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:37.768813 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce9f075-ebae-451b-bf81-130a670c3dda admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:37.773546 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f9768-f195-45ac-9624-ff82504fff3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:37.774429 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f9768-f195-45ac-9624-ff82504fff3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:37.775094 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f9768-f195-45ac-9624-ff82504fff3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:37.775094 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f9768-f195-45ac-9624-ff82504fff3f admin admin] PATH_INFO: `/v3/users/4957fc6d9df04de6a744dd3312b3671c` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:37.776358 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1f9768-f195-45ac-9624-ff82504fff3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4957fc6d9df04de6a744dd3312b3671c)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:37.778483 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1f9768-f195-45ac-9624-ff82504fff3f admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:37.785548 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1073/2134] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:26:37 2022] POST /identity/v3/users => generated 285 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:26:37.789298 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca156ba2-361f-43eb-ba16-a5e391304d9b admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:37.798866 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca156ba2-361f-43eb-ba16-a5e391304d9b admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:37.804361 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fcf888-e6dd-4df1-ac53-f4637395ef8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:37.805095 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fcf888-e6dd-4df1-ac53-f4637395ef8b admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:37.805376 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fcf888-e6dd-4df1-ac53-f4637395ef8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:37.806169 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fcf888-e6dd-4df1-ac53-f4637395ef8b admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:37.807045 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fcf888-e6dd-4df1-ac53-f4637395ef8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:37.808755 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fcf888-e6dd-4df1-ac53-f4637395ef8b admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:37.828058 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1074/2135] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:26:37 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 09 20:26:37.828200 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-2d1f9768-f195-45ac-9624-ff82504fff3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4957fc6d9df04de6a744dd3312b3671c'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:37.829092 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fcf888-e6dd-4df1-ac53-f4637395ef8b admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:37.832589 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-2d1f9768-f195-45ac-9624-ff82504fff3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4957fc6d9df04de6a744dd3312b3671c'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:37.838841 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fcf888-e6dd-4df1-ac53-f4637395ef8b admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:37.841164 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-2d1f9768-f195-45ac-9624-ff82504fff3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4957fc6d9df04de6a744dd3312b3671c'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:37.841786 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-2d1f9768-f195-45ac-9624-ff82504fff3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4957fc6d9df04de6a744dd3312b3671c'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:37.842557 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-2d1f9768-f195-45ac-9624-ff82504fff3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4957fc6d9df04de6a744dd3312b3671c'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:37.843916 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0af851-2678-40ba-9d7d-3c1a694fd767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:37.844554 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0af851-2678-40ba-9d7d-3c1a694fd767 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:37.844835 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0af851-2678-40ba-9d7d-3c1a694fd767 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:37.845107 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0af851-2678-40ba-9d7d-3c1a694fd767 admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:37.845824 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0af851-2678-40ba-9d7d-3c1a694fd767 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:37.847427 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0af851-2678-40ba-9d7d-3c1a694fd767 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:37.858471 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1075/2136] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:26:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:26:37.860511 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1062/2137] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:26:37 2022] DELETE /identity/v3/users/4957fc6d9df04de6a744dd3312b3671c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:26:37.864181 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0af851-2678-40ba-9d7d-3c1a694fd767 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:37.864569 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349d691-3f7d-488b-b479-5c3da150bc24 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:37.864848 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349d691-3f7d-488b-b479-5c3da150bc24 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:37.865117 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349d691-3f7d-488b-b479-5c3da150bc24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:37.865877 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-6e0af851-2678-40ba-9d7d-3c1a694fd767 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:26:37.878966 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0af851-2678-40ba-9d7d-3c1a694fd767 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:37.882519 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-9349d691-3f7d-488b-b479-5c3da150bc24 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:26:37.884546 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-9349d691-3f7d-488b-b479-5c3da150bc24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:26:37.935332 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c27256d-e14a-4043-82d8-5c885cb590c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:37.936242 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c27256d-e14a-4043-82d8-5c885cb590c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:37.936522 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c27256d-e14a-4043-82d8-5c885cb590c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:37.936792 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c27256d-e14a-4043-82d8-5c885cb590c3 admin admin] PATH_INFO: `/v3/projects/89f7c7a9890c4e80beb1240a97247c83/users/c82f803ce4dd4a36b5848486497ecc25/roles/79f90a0bf6ea43d0b3c434e31556253a` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:37.943284 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1063/2138] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:26:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:26:37.952072 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c27256d-e14a-4043-82d8-5c885cb590c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89f7c7a9890c4e80beb1240a97247c83, user_id=c82f803ce4dd4a36b5848486497ecc25, role_id=79f90a0bf6ea43d0b3c434e31556253a)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:37.953250 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9349d691-3f7d-488b-b479-5c3da150bc24 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:37.954634 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-9349d691-3f7d-488b-b479-5c3da150bc24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:26:37.954843 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c27256d-e14a-4043-82d8-5c885cb590c3 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:37.968054 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1076/2139] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:26:37 2022] PUT /identity/v3/projects/89f7c7a9890c4e80beb1240a97247c83/users/c82f803ce4dd4a36b5848486497ecc25/roles/79f90a0bf6ea43d0b3c434e31556253a => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:26:37.978295 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7b746-a9e2-4c60-aeb3-dc1155fbee29 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:37.978478 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7b746-a9e2-4c60-aeb3-dc1155fbee29 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:37.978665 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7b746-a9e2-4c60-aeb3-dc1155fbee29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:38.006197 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-4ce7b746-a9e2-4c60-aeb3-dc1155fbee29 None None] MFA Rules not processed for user `c82f803ce4dd4a36b5848486497ecc25`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:26:38.007378 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-4ce7b746-a9e2-4c60-aeb3-dc1155fbee29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:26:38.012865 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9349d691-3f7d-488b-b479-5c3da150bc24 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:38.061000 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec85db48-47c5-42d0-9e4b-30059ef9a77f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:38.061645 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec85db48-47c5-42d0-9e4b-30059ef9a77f service neutron] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:38.061924 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec85db48-47c5-42d0-9e4b-30059ef9a77f service neutron] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:38.062222 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec85db48-47c5-42d0-9e4b-30059ef9a77f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:38.072184 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1077/2140] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:26:37 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:26:38.083889 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce7b746-a9e2-4c60-aeb3-dc1155fbee29 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:38.085228 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-4ce7b746-a9e2-4c60-aeb3-dc1155fbee29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:26:38.120275 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec85db48-47c5-42d0-9e4b-30059ef9a77f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:38.121627 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec85db48-47c5-42d0-9e4b-30059ef9a77f service neutron] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:38.130911 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1064/2141] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:26:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 09 20:26:38.141312 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce7b746-a9e2-4c60-aeb3-dc1155fbee29 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:38.150725 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61fba11-b532-4eaf-b69f-9f735b75e26b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d65e731386d44948dcc1ecd40cbda65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:38.151388 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61fba11-b532-4eaf-b69f-9f735b75e26b service cinder] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:38.151700 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61fba11-b532-4eaf-b69f-9f735b75e26b service cinder] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:38.151978 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61fba11-b532-4eaf-b69f-9f735b75e26b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:38.160600 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61fba11-b532-4eaf-b69f-9f735b75e26b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:38.162022 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61fba11-b532-4eaf-b69f-9f735b75e26b service cinder] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:38.170921 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1078/2142] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:26:38 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 09 20:26:38.198505 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec85db48-47c5-42d0-9e4b-30059ef9a77f service neutron] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:38.214971 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec85db48-47c5-42d0-9e4b-30059ef9a77f service neutron] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:38.220467 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4257575d-98bd-40a9-be1d-fd6e2eb28dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:38.221538 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257575d-98bd-40a9-be1d-fd6e2eb28dc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:38.222003 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257575d-98bd-40a9-be1d-fd6e2eb28dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:38.222346 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257575d-98bd-40a9-be1d-fd6e2eb28dc9 admin admin] PATH_INFO: `/v3/users/c82f803ce4dd4a36b5848486497ecc25` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:38.223681 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4257575d-98bd-40a9-be1d-fd6e2eb28dc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c82f803ce4dd4a36b5848486497ecc25)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:38.225955 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4257575d-98bd-40a9-be1d-fd6e2eb28dc9 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:38.275068 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-4257575d-98bd-40a9-be1d-fd6e2eb28dc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c82f803ce4dd4a36b5848486497ecc25'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:38.282186 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-4257575d-98bd-40a9-be1d-fd6e2eb28dc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c82f803ce4dd4a36b5848486497ecc25'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:38.290122 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-4257575d-98bd-40a9-be1d-fd6e2eb28dc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c82f803ce4dd4a36b5848486497ecc25'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:38.290919 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-4257575d-98bd-40a9-be1d-fd6e2eb28dc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c82f803ce4dd4a36b5848486497ecc25'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:38.291562 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-4257575d-98bd-40a9-be1d-fd6e2eb28dc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c82f803ce4dd4a36b5848486497ecc25'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:38.307918 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1065/2143] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:26:38 2022] DELETE /identity/v3/users/c82f803ce4dd4a36b5848486497ecc25 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:26:38.312654 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f372892-4ce2-4ed0-970a-015180fce476 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:38.312938 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f372892-4ce2-4ed0-970a-015180fce476 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:38.313209 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f372892-4ce2-4ed0-970a-015180fce476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:38.331087 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-9f372892-4ce2-4ed0-970a-015180fce476 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:26:38.332321 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-9f372892-4ce2-4ed0-970a-015180fce476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:26:38.389981 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1079/2144] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:26:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:26:38.401466 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4257575d-98bd-40a9-be1d-fd6e2eb28dc9 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:38.403368 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-4257575d-98bd-40a9-be1d-fd6e2eb28dc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:26:38.411020 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f372892-4ce2-4ed0-970a-015180fce476 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:38.412444 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-9f372892-4ce2-4ed0-970a-015180fce476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:26:38.424855 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f372892-4ce2-4ed0-970a-015180fce476 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:38.429778 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1dca6-8efb-4ee1-94f3-1d0c729f94e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:38.432249 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1dca6-8efb-4ee1-94f3-1d0c729f94e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:38.432536 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1dca6-8efb-4ee1-94f3-1d0c729f94e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:38.432816 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1dca6-8efb-4ee1-94f3-1d0c729f94e7 admin admin] PATH_INFO: `/v3/projects/7cabe25dc5ef447e9ce5c6898298ffeb` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:38.434161 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb1dca6-8efb-4ee1-94f3-1d0c729f94e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cabe25dc5ef447e9ce5c6898298ffeb)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:38.436118 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb1dca6-8efb-4ee1-94f3-1d0c729f94e7 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:38.471937 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4257575d-98bd-40a9-be1d-fd6e2eb28dc9 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:38.486752 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-abb1dca6-8efb-4ee1-94f3-1d0c729f94e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cabe25dc5ef447e9ce5c6898298ffeb', 'request_id': 'req-abb1dca6-8efb-4ee1-94f3-1d0c729f94e7'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:38.494124 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-abb1dca6-8efb-4ee1-94f3-1d0c729f94e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cabe25dc5ef447e9ce5c6898298ffeb', 'request_id': 'req-abb1dca6-8efb-4ee1-94f3-1d0c729f94e7'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:38.500253 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-abb1dca6-8efb-4ee1-94f3-1d0c729f94e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cabe25dc5ef447e9ce5c6898298ffeb', 'request_id': 'req-abb1dca6-8efb-4ee1-94f3-1d0c729f94e7'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:38.513842 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-abb1dca6-8efb-4ee1-94f3-1d0c729f94e7 admin admin] The token cache is being invalidate because project 7cabe25dc5ef447e9ce5c6898298ffeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:26:38.514129 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-abb1dca6-8efb-4ee1-94f3-1d0c729f94e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:38.514788 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-abb1dca6-8efb-4ee1-94f3-1d0c729f94e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:38.516606 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1080/2145] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:26:38 2022] DELETE /identity/v3/projects/7cabe25dc5ef447e9ce5c6898298ffeb => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:26:38.521122 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e372d451-2766-4393-bd55-53eff80ace33 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:38.521477 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e372d451-2766-4393-bd55-53eff80ace33 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:38.521860 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e372d451-2766-4393-bd55-53eff80ace33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:38.524454 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665925ca-31c9-469f-97a9-f7477a91a5c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:38.525186 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665925ca-31c9-469f-97a9-f7477a91a5c2 service neutron] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:38.525464 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665925ca-31c9-469f-97a9-f7477a91a5c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:38.525740 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665925ca-31c9-469f-97a9-f7477a91a5c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:38.527593 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-665925ca-31c9-469f-97a9-f7477a91a5c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:26:38.544920 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-e372d451-2766-4393-bd55-53eff80ace33 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:26:38.546881 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-e372d451-2766-4393-bd55-53eff80ace33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:26:38.598004 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665925ca-31c9-469f-97a9-f7477a91a5c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:38.599495 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665925ca-31c9-469f-97a9-f7477a91a5c2 service neutron] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:38.610772 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1081/2146] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:26:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:26:38.611616 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1066/2147] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:26:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:26:38.618812 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3297f4-0184-480f-9159-fbc095708dee None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:38.619297 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3297f4-0184-480f-9159-fbc095708dee None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:38.620065 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3297f4-0184-480f-9159-fbc095708dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:38.637857 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-0a3297f4-0184-480f-9159-fbc095708dee None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:26:38.639063 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-0a3297f4-0184-480f-9159-fbc095708dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:26:38.647110 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1082/2148] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:26:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:26:38.651896 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665925ca-31c9-469f-97a9-f7477a91a5c2 service neutron] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:38.661546 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665925ca-31c9-469f-97a9-f7477a91a5c2 service neutron] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:38.667800 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db89257-dba4-448b-adf0-43829b1edc5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:38.668535 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db89257-dba4-448b-adf0-43829b1edc5b admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:38.668935 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db89257-dba4-448b-adf0-43829b1edc5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:38.669264 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db89257-dba4-448b-adf0-43829b1edc5b admin admin] PATH_INFO: `/v3/domains` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:38.669976 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db89257-dba4-448b-adf0-43829b1edc5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:26:38.670276 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db89257-dba4-448b-adf0-43829b1edc5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:38.672142 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db89257-dba4-448b-adf0-43829b1edc5b admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:38.685252 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1067/2149] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 9 20:26:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:26:38.690369 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3297f4-0184-480f-9159-fbc095708dee None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:38.699923 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3297f4-0184-480f-9159-fbc095708dee None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:38.704530 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc68c3c6-d8c9-44e6-b162-c3fc2473ae96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:38.705178 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc68c3c6-d8c9-44e6-b162-c3fc2473ae96 admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:38.705454 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc68c3c6-d8c9-44e6-b162-c3fc2473ae96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:38.705726 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc68c3c6-d8c9-44e6-b162-c3fc2473ae96 admin admin] PATH_INFO: `/v3/projects` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:38.706672 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc68c3c6-d8c9-44e6-b162-c3fc2473ae96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:38.708612 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc68c3c6-d8c9-44e6-b162-c3fc2473ae96 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:38.740438 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1083/2150] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:26:38 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:26:38.742012 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db89257-dba4-448b-adf0-43829b1edc5b admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:38.752832 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db89257-dba4-448b-adf0-43829b1edc5b admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:38.828664 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791db043-1cd3-47e1-ac78-c1778c225d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:38.829415 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791db043-1cd3-47e1-ac78-c1778c225d50 admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:38.829764 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791db043-1cd3-47e1-ac78-c1778c225d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:38.830107 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791db043-1cd3-47e1-ac78-c1778c225d50 admin admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:38.830851 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791db043-1cd3-47e1-ac78-c1778c225d50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:38.832893 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791db043-1cd3-47e1-ac78-c1778c225d50 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:38.856295 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1068/2151] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:26:38 2022] POST /identity/v3/users => generated 289 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:26:38.857515 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc68c3c6-d8c9-44e6-b162-c3fc2473ae96 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:38.868847 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc68c3c6-d8c9-44e6-b162-c3fc2473ae96 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:38.875957 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3670ef49-fa12-4f5e-bf45-223ccb35fedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:38.876693 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3670ef49-fa12-4f5e-bf45-223ccb35fedd admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:38.877034 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3670ef49-fa12-4f5e-bf45-223ccb35fedd admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:38.877500 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3670ef49-fa12-4f5e-bf45-223ccb35fedd admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:38.878322 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3670ef49-fa12-4f5e-bf45-223ccb35fedd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:38.880110 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3670ef49-fa12-4f5e-bf45-223ccb35fedd admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:38.895302 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1084/2152] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:26:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:26:38.896475 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791db043-1cd3-47e1-ac78-c1778c225d50 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:38.902917 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3670ef49-fa12-4f5e-bf45-223ccb35fedd admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:38.904870 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-3670ef49-fa12-4f5e-bf45-223ccb35fedd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:26:38.908287 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791db043-1cd3-47e1-ac78-c1778c225d50 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:38.913464 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197ab474-4e7e-45b9-97c1-34b6febd8234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:38.914247 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ab474-4e7e-45b9-97c1-34b6febd8234 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:38.914592 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ab474-4e7e-45b9-97c1-34b6febd8234 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:38.915512 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ab474-4e7e-45b9-97c1-34b6febd8234 admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:38.916648 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197ab474-4e7e-45b9-97c1-34b6febd8234 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:38.918350 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197ab474-4e7e-45b9-97c1-34b6febd8234 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:38.923827 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3670ef49-fa12-4f5e-bf45-223ccb35fedd admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:38.929079 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbd96f8-bafb-498c-8a04-a051ac8ea26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:38.929557 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1069/2153] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:26:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:26:38.933668 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd96f8-bafb-498c-8a04-a051ac8ea26a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:38.933873 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd96f8-bafb-498c-8a04-a051ac8ea26a admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:38.934153 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd96f8-bafb-498c-8a04-a051ac8ea26a admin admin] PATH_INFO: `/v3/projects/89f7c7a9890c4e80beb1240a97247c83` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:38.934447 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197ab474-4e7e-45b9-97c1-34b6febd8234 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:38.935581 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbd96f8-bafb-498c-8a04-a051ac8ea26a admin admin] RBAC: Authorizing `identity:delete_project(project_id=89f7c7a9890c4e80beb1240a97247c83)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:38.937594 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbd96f8-bafb-498c-8a04-a051ac8ea26a admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:38.944888 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197ab474-4e7e-45b9-97c1-34b6febd8234 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:38.951210 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea2c40e-6bd1-4100-9b1e-3d0ac0ba1c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:38.952118 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea2c40e-6bd1-4100-9b1e-3d0ac0ba1c26 admin admin] REQUEST_METHOD: `PUT` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:38.952391 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea2c40e-6bd1-4100-9b1e-3d0ac0ba1c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:38.952656 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea2c40e-6bd1-4100-9b1e-3d0ac0ba1c26 admin admin] PATH_INFO: `/v3/projects/b00becd4a9ab4b44a5627b6f311f7e23/users/91345b6cd3ab4a59bdf040e1cf18e5e2/roles/79f90a0bf6ea43d0b3c434e31556253a` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:38.969108 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea2c40e-6bd1-4100-9b1e-3d0ac0ba1c26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b00becd4a9ab4b44a5627b6f311f7e23, user_id=91345b6cd3ab4a59bdf040e1cf18e5e2, role_id=79f90a0bf6ea43d0b3c434e31556253a)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:38.972055 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea2c40e-6bd1-4100-9b1e-3d0ac0ba1c26 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:38.986506 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-8fbd96f8-bafb-498c-8a04-a051ac8ea26a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89f7c7a9890c4e80beb1240a97247c83', 'request_id': 'req-8fbd96f8-bafb-498c-8a04-a051ac8ea26a'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:38.986903 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1070/2154] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:26:38 2022] PUT /identity/v3/projects/b00becd4a9ab4b44a5627b6f311f7e23/users/91345b6cd3ab4a59bdf040e1cf18e5e2/roles/79f90a0bf6ea43d0b3c434e31556253a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:26:38.993140 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-8fbd96f8-bafb-498c-8a04-a051ac8ea26a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89f7c7a9890c4e80beb1240a97247c83', 'request_id': 'req-8fbd96f8-bafb-498c-8a04-a051ac8ea26a'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:38.997781 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2834f8-6f7f-4675-9ae5-45d9df73d33d None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:38.998090 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2834f8-6f7f-4675-9ae5-45d9df73d33d None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:38.998552 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2834f8-6f7f-4675-9ae5-45d9df73d33d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:38.999234 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-8fbd96f8-bafb-498c-8a04-a051ac8ea26a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89f7c7a9890c4e80beb1240a97247c83', 'request_id': 'req-8fbd96f8-bafb-498c-8a04-a051ac8ea26a'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:39.013061 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-8fbd96f8-bafb-498c-8a04-a051ac8ea26a admin admin] The token cache is being invalidate because project 89f7c7a9890c4e80beb1240a97247c83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:26:39.013408 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-8fbd96f8-bafb-498c-8a04-a051ac8ea26a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:39.014348 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-8fbd96f8-bafb-498c-8a04-a051ac8ea26a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:26:39.016191 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1085/2155] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:26:38 2022] DELETE /identity/v3/projects/89f7c7a9890c4e80beb1240a97247c83 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:26:39.030016 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-8e2834f8-6f7f-4675-9ae5-45d9df73d33d None None] MFA Rules not processed for user `91345b6cd3ab4a59bdf040e1cf18e5e2`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:26:39.031435 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-8e2834f8-6f7f-4675-9ae5-45d9df73d33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:26:39.105959 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1071/2156] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:26:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:26:39.117560 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbd96f8-bafb-498c-8a04-a051ac8ea26a admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:26:39.119294 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-8fbd96f8-bafb-498c-8a04-a051ac8ea26a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:26:39.180363 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbd96f8-bafb-498c-8a04-a051ac8ea26a admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:26:39.232278 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1168de-ceec-4c5e-9d49-f7f20d4950f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d65e731386d44948dcc1ecd40cbda65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:26:39.232912 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1168de-ceec-4c5e-9d49-f7f20d4950f9 service cinder] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:26:39.233188 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1168de-ceec-4c5e-9d49-f7f20d4950f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:26:39.233457 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1168de-ceec-4c5e-9d49-f7f20d4950f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:26:39.241450 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1168de-ceec-4c5e-9d49-f7f20d4950f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:26:39.242854 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1168de-ceec-4c5e-9d49-f7f20d4950f9 service cinder] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:26:39.251836 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1086/2157] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:26:39 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:27:06.791415 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2834f8-6f7f-4675-9ae5-45d9df73d33d None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:27:06.792855 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-8e2834f8-6f7f-4675-9ae5-45d9df73d33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:27:06.921374 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2834f8-6f7f-4675-9ae5-45d9df73d33d None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:27:06.926070 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038101b0-74f2-4703-b70f-f644de90e0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:27:06.926915 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038101b0-74f2-4703-b70f-f644de90e0ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:27:06.927244 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038101b0-74f2-4703-b70f-f644de90e0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:27:06.927545 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038101b0-74f2-4703-b70f-f644de90e0ea admin admin] PATH_INFO: `/v3/users/5175d6860a0a436691aefb541ef0bd91` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:27:06.928799 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038101b0-74f2-4703-b70f-f644de90e0ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=5175d6860a0a436691aefb541ef0bd91)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:27:06.930913 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038101b0-74f2-4703-b70f-f644de90e0ea admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:27:06.979063 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-038101b0-74f2-4703-b70f-f644de90e0ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5175d6860a0a436691aefb541ef0bd91'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:27:06.985896 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-038101b0-74f2-4703-b70f-f644de90e0ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5175d6860a0a436691aefb541ef0bd91'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:27:06.994811 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-038101b0-74f2-4703-b70f-f644de90e0ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5175d6860a0a436691aefb541ef0bd91'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:27:06.995515 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-038101b0-74f2-4703-b70f-f644de90e0ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5175d6860a0a436691aefb541ef0bd91'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:27:06.996290 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-038101b0-74f2-4703-b70f-f644de90e0ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5175d6860a0a436691aefb541ef0bd91'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:27:07.016347 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1072/2158] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:27:06 2022] DELETE /identity/v3/users/5175d6860a0a436691aefb541ef0bd91 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:27:07.021026 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9083df4-1494-4b27-8285-a9e3f44dcb9c None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:27:07.021560 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9083df4-1494-4b27-8285-a9e3f44dcb9c None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:27:07.021665 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9083df4-1494-4b27-8285-a9e3f44dcb9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:27:07.050834 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-e9083df4-1494-4b27-8285-a9e3f44dcb9c None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:27:07.052188 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-e9083df4-1494-4b27-8285-a9e3f44dcb9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:27:07.115567 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1087/2159] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:27:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:27:07.126973 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038101b0-74f2-4703-b70f-f644de90e0ea admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:27:07.128672 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-038101b0-74f2-4703-b70f-f644de90e0ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:27:07.234436 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038101b0-74f2-4703-b70f-f644de90e0ea admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:27:07.238216 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c082633f-d7f1-4639-bc8f-f794e7d9c127 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:27:07.238851 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c082633f-d7f1-4639-bc8f-f794e7d9c127 service neutron] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:27:07.239129 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c082633f-d7f1-4639-bc8f-f794e7d9c127 service neutron] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:27:07.239416 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c082633f-d7f1-4639-bc8f-f794e7d9c127 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:27:07.248280 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c082633f-d7f1-4639-bc8f-f794e7d9c127 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:27:07.249705 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c082633f-d7f1-4639-bc8f-f794e7d9c127 service neutron] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:27:07.259462 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1073/2160] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:27:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:27:07.521209 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9083df4-1494-4b27-8285-a9e3f44dcb9c None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:27:07.522650 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-e9083df4-1494-4b27-8285-a9e3f44dcb9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:27:07.536111 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9083df4-1494-4b27-8285-a9e3f44dcb9c None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:27:07.541100 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1f9822-d1e0-453c-a78c-cabc304c1c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:27:07.542000 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f9822-d1e0-453c-a78c-cabc304c1c15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:27:07.542286 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f9822-d1e0-453c-a78c-cabc304c1c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:27:07.542556 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f9822-d1e0-453c-a78c-cabc304c1c15 admin admin] PATH_INFO: `/v3/projects/b7e836339ae447f0b6c9cb4647d5553b` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:27:07.543772 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1f9822-d1e0-453c-a78c-cabc304c1c15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7e836339ae447f0b6c9cb4647d5553b)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:27:07.545673 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1f9822-d1e0-453c-a78c-cabc304c1c15 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:27:07.592822 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-7c1f9822-d1e0-453c-a78c-cabc304c1c15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7e836339ae447f0b6c9cb4647d5553b', 'request_id': 'req-7c1f9822-d1e0-453c-a78c-cabc304c1c15'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:27:07.598688 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-7c1f9822-d1e0-453c-a78c-cabc304c1c15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7e836339ae447f0b6c9cb4647d5553b', 'request_id': 'req-7c1f9822-d1e0-453c-a78c-cabc304c1c15'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:27:07.604063 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-7c1f9822-d1e0-453c-a78c-cabc304c1c15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7e836339ae447f0b6c9cb4647d5553b', 'request_id': 'req-7c1f9822-d1e0-453c-a78c-cabc304c1c15'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:27:07.617049 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-7c1f9822-d1e0-453c-a78c-cabc304c1c15 admin admin] The token cache is being invalidate because project b7e836339ae447f0b6c9cb4647d5553b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:27:07.617611 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-7c1f9822-d1e0-453c-a78c-cabc304c1c15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:27:07.618236 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-7c1f9822-d1e0-453c-a78c-cabc304c1c15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:27:07.619857 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1088/2161] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:27:07 2022] DELETE /identity/v3/projects/b7e836339ae447f0b6c9cb4647d5553b => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:27:09.108517 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c082633f-d7f1-4639-bc8f-f794e7d9c127 service neutron] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:27:09.109954 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-c082633f-d7f1-4639-bc8f-f794e7d9c127 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:27:09.123110 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c082633f-d7f1-4639-bc8f-f794e7d9c127 service neutron] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:27:09.180318 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47ea4f-3dfe-403f-b5e6-b8c739da2bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:27:09.181174 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47ea4f-3dfe-403f-b5e6-b8c739da2bc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:27:09.181450 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47ea4f-3dfe-403f-b5e6-b8c739da2bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:27:09.181717 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47ea4f-3dfe-403f-b5e6-b8c739da2bc9 admin admin] PATH_INFO: `/v3/users/91345b6cd3ab4a59bdf040e1cf18e5e2` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:27:09.182891 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c47ea4f-3dfe-403f-b5e6-b8c739da2bc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91345b6cd3ab4a59bdf040e1cf18e5e2)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:27:09.184846 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c47ea4f-3dfe-403f-b5e6-b8c739da2bc9 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:27:09.231063 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-3c47ea4f-3dfe-403f-b5e6-b8c739da2bc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91345b6cd3ab4a59bdf040e1cf18e5e2'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:27:09.238242 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-3c47ea4f-3dfe-403f-b5e6-b8c739da2bc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91345b6cd3ab4a59bdf040e1cf18e5e2'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:27:09.245358 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-3c47ea4f-3dfe-403f-b5e6-b8c739da2bc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91345b6cd3ab4a59bdf040e1cf18e5e2'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:27:09.246104 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-3c47ea4f-3dfe-403f-b5e6-b8c739da2bc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91345b6cd3ab4a59bdf040e1cf18e5e2'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:27:09.246798 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-3c47ea4f-3dfe-403f-b5e6-b8c739da2bc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91345b6cd3ab4a59bdf040e1cf18e5e2'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:27:09.264406 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1074/2162] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:27:09 2022] DELETE /identity/v3/users/91345b6cd3ab4a59bdf040e1cf18e5e2 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:27:09.268953 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613616ea-f712-4b39-8c8c-dbfc83fd35ca None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:27:09.269427 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613616ea-f712-4b39-8c8c-dbfc83fd35ca None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:27:09.269537 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613616ea-f712-4b39-8c8c-dbfc83fd35ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:27:09.287720 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-613616ea-f712-4b39-8c8c-dbfc83fd35ca None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:27:09.289032 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-613616ea-f712-4b39-8c8c-dbfc83fd35ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:27:09.348722 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1089/2163] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:27:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:27:09.359667 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47ea4f-3dfe-403f-b5e6-b8c739da2bc9 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:27:09.361109 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-3c47ea4f-3dfe-403f-b5e6-b8c739da2bc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:27:09.417539 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47ea4f-3dfe-403f-b5e6-b8c739da2bc9 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:27:09.421272 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5fdac1-22a6-49ef-944a-c7619bacc9a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:27:09.421916 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5fdac1-22a6-49ef-944a-c7619bacc9a0 service neutron] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:27:09.422511 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5fdac1-22a6-49ef-944a-c7619bacc9a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:27:09.422511 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5fdac1-22a6-49ef-944a-c7619bacc9a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:27:09.433455 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5fdac1-22a6-49ef-944a-c7619bacc9a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:27:09.434907 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5fdac1-22a6-49ef-944a-c7619bacc9a0 service neutron] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:27:09.444724 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1075/2164] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:27:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:27:09.462267 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481fa243-5e51-4d46-9dd6-8332a0be9cc6 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:27:09.462410 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481fa243-5e51-4d46-9dd6-8332a0be9cc6 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:27:09.462670 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481fa243-5e51-4d46-9dd6-8332a0be9cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:27:09.480432 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-481fa243-5e51-4d46-9dd6-8332a0be9cc6 None None] MFA Rules not processed for user `797d7c0dfda747549456236e9e639466`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:27:09.481777 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-481fa243-5e51-4d46-9dd6-8332a0be9cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:27:09.539702 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1090/2165] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:27:09 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:27:09.728780 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5fdac1-22a6-49ef-944a-c7619bacc9a0 service neutron] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:27:09.730352 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-8e5fdac1-22a6-49ef-944a-c7619bacc9a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:27:09.749928 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5fdac1-22a6-49ef-944a-c7619bacc9a0 service neutron] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:27:09.762095 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a7256f-cb31-49b4-b72d-3b2e4a6d4e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:27:09.762940 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a7256f-cb31-49b4-b72d-3b2e4a6d4e9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:27:09.763215 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a7256f-cb31-49b4-b72d-3b2e4a6d4e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:27:09.763513 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a7256f-cb31-49b4-b72d-3b2e4a6d4e9c admin admin] PATH_INFO: `/v3/projects/b00becd4a9ab4b44a5627b6f311f7e23` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:27:09.764688 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a7256f-cb31-49b4-b72d-3b2e4a6d4e9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b00becd4a9ab4b44a5627b6f311f7e23)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:27:09.766711 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a7256f-cb31-49b4-b72d-3b2e4a6d4e9c admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:27:09.814293 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-35a7256f-cb31-49b4-b72d-3b2e4a6d4e9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b00becd4a9ab4b44a5627b6f311f7e23', 'request_id': 'req-35a7256f-cb31-49b4-b72d-3b2e4a6d4e9c'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:27:09.820745 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-35a7256f-cb31-49b4-b72d-3b2e4a6d4e9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b00becd4a9ab4b44a5627b6f311f7e23', 'request_id': 'req-35a7256f-cb31-49b4-b72d-3b2e4a6d4e9c'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:27:09.826469 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-35a7256f-cb31-49b4-b72d-3b2e4a6d4e9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b00becd4a9ab4b44a5627b6f311f7e23', 'request_id': 'req-35a7256f-cb31-49b4-b72d-3b2e4a6d4e9c'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:27:09.839606 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-35a7256f-cb31-49b4-b72d-3b2e4a6d4e9c admin admin] The token cache is being invalidate because project b00becd4a9ab4b44a5627b6f311f7e23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:27:09.839958 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-35a7256f-cb31-49b4-b72d-3b2e4a6d4e9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:27:09.840656 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-35a7256f-cb31-49b4-b72d-3b2e4a6d4e9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:27:09.842545 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1076/2166] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:27:09 2022] DELETE /identity/v3/projects/b00becd4a9ab4b44a5627b6f311f7e23 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:27:09.847147 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8d58a-137f-434b-932b-cb485934cc2f None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:27:09.847541 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8d58a-137f-434b-932b-cb485934cc2f None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:27:09.847890 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8d58a-137f-434b-932b-cb485934cc2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:27:09.894865 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-d3a8d58a-137f-434b-932b-cb485934cc2f None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:27:09.896083 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-d3a8d58a-137f-434b-932b-cb485934cc2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:27:09.953779 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1091/2167] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:27:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:27:09.961822 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4c71f-a766-4275-b2c3-70a7069e9f5e None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:27:09.962105 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4c71f-a766-4275-b2c3-70a7069e9f5e None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:27:09.962402 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4c71f-a766-4275-b2c3-70a7069e9f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:27:09.981180 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-c8f4c71f-a766-4275-b2c3-70a7069e9f5e None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:27:09.982443 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-c8f4c71f-a766-4275-b2c3-70a7069e9f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:27:09.990368 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1077/2168] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:27:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:27:09.995413 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a8d58a-137f-434b-932b-cb485934cc2f None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:27:10.004874 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a8d58a-137f-434b-932b-cb485934cc2f None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:27:10.010172 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b3ca69-fc24-415c-ac23-8b9110be1eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:27:10.010819 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b3ca69-fc24-415c-ac23-8b9110be1eaa admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:27:10.011099 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b3ca69-fc24-415c-ac23-8b9110be1eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:27:10.011683 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b3ca69-fc24-415c-ac23-8b9110be1eaa admin admin] PATH_INFO: `/v3/domains` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:27:10.012412 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b3ca69-fc24-415c-ac23-8b9110be1eaa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:27:10.012715 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b3ca69-fc24-415c-ac23-8b9110be1eaa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:27:10.014319 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b3ca69-fc24-415c-ac23-8b9110be1eaa admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:27:10.029248 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1092/2169] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 9 20:27:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:27:10.030604 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f4c71f-a766-4275-b2c3-70a7069e9f5e None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:27:10.039789 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f4c71f-a766-4275-b2c3-70a7069e9f5e None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:27:10.044659 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cc1fa1-a4ce-4a9d-9a6b-da965c4d4d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:27:10.045237 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc1fa1-a4ce-4a9d-9a6b-da965c4d4d5e admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:27:10.045832 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc1fa1-a4ce-4a9d-9a6b-da965c4d4d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:27:10.045832 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc1fa1-a4ce-4a9d-9a6b-da965c4d4d5e admin admin] PATH_INFO: `/v3/projects` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:27:10.046453 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cc1fa1-a4ce-4a9d-9a6b-da965c4d4d5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:27:10.048427 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cc1fa1-a4ce-4a9d-9a6b-da965c4d4d5e admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:27:10.075735 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1078/2170] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:27:10 2022] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:27:10.079991 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b3ca69-fc24-415c-ac23-8b9110be1eaa admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:27:10.090435 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b3ca69-fc24-415c-ac23-8b9110be1eaa admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:27:10.146616 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a73704-2dc4-4af0-ac31-a6841a84f029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:27:10.147346 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a73704-2dc4-4af0-ac31-a6841a84f029 admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:27:10.148145 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a73704-2dc4-4af0-ac31-a6841a84f029 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:27:10.148145 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a73704-2dc4-4af0-ac31-a6841a84f029 admin admin] PATH_INFO: `/v3/users` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:27:10.149313 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a73704-2dc4-4af0-ac31-a6841a84f029 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:27:10.151484 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a73704-2dc4-4af0-ac31-a6841a84f029 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:27:10.174350 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1093/2171] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:27:10 2022] POST /identity/v3/users => generated 291 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:27:10.178061 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cc1fa1-a4ce-4a9d-9a6b-da965c4d4d5e admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:27:10.188736 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cc1fa1-a4ce-4a9d-9a6b-da965c4d4d5e admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:27:10.193615 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba03cb71-ac64-498a-9f96-53115f087087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:27:10.194270 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba03cb71-ac64-498a-9f96-53115f087087 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:27:10.194549 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba03cb71-ac64-498a-9f96-53115f087087 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:27:10.194819 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba03cb71-ac64-498a-9f96-53115f087087 admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:27:10.195790 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba03cb71-ac64-498a-9f96-53115f087087 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:27:10.197410 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba03cb71-ac64-498a-9f96-53115f087087 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:27:10.207956 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1079/2172] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:27:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 09 20:27:10.212405 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a73704-2dc4-4af0-ac31-a6841a84f029 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:27:10.222850 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a73704-2dc4-4af0-ac31-a6841a84f029 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:27:10.229905 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847e9d94-1bd9-4299-9ae3-dbbc03119685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:27:10.230638 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e9d94-1bd9-4299-9ae3-dbbc03119685 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:27:10.230988 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e9d94-1bd9-4299-9ae3-dbbc03119685 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:27:10.231328 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e9d94-1bd9-4299-9ae3-dbbc03119685 admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:27:10.232156 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847e9d94-1bd9-4299-9ae3-dbbc03119685 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:27:10.233887 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847e9d94-1bd9-4299-9ae3-dbbc03119685 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:27:10.244730 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1094/2173] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:27:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:27:10.248564 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba03cb71-ac64-498a-9f96-53115f087087 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:27:10.259061 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba03cb71-ac64-498a-9f96-53115f087087 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:27:10.264061 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0706aaaa-f301-4c98-96f0-6c539fe18cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:27:10.264934 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706aaaa-f301-4c98-96f0-6c539fe18cbc admin admin] REQUEST_METHOD: `PUT` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:27:10.265215 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706aaaa-f301-4c98-96f0-6c539fe18cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:27:10.265488 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706aaaa-f301-4c98-96f0-6c539fe18cbc admin admin] PATH_INFO: `/v3/projects/970fffc753884be893292412dc3a6f69/users/3e50a700ac8f4e708b23e35ffa57e4cf/roles/79f90a0bf6ea43d0b3c434e31556253a` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:27:10.285063 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0706aaaa-f301-4c98-96f0-6c539fe18cbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=970fffc753884be893292412dc3a6f69, user_id=3e50a700ac8f4e708b23e35ffa57e4cf, role_id=79f90a0bf6ea43d0b3c434e31556253a)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:27:10.287748 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0706aaaa-f301-4c98-96f0-6c539fe18cbc admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:27:10.302273 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1080/2174] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:27:10 2022] PUT /identity/v3/projects/970fffc753884be893292412dc3a6f69/users/3e50a700ac8f4e708b23e35ffa57e4cf/roles/79f90a0bf6ea43d0b3c434e31556253a => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:27:10.307236 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c7ae4-411d-4f79-8991-94bd7739af10 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:27:10.307728 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c7ae4-411d-4f79-8991-94bd7739af10 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:27:10.307827 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c7ae4-411d-4f79-8991-94bd7739af10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:27:10.331257 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-656c7ae4-411d-4f79-8991-94bd7739af10 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:27:10.332498 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-656c7ae4-411d-4f79-8991-94bd7739af10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:27:10.396802 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1095/2175] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:27:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:27:10.408904 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0706aaaa-f301-4c98-96f0-6c539fe18cbc admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:27:10.410587 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-0706aaaa-f301-4c98-96f0-6c539fe18cbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:27:10.471346 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0706aaaa-f301-4c98-96f0-6c539fe18cbc admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:27:10.475015 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4925a41f-cb09-4df1-a6d7-72f12673b8e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:27:10.475681 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925a41f-cb09-4df1-a6d7-72f12673b8e4 service neutron] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:27:10.476003 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925a41f-cb09-4df1-a6d7-72f12673b8e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:27:10.476412 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925a41f-cb09-4df1-a6d7-72f12673b8e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:27:10.486457 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4925a41f-cb09-4df1-a6d7-72f12673b8e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:27:10.487868 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4925a41f-cb09-4df1-a6d7-72f12673b8e4 service neutron] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:27:10.500345 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1081/2176] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:27:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:27:11.148456 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef95c3-4fb3-487c-92c0-f29119f623ff None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:27:11.149676 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef95c3-4fb3-487c-92c0-f29119f623ff None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:27:11.150040 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef95c3-4fb3-487c-92c0-f29119f623ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:27:11.190928 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-eeef95c3-4fb3-487c-92c0-f29119f623ff None None] MFA Rules not processed for user `3e50a700ac8f4e708b23e35ffa57e4cf`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:27:11.193443 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-eeef95c3-4fb3-487c-92c0-f29119f623ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:27:11.327679 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1096/2177] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:27:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:27:11.343723 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4925a41f-cb09-4df1-a6d7-72f12673b8e4 service neutron] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:27:11.345536 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-4925a41f-cb09-4df1-a6d7-72f12673b8e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:27:11.409199 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4925a41f-cb09-4df1-a6d7-72f12673b8e4 service neutron] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:27:11.413043 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efd21ea-42b0-488c-ad21-07358dad910e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d65e731386d44948dcc1ecd40cbda65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:27:11.413794 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efd21ea-42b0-488c-ad21-07358dad910e service cinder] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:27:11.414906 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efd21ea-42b0-488c-ad21-07358dad910e service cinder] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:27:11.415354 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efd21ea-42b0-488c-ad21-07358dad910e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:27:11.424122 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efd21ea-42b0-488c-ad21-07358dad910e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:27:11.425726 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efd21ea-42b0-488c-ad21-07358dad910e service cinder] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:27:11.435382 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1082/2178] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:27:11 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:27:12.792303 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef9d2d3-4b3f-40a4-bcbb-34fe06eac07d None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:27:12.793131 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef9d2d3-4b3f-40a4-bcbb-34fe06eac07d None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:27:12.793414 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef9d2d3-4b3f-40a4-bcbb-34fe06eac07d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:27:12.813681 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-aef9d2d3-4b3f-40a4-bcbb-34fe06eac07d None None] MFA Rules not processed for user `3e50a700ac8f4e708b23e35ffa57e4cf`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:27:12.814925 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-aef9d2d3-4b3f-40a4-bcbb-34fe06eac07d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:27:12.837473 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1097/2179] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:27:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:27:30.532201 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efd21ea-42b0-488c-ad21-07358dad910e service cinder] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:27:30.533571 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-6efd21ea-42b0-488c-ad21-07358dad910e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:27:30.622000 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efd21ea-42b0-488c-ad21-07358dad910e service cinder] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:27:30.626985 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ce2f0d-323c-4a08-926b-18c311bf44cc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '285198b50b50431f96f9225d106417a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:27:30.627646 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ce2f0d-323c-4a08-926b-18c311bf44cc service placement] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:27:30.627927 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ce2f0d-323c-4a08-926b-18c311bf44cc service placement] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:27:30.628197 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ce2f0d-323c-4a08-926b-18c311bf44cc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:27:30.629970 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-39ce2f0d-323c-4a08-926b-18c311bf44cc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:27:30.642292 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ce2f0d-323c-4a08-926b-18c311bf44cc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:27:30.643926 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ce2f0d-323c-4a08-926b-18c311bf44cc service placement] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:27:30.656115 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1083/2180] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:27:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:28:17.490969 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285b351-a55f-47a5-9dc2-014866d9ba20 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:28:17.491594 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285b351-a55f-47a5-9dc2-014866d9ba20 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:28:17.491594 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285b351-a55f-47a5-9dc2-014866d9ba20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:28:17.508345 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-8285b351-a55f-47a5-9dc2-014866d9ba20 None None] MFA Rules not processed for user `dee809a4a41f4d2c91edb83c1f4d224c`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:28:17.509473 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-8285b351-a55f-47a5-9dc2-014866d9ba20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:28:17.564445 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1098/2181] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:28:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:28:38.772196 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111ff87-c87c-4c6f-b816-e9a9ab8f141e None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:28:38.772656 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111ff87-c87c-4c6f-b816-e9a9ab8f141e None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:28:38.772758 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111ff87-c87c-4c6f-b816-e9a9ab8f141e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:28:38.836597 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-9111ff87-c87c-4c6f-b816-e9a9ab8f141e None None] MFA Rules not processed for user `0227b2954e61426388214e96e1741eb2`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:28:38.837794 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-9111ff87-c87c-4c6f-b816-e9a9ab8f141e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:28:38.907027 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1084/2182] 10.222.0.44 () {58 vars in 1009 bytes} [Mon May 9 20:28:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:28:38.951826 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8285b351-a55f-47a5-9dc2-014866d9ba20 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:28:38.953225 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-8285b351-a55f-47a5-9dc2-014866d9ba20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:28:39.044401 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8285b351-a55f-47a5-9dc2-014866d9ba20 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:28:39.049386 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb056f44-122c-478c-a06a-2c7a290068ba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965089f1a92f49bd883b337d6042c69f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:28:39.050031 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb056f44-122c-478c-a06a-2c7a290068ba service swift] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:28:39.050313 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb056f44-122c-478c-a06a-2c7a290068ba service swift] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:28:39.050588 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb056f44-122c-478c-a06a-2c7a290068ba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:28:39.058917 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb056f44-122c-478c-a06a-2c7a290068ba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:28:39.060615 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb056f44-122c-478c-a06a-2c7a290068ba service swift] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:28:39.068547 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1099/2183] 10.222.0.44 () {60 vars in 1384 bytes} [Mon May 9 20:28:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 09 20:28:46.423978 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a83de-ebd2-4f6b-a5de-4cb0e0204747 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:28:46.424565 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a83de-ebd2-4f6b-a5de-4cb0e0204747 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:28:46.424565 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a83de-ebd2-4f6b-a5de-4cb0e0204747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:28:46.447962 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-3a8a83de-ebd2-4f6b-a5de-4cb0e0204747 None None] MFA Rules not processed for user `3e50a700ac8f4e708b23e35ffa57e4cf`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:28:46.448923 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-3a8a83de-ebd2-4f6b-a5de-4cb0e0204747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:28:46.463792 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1085/2184] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:28:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:28:57.038719 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee84da-4551-4717-918d-73634981553a None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:28:57.039423 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee84da-4551-4717-918d-73634981553a None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:28:57.039592 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee84da-4551-4717-918d-73634981553a None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:28:57.041061 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1100/2185] 10.222.0.44 () {54 vars in 921 bytes} [Mon May 9 20:28:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:28:57.047953 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4075ff-4dad-4bb9-bfde-e12d964157ad None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:28:57.048456 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4075ff-4dad-4bb9-bfde-e12d964157ad None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:28:57.048573 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4075ff-4dad-4bb9-bfde-e12d964157ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:28:57.096505 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-7c4075ff-4dad-4bb9-bfde-e12d964157ad None None] MFA Rules not processed for user `eb59440b21074d9da15679dc2d745f72`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:28:57.097751 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-7c4075ff-4dad-4bb9-bfde-e12d964157ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:28:57.174530 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1086/2186] 10.222.0.44 () {58 vars in 1018 bytes} [Mon May 9 20:28:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:28:57.186469 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bee84da-4551-4717-918d-73634981553a None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:28:57.188129 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-2bee84da-4551-4717-918d-73634981553a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:28:57.263788 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bee84da-4551-4717-918d-73634981553a None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:28:57.267285 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d29c795-0af7-4b57-8955-02017ba2e499 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65db5d9a86fd48acb5874df0165c0ef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:28:57.267941 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29c795-0af7-4b57-8955-02017ba2e499 service glance] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:28:57.268222 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29c795-0af7-4b57-8955-02017ba2e499 service glance] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:28:57.268495 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29c795-0af7-4b57-8955-02017ba2e499 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:28:57.278872 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d29c795-0af7-4b57-8955-02017ba2e499 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:28:57.280337 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d29c795-0af7-4b57-8955-02017ba2e499 service glance] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:28:57.290630 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1101/2187] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:28:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 09 20:28:57.355411 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca7cdc0-d569-4edc-aedd-100835fcb9a3 None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:28:57.355713 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca7cdc0-d569-4edc-aedd-100835fcb9a3 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:28:57.355985 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca7cdc0-d569-4edc-aedd-100835fcb9a3 None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:28:57.357431 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1087/2188] 10.222.0.44 () {54 vars in 921 bytes} [Mon May 9 20:28:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:28:57.362120 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac88dc0a-eff0-4eb8-a0fd-8930ff5b0b5a None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:28:57.362430 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac88dc0a-eff0-4eb8-a0fd-8930ff5b0b5a None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:28:57.362699 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac88dc0a-eff0-4eb8-a0fd-8930ff5b0b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:28:57.380088 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-ac88dc0a-eff0-4eb8-a0fd-8930ff5b0b5a None None] MFA Rules not processed for user `b2a13ad25f27471792ba0758602b6e63`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:28:57.381276 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-ac88dc0a-eff0-4eb8-a0fd-8930ff5b0b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:28:57.388578 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1102/2189] 10.222.0.44 () {58 vars in 1018 bytes} [Mon May 9 20:28:57 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:28:57.399796 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca7cdc0-d569-4edc-aedd-100835fcb9a3 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:28:57.410977 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca7cdc0-d569-4edc-aedd-100835fcb9a3 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:28:57.414452 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549b118e-113c-46bc-b04d-ee83269ac9e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:28:57.415069 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b118e-113c-46bc-b04d-ee83269ac9e2 service neutron] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:28:57.415347 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b118e-113c-46bc-b04d-ee83269ac9e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:28:57.415665 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b118e-113c-46bc-b04d-ee83269ac9e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:28:57.422674 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549b118e-113c-46bc-b04d-ee83269ac9e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:28:57.424173 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549b118e-113c-46bc-b04d-ee83269ac9e2 service neutron] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:28:57.431846 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1088/2190] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:28:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:28:57.512445 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6fe1e2-7d28-4d4b-9eb1-5f49c17f49e2 None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:28:57.512728 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6fe1e2-7d28-4d4b-9eb1-5f49c17f49e2 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:28:57.513024 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6fe1e2-7d28-4d4b-9eb1-5f49c17f49e2 None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:28:57.514391 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1103/2191] 10.222.0.44 () {54 vars in 921 bytes} [Mon May 9 20:28:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:28:57.519621 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c0172-2f11-41e4-862c-b570e63adc23 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:28:57.519904 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c0172-2f11-41e4-862c-b570e63adc23 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:28:57.520174 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c0172-2f11-41e4-862c-b570e63adc23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:28:57.538189 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-899c0172-2f11-41e4-862c-b570e63adc23 None None] MFA Rules not processed for user `eb59440b21074d9da15679dc2d745f72`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:28:57.539486 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-899c0172-2f11-41e4-862c-b570e63adc23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:28:57.549389 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1089/2192] 10.222.0.44 () {58 vars in 1018 bytes} [Mon May 9 20:28:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:28:57.561079 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6fe1e2-7d28-4d4b-9eb1-5f49c17f49e2 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:28:57.562806 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-9b6fe1e2-7d28-4d4b-9eb1-5f49c17f49e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:28:57.576860 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6fe1e2-7d28-4d4b-9eb1-5f49c17f49e2 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:28:57.580709 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc02bd7-dd42-4aca-acdf-fd6c193ff9ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:28:57.581422 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc02bd7-dd42-4aca-acdf-fd6c193ff9ec service neutron] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:28:57.581609 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc02bd7-dd42-4aca-acdf-fd6c193ff9ec service neutron] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:28:57.581885 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc02bd7-dd42-4aca-acdf-fd6c193ff9ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:28:57.592178 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc02bd7-dd42-4aca-acdf-fd6c193ff9ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:28:57.593592 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc02bd7-dd42-4aca-acdf-fd6c193ff9ec service neutron] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:28:57.603938 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1104/2193] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:28:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:29:00.069308 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5954955-0d38-45fe-bb58-54c5ebfdd39f None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:29:00.069773 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5954955-0d38-45fe-bb58-54c5ebfdd39f None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:29:00.069865 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5954955-0d38-45fe-bb58-54c5ebfdd39f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:29:00.090554 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-b5954955-0d38-45fe-bb58-54c5ebfdd39f None None] MFA Rules not processed for user `0227b2954e61426388214e96e1741eb2`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:29:00.091806 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-b5954955-0d38-45fe-bb58-54c5ebfdd39f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:29:00.099212 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1090/2194] 10.222.0.44 () {58 vars in 1009 bytes} [Mon May 9 20:29:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:29:00.111483 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc02bd7-dd42-4aca-acdf-fd6c193ff9ec service neutron] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:29:00.123589 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc02bd7-dd42-4aca-acdf-fd6c193ff9ec service neutron] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:29:00.128572 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b35eda-2d19-4a83-af32-68d57b842c71 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965089f1a92f49bd883b337d6042c69f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:29:00.129218 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b35eda-2d19-4a83-af32-68d57b842c71 service swift] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:29:00.129496 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b35eda-2d19-4a83-af32-68d57b842c71 service swift] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:29:00.129767 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b35eda-2d19-4a83-af32-68d57b842c71 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:29:00.140317 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b35eda-2d19-4a83-af32-68d57b842c71 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:29:00.141910 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b35eda-2d19-4a83-af32-68d57b842c71 service swift] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:29:00.151335 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1105/2195] 10.222.0.44 () {60 vars in 1384 bytes} [Mon May 9 20:29:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 09 20:29:28.821786 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5954955-0d38-45fe-bb58-54c5ebfdd39f None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:29:28.832638 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5954955-0d38-45fe-bb58-54c5ebfdd39f None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:29:28.836174 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6bb42c-2f9a-4b10-ad8c-f49e9fa11dbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:29:28.836799 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6bb42c-2f9a-4b10-ad8c-f49e9fa11dbc service neutron] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:29:28.837079 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6bb42c-2f9a-4b10-ad8c-f49e9fa11dbc service neutron] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:29:28.837345 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6bb42c-2f9a-4b10-ad8c-f49e9fa11dbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:29:28.839216 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-9c6bb42c-2f9a-4b10-ad8c-f49e9fa11dbc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:29:28.852982 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6bb42c-2f9a-4b10-ad8c-f49e9fa11dbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:29:28.854419 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6bb42c-2f9a-4b10-ad8c-f49e9fa11dbc service neutron] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:29:28.865772 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1091/2196] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:29:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:29:30.154531 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b35eda-2d19-4a83-af32-68d57b842c71 service swift] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:29:30.163636 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b35eda-2d19-4a83-af32-68d57b842c71 service swift] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:29:30.167822 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a87250-5357-4225-b028-e7fdb4feba4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:29:30.168420 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a87250-5357-4225-b028-e7fdb4feba4f service neutron] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:29:30.168700 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a87250-5357-4225-b028-e7fdb4feba4f service neutron] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:29:30.168972 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a87250-5357-4225-b028-e7fdb4feba4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:29:30.170846 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-63a87250-5357-4225-b028-e7fdb4feba4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:29:30.184820 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a87250-5357-4225-b028-e7fdb4feba4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:29:30.186240 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a87250-5357-4225-b028-e7fdb4feba4f service neutron] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:29:30.197591 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1106/2197] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:29:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:29:42.085152 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6bb42c-2f9a-4b10-ad8c-f49e9fa11dbc service neutron] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:29:42.086609 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-9c6bb42c-2f9a-4b10-ad8c-f49e9fa11dbc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:29:42.099852 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6bb42c-2f9a-4b10-ad8c-f49e9fa11dbc service neutron] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:29:42.105781 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baebc637-e137-43a5-9dfe-2e98e7b6516e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb59440b21074d9da15679dc2d745f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:29:42.106412 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baebc637-e137-43a5-9dfe-2e98e7b6516e service nova] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:29:42.106718 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baebc637-e137-43a5-9dfe-2e98e7b6516e service nova] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:29:42.106992 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baebc637-e137-43a5-9dfe-2e98e7b6516e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:29:42.108733 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-baebc637-e137-43a5-9dfe-2e98e7b6516e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:29:42.163225 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baebc637-e137-43a5-9dfe-2e98e7b6516e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:29:42.164844 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baebc637-e137-43a5-9dfe-2e98e7b6516e service nova] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:29:42.174413 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1092/2198] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:29:42 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:29:42.972942 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51432035-45a4-40bd-86e6-03809d0314ff None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:29:42.973421 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51432035-45a4-40bd-86e6-03809d0314ff None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:29:42.973519 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51432035-45a4-40bd-86e6-03809d0314ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:29:42.992829 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-51432035-45a4-40bd-86e6-03809d0314ff None None] MFA Rules not processed for user `0227b2954e61426388214e96e1741eb2`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:29:42.994020 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-51432035-45a4-40bd-86e6-03809d0314ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:29:43.001425 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1107/2199] 10.222.0.44 () {58 vars in 967 bytes} [Mon May 9 20:29:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:29:43.025229 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baebc637-e137-43a5-9dfe-2e98e7b6516e service nova] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:29:43.037122 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baebc637-e137-43a5-9dfe-2e98e7b6516e service nova] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:29:43.042401 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160fa9ab-ea9b-46c3-a309-c352161453be service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965089f1a92f49bd883b337d6042c69f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:29:43.043040 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160fa9ab-ea9b-46c3-a309-c352161453be service swift] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:29:43.043324 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160fa9ab-ea9b-46c3-a309-c352161453be service swift] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:29:43.043631 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160fa9ab-ea9b-46c3-a309-c352161453be service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:29:43.053132 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160fa9ab-ea9b-46c3-a309-c352161453be service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:29:43.054757 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160fa9ab-ea9b-46c3-a309-c352161453be service swift] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:29:43.063666 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1093/2200] 10.222.0.44 () {60 vars in 1384 bytes} [Mon May 9 20:29:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 09 20:29:51.187198 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51432035-45a4-40bd-86e6-03809d0314ff None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:29:51.200637 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51432035-45a4-40bd-86e6-03809d0314ff None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:29:51.204896 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ac8890-2c09-45d8-92d2-ce64f0ee7196 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:29:51.206409 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac8890-2c09-45d8-92d2-ce64f0ee7196 service neutron] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:29:51.206760 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac8890-2c09-45d8-92d2-ce64f0ee7196 service neutron] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:29:51.207266 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac8890-2c09-45d8-92d2-ce64f0ee7196 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:29:51.209807 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-72ac8890-2c09-45d8-92d2-ce64f0ee7196 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:29:51.221682 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ac8890-2c09-45d8-92d2-ce64f0ee7196 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:29:51.223138 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ac8890-2c09-45d8-92d2-ce64f0ee7196 service neutron] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:29:51.231158 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1108/2201] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:29:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:29:54.208392 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160fa9ab-ea9b-46c3-a309-c352161453be service swift] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:29:54.222883 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160fa9ab-ea9b-46c3-a309-c352161453be service swift] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:29:54.229649 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a48095-0d48-490d-baa5-a81d4bb4989a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb59440b21074d9da15679dc2d745f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:29:54.231177 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a48095-0d48-490d-baa5-a81d4bb4989a service nova] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:29:54.231490 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a48095-0d48-490d-baa5-a81d4bb4989a service nova] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:29:54.231765 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a48095-0d48-490d-baa5-a81d4bb4989a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:29:54.236738 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-a3a48095-0d48-490d-baa5-a81d4bb4989a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:29:54.250335 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a48095-0d48-490d-baa5-a81d4bb4989a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:29:54.251998 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a48095-0d48-490d-baa5-a81d4bb4989a service nova] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:29:54.263824 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1094/2202] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:29:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:30:18.367873 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc6510-f3a4-458b-b583-43dfc56f6dfb None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:30:18.368589 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc6510-f3a4-458b-b583-43dfc56f6dfb None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:30:18.368589 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc6510-f3a4-458b-b583-43dfc56f6dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:30:18.386414 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-67bc6510-f3a4-458b-b583-43dfc56f6dfb None None] MFA Rules not processed for user `797d7c0dfda747549456236e9e639466`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:30:18.387987 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-67bc6510-f3a4-458b-b583-43dfc56f6dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:30:18.394985 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1109/2203] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:30:18 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:30:20.809163 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a48095-0d48-490d-baa5-a81d4bb4989a service nova] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:30:20.822127 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a48095-0d48-490d-baa5-a81d4bb4989a service nova] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:30:20.831111 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e0b444-cc55-4c24-9db0-51f077a19a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:30:20.832101 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0b444-cc55-4c24-9db0-51f077a19a15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:30:20.832379 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0b444-cc55-4c24-9db0-51f077a19a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:30:20.832649 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0b444-cc55-4c24-9db0-51f077a19a15 admin admin] PATH_INFO: `/v3/users/3e50a700ac8f4e708b23e35ffa57e4cf` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:30:20.833834 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e0b444-cc55-4c24-9db0-51f077a19a15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e50a700ac8f4e708b23e35ffa57e4cf)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:30:20.835841 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e0b444-cc55-4c24-9db0-51f077a19a15 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:30:20.883493 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-78e0b444-cc55-4c24-9db0-51f077a19a15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e50a700ac8f4e708b23e35ffa57e4cf'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:30:20.890733 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-78e0b444-cc55-4c24-9db0-51f077a19a15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e50a700ac8f4e708b23e35ffa57e4cf'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:30:20.899354 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-78e0b444-cc55-4c24-9db0-51f077a19a15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e50a700ac8f4e708b23e35ffa57e4cf'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:30:20.900017 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-78e0b444-cc55-4c24-9db0-51f077a19a15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e50a700ac8f4e708b23e35ffa57e4cf'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:30:20.900746 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-78e0b444-cc55-4c24-9db0-51f077a19a15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e50a700ac8f4e708b23e35ffa57e4cf'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:30:20.918132 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1095/2204] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:30:20 2022] DELETE /identity/v3/users/3e50a700ac8f4e708b23e35ffa57e4cf => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:30:21.152559 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bc6510-f3a4-458b-b583-43dfc56f6dfb None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:30:21.163409 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bc6510-f3a4-458b-b583-43dfc56f6dfb None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:30:21.229283 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23370458-0d65-4ac7-b98f-c792b18a76a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:30:21.230128 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23370458-0d65-4ac7-b98f-c792b18a76a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:30:21.230405 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23370458-0d65-4ac7-b98f-c792b18a76a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:30:21.230676 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23370458-0d65-4ac7-b98f-c792b18a76a6 admin admin] PATH_INFO: `/v3/projects/970fffc753884be893292412dc3a6f69` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:30:21.232485 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23370458-0d65-4ac7-b98f-c792b18a76a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=970fffc753884be893292412dc3a6f69)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:30:21.234558 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23370458-0d65-4ac7-b98f-c792b18a76a6 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:30:21.278784 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-23370458-0d65-4ac7-b98f-c792b18a76a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '970fffc753884be893292412dc3a6f69', 'request_id': 'req-23370458-0d65-4ac7-b98f-c792b18a76a6'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:30:21.284615 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-23370458-0d65-4ac7-b98f-c792b18a76a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '970fffc753884be893292412dc3a6f69', 'request_id': 'req-23370458-0d65-4ac7-b98f-c792b18a76a6'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:30:21.289745 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-23370458-0d65-4ac7-b98f-c792b18a76a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '970fffc753884be893292412dc3a6f69', 'request_id': 'req-23370458-0d65-4ac7-b98f-c792b18a76a6'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:30:21.301708 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-23370458-0d65-4ac7-b98f-c792b18a76a6 admin admin] The token cache is being invalidate because project 970fffc753884be893292412dc3a6f69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:30:21.301988 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-23370458-0d65-4ac7-b98f-c792b18a76a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:30:21.302594 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-23370458-0d65-4ac7-b98f-c792b18a76a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:30:21.304135 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1110/2205] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:30:21 2022] DELETE /identity/v3/projects/970fffc753884be893292412dc3a6f69 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:30:25.826084 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e0b444-cc55-4c24-9db0-51f077a19a15 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:30:25.827575 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-78e0b444-cc55-4c24-9db0-51f077a19a15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:30:25.899975 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e0b444-cc55-4c24-9db0-51f077a19a15 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:30:25.970510 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91fc1dd-3bbb-4c78-993a-ddd14cdf95e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb59440b21074d9da15679dc2d745f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:30:25.971162 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91fc1dd-3bbb-4c78-993a-ddd14cdf95e1 service nova] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:30:25.971478 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91fc1dd-3bbb-4c78-993a-ddd14cdf95e1 service nova] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:30:25.971756 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91fc1dd-3bbb-4c78-993a-ddd14cdf95e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:30:25.973595 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-c91fc1dd-3bbb-4c78-993a-ddd14cdf95e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:30:26.029584 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91fc1dd-3bbb-4c78-993a-ddd14cdf95e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:30:26.031192 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91fc1dd-3bbb-4c78-993a-ddd14cdf95e1 service nova] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:30:26.040358 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1096/2206] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:30:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:30:32.863069 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23370458-0d65-4ac7-b98f-c792b18a76a6 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:30:32.864450 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-23370458-0d65-4ac7-b98f-c792b18a76a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:30:32.880566 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23370458-0d65-4ac7-b98f-c792b18a76a6 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:30:32.886120 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ca497-df44-4a32-b82c-966ce9d71c05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb59440b21074d9da15679dc2d745f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:30:32.887178 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ca497-df44-4a32-b82c-966ce9d71c05 service nova] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:30:32.887491 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ca497-df44-4a32-b82c-966ce9d71c05 service nova] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:30:32.887772 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ca497-df44-4a32-b82c-966ce9d71c05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:30:32.889472 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-cb8ca497-df44-4a32-b82c-966ce9d71c05 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:30:32.950426 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8ca497-df44-4a32-b82c-966ce9d71c05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:30:32.952040 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8ca497-df44-4a32-b82c-966ce9d71c05 service nova] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:30:32.960882 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1111/2207] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:30:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:30:43.795155 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb374d2-f720-4723-8812-bc720f71a725 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:30:43.795711 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb374d2-f720-4723-8812-bc720f71a725 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:30:43.795809 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb374d2-f720-4723-8812-bc720f71a725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:30:43.812729 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-bcb374d2-f720-4723-8812-bc720f71a725 None None] MFA Rules not processed for user `dee809a4a41f4d2c91edb83c1f4d224c`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:30:43.813938 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-bcb374d2-f720-4723-8812-bc720f71a725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:30:43.821100 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1097/2208] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:30:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:30:44.303718 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ca497-df44-4a32-b82c-966ce9d71c05 service nova] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:30:44.305167 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-cb8ca497-df44-4a32-b82c-966ce9d71c05 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:30:44.362948 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ca497-df44-4a32-b82c-966ce9d71c05 service nova] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:30:44.366759 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f445a8-1abe-4fd5-8614-f9a3a64ac0fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:30:44.367426 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f445a8-1abe-4fd5-8614-f9a3a64ac0fe service neutron] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:30:44.367713 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f445a8-1abe-4fd5-8614-f9a3a64ac0fe service neutron] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:30:44.367981 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f445a8-1abe-4fd5-8614-f9a3a64ac0fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:30:44.370401 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-82f445a8-1abe-4fd5-8614-f9a3a64ac0fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:30:44.380867 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f445a8-1abe-4fd5-8614-f9a3a64ac0fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:30:44.382287 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f445a8-1abe-4fd5-8614-f9a3a64ac0fe service neutron] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:30:44.391615 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1112/2209] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:30:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:30:44.716372 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb374d2-f720-4723-8812-bc720f71a725 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:30:44.717953 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-bcb374d2-f720-4723-8812-bc720f71a725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:30:44.799243 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb374d2-f720-4723-8812-bc720f71a725 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:30:44.804560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbd56bd-52e1-4838-b4f6-fba1dce30142 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '285198b50b50431f96f9225d106417a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:30:44.805306 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd56bd-52e1-4838-b4f6-fba1dce30142 service placement] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:30:44.805589 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd56bd-52e1-4838-b4f6-fba1dce30142 service placement] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:30:44.805865 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd56bd-52e1-4838-b4f6-fba1dce30142 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:30:44.808251 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-bfbd56bd-52e1-4838-b4f6-fba1dce30142 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:30:44.829126 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbd56bd-52e1-4838-b4f6-fba1dce30142 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:30:44.831060 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbd56bd-52e1-4838-b4f6-fba1dce30142 service placement] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:30:44.844128 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1098/2210] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:30:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:30:52.374703 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f445a8-1abe-4fd5-8614-f9a3a64ac0fe service neutron] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:30:52.376190 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-82f445a8-1abe-4fd5-8614-f9a3a64ac0fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:30:52.392634 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f445a8-1abe-4fd5-8614-f9a3a64ac0fe service neutron] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:30:52.398259 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d65c9b4-f1f8-4f39-ae24-070377811f7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb59440b21074d9da15679dc2d745f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:30:52.398900 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65c9b4-f1f8-4f39-ae24-070377811f7f service nova] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:30:52.399176 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65c9b4-f1f8-4f39-ae24-070377811f7f service nova] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:30:52.399527 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65c9b4-f1f8-4f39-ae24-070377811f7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:30:52.401365 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-5d65c9b4-f1f8-4f39-ae24-070377811f7f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:30:52.461873 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d65c9b4-f1f8-4f39-ae24-070377811f7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:30:52.463498 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d65c9b4-f1f8-4f39-ae24-070377811f7f service nova] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:30:52.473286 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1113/2211] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:30:52 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:30:55.122276 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbd56bd-52e1-4838-b4f6-fba1dce30142 service placement] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:30:55.143150 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbd56bd-52e1-4838-b4f6-fba1dce30142 service placement] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:30:55.148854 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62981fa-167f-4081-98c9-5baf8cf42650 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb59440b21074d9da15679dc2d745f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:30:55.149491 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62981fa-167f-4081-98c9-5baf8cf42650 service nova] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:30:55.149765 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62981fa-167f-4081-98c9-5baf8cf42650 service nova] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:30:55.150035 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62981fa-167f-4081-98c9-5baf8cf42650 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:30:55.152446 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-b62981fa-167f-4081-98c9-5baf8cf42650 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:30:55.165433 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62981fa-167f-4081-98c9-5baf8cf42650 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:30:55.167111 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62981fa-167f-4081-98c9-5baf8cf42650 service nova] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:30:55.178959 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1099/2212] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:30:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:30:58.770332 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d65c9b4-f1f8-4f39-ae24-070377811f7f service nova] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:30:58.784249 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d65c9b4-f1f8-4f39-ae24-070377811f7f service nova] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:30:58.791583 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec05e0-1e61-4fe5-b0db-748b38a8b411 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb59440b21074d9da15679dc2d745f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:30:58.792783 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec05e0-1e61-4fe5-b0db-748b38a8b411 service nova] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:30:58.793059 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec05e0-1e61-4fe5-b0db-748b38a8b411 service nova] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:30:58.793375 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec05e0-1e61-4fe5-b0db-748b38a8b411 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:30:58.795252 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-0dec05e0-1e61-4fe5-b0db-748b38a8b411 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:30:58.809573 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dec05e0-1e61-4fe5-b0db-748b38a8b411 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:30:58.812222 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dec05e0-1e61-4fe5-b0db-748b38a8b411 service nova] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:30:58.832543 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1114/2213] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:30:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 09 20:31:00.976064 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96822b2-da72-4c8a-9160-74c1b8dbd958 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:31:00.976625 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96822b2-da72-4c8a-9160-74c1b8dbd958 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:31:00.976625 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96822b2-da72-4c8a-9160-74c1b8dbd958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:31:00.994605 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-c96822b2-da72-4c8a-9160-74c1b8dbd958 None None] MFA Rules not processed for user `38716aefb55246079de2658159fd5ca4`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:31:00.996570 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-c96822b2-da72-4c8a-9160-74c1b8dbd958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:31:01.003512 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1100/2214] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:31:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:31:01.297800 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec05e0-1e61-4fe5-b0db-748b38a8b411 service nova] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:31:01.299168 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-0dec05e0-1e61-4fe5-b0db-748b38a8b411 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:31:01.310641 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec05e0-1e61-4fe5-b0db-748b38a8b411 service nova] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:31:01.314134 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a8ac06-f8ae-4748-8c26-deb4f708a259 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:31:01.314753 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8ac06-f8ae-4748-8c26-deb4f708a259 service neutron] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:31:01.315030 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8ac06-f8ae-4748-8c26-deb4f708a259 service neutron] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:31:01.315295 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8ac06-f8ae-4748-8c26-deb4f708a259 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:31:01.316967 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-49a8ac06-f8ae-4748-8c26-deb4f708a259 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:31:01.326543 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a8ac06-f8ae-4748-8c26-deb4f708a259 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:31:01.327975 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a8ac06-f8ae-4748-8c26-deb4f708a259 service neutron] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:31:01.335544 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1115/2215] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:31:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:31:47.406342 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96822b2-da72-4c8a-9160-74c1b8dbd958 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:31:47.415797 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96822b2-da72-4c8a-9160-74c1b8dbd958 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:31:47.419463 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab66ec7-ec8f-4201-a05e-f32d8fbd0b7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:31:47.420084 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab66ec7-ec8f-4201-a05e-f32d8fbd0b7d service neutron] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:31:47.420359 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab66ec7-ec8f-4201-a05e-f32d8fbd0b7d service neutron] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:31:47.420630 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab66ec7-ec8f-4201-a05e-f32d8fbd0b7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:31:47.422366 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-2ab66ec7-ec8f-4201-a05e-f32d8fbd0b7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:31:47.481653 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab66ec7-ec8f-4201-a05e-f32d8fbd0b7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:31:47.483070 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab66ec7-ec8f-4201-a05e-f32d8fbd0b7d service neutron] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:31:47.492383 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1101/2216] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:31:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:31:50.945946 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a8ac06-f8ae-4748-8c26-deb4f708a259 service neutron] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:31:50.953730 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-49a8ac06-f8ae-4748-8c26-deb4f708a259 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:31:50.962894 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a8ac06-f8ae-4748-8c26-deb4f708a259 service neutron] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:31:50.967914 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f871377-778e-455e-a207-dffb250b41df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:31:50.968758 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f871377-778e-455e-a207-dffb250b41df admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:31:50.969032 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f871377-778e-455e-a207-dffb250b41df admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:31:50.969299 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f871377-778e-455e-a207-dffb250b41df admin admin] PATH_INFO: `/v3/users/797d7c0dfda747549456236e9e639466` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:31:50.970470 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f871377-778e-455e-a207-dffb250b41df admin admin] RBAC: Authorizing `identity:delete_user(user_id=797d7c0dfda747549456236e9e639466)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:31:50.972514 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f871377-778e-455e-a207-dffb250b41df admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:31:51.016671 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-9f871377-778e-455e-a207-dffb250b41df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '797d7c0dfda747549456236e9e639466'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:31:51.017328 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-9f871377-778e-455e-a207-dffb250b41df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '797d7c0dfda747549456236e9e639466'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:31:51.023715 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-9f871377-778e-455e-a207-dffb250b41df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '797d7c0dfda747549456236e9e639466'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:31:51.024325 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-9f871377-778e-455e-a207-dffb250b41df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '797d7c0dfda747549456236e9e639466'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:31:51.031748 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-9f871377-778e-455e-a207-dffb250b41df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '797d7c0dfda747549456236e9e639466'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:31:51.048279 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1116/2217] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:31:50 2022] DELETE /identity/v3/users/797d7c0dfda747549456236e9e639466 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:31:51.223839 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab66ec7-ec8f-4201-a05e-f32d8fbd0b7d service neutron] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:31:51.235983 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab66ec7-ec8f-4201-a05e-f32d8fbd0b7d service neutron] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:31:51.295070 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125cd8af-5349-429c-b8d3-91efc33bc793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:31:51.295580 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125cd8af-5349-429c-b8d3-91efc33bc793 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:31:51.295994 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125cd8af-5349-429c-b8d3-91efc33bc793 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:31:51.296271 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125cd8af-5349-429c-b8d3-91efc33bc793 admin admin] PATH_INFO: `/v3/projects/96a116cd334648f185dbf35bfa3ade00` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:31:51.297987 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125cd8af-5349-429c-b8d3-91efc33bc793 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96a116cd334648f185dbf35bfa3ade00)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:31:51.299957 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125cd8af-5349-429c-b8d3-91efc33bc793 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:31:51.346955 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-125cd8af-5349-429c-b8d3-91efc33bc793 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96a116cd334648f185dbf35bfa3ade00', 'request_id': 'req-125cd8af-5349-429c-b8d3-91efc33bc793'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:31:51.353126 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-125cd8af-5349-429c-b8d3-91efc33bc793 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96a116cd334648f185dbf35bfa3ade00', 'request_id': 'req-125cd8af-5349-429c-b8d3-91efc33bc793'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:31:51.359119 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-125cd8af-5349-429c-b8d3-91efc33bc793 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96a116cd334648f185dbf35bfa3ade00', 'request_id': 'req-125cd8af-5349-429c-b8d3-91efc33bc793'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:31:51.372313 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-125cd8af-5349-429c-b8d3-91efc33bc793 admin admin] The token cache is being invalidate because project 96a116cd334648f185dbf35bfa3ade00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:31:51.372651 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-125cd8af-5349-429c-b8d3-91efc33bc793 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:31:51.373275 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-125cd8af-5349-429c-b8d3-91efc33bc793 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:31:51.374857 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1102/2218] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:31:51 2022] DELETE /identity/v3/projects/96a116cd334648f185dbf35bfa3ade00 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:31:51.379888 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de81d46-8215-4b87-9314-a90398018081 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:31:51.380178 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de81d46-8215-4b87-9314-a90398018081 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:31:51.380453 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de81d46-8215-4b87-9314-a90398018081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:31:51.398410 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-1de81d46-8215-4b87-9314-a90398018081 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:31:51.399634 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-1de81d46-8215-4b87-9314-a90398018081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:31:51.457946 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1117/2219] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:31:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:31:51.466050 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782c57f-089e-4242-8648-72196d8bf527 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:31:51.466257 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782c57f-089e-4242-8648-72196d8bf527 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:31:51.466527 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782c57f-089e-4242-8648-72196d8bf527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:31:51.485390 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-f782c57f-089e-4242-8648-72196d8bf527 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:31:51.486586 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-f782c57f-089e-4242-8648-72196d8bf527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:31:51.496249 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1103/2220] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:31:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:31:51.500472 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de81d46-8215-4b87-9314-a90398018081 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:31:51.510043 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de81d46-8215-4b87-9314-a90398018081 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:31:51.514982 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f257238-28bf-44c1-bf1f-a9d6b84ea2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:31:51.515705 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f257238-28bf-44c1-bf1f-a9d6b84ea2a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:31:51.515986 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f257238-28bf-44c1-bf1f-a9d6b84ea2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:31:51.516262 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f257238-28bf-44c1-bf1f-a9d6b84ea2a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:31:51.517069 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f257238-28bf-44c1-bf1f-a9d6b84ea2a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:31:51.517376 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f257238-28bf-44c1-bf1f-a9d6b84ea2a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:31:51.518974 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f257238-28bf-44c1-bf1f-a9d6b84ea2a4 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:31:51.531356 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1118/2221] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 9 20:31:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:31:51.535920 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f782c57f-089e-4242-8648-72196d8bf527 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:31:51.546266 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f782c57f-089e-4242-8648-72196d8bf527 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:31:51.551053 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2988293-1f7a-4aa2-a1cb-531e0b7fb2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:31:51.551826 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2988293-1f7a-4aa2-a1cb-531e0b7fb2d1 admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:31:51.552108 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2988293-1f7a-4aa2-a1cb-531e0b7fb2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:31:51.552378 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2988293-1f7a-4aa2-a1cb-531e0b7fb2d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:31:51.553071 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2988293-1f7a-4aa2-a1cb-531e0b7fb2d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:31:51.554975 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2988293-1f7a-4aa2-a1cb-531e0b7fb2d1 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:31:51.597453 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1104/2222] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:31:51 2022] POST /identity/v3/projects => generated 371 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 20:31:51.601676 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f257238-28bf-44c1-bf1f-a9d6b84ea2a4 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:31:51.612087 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f257238-28bf-44c1-bf1f-a9d6b84ea2a4 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:31:51.674377 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14663d08-919f-4220-a71e-fb157cc7b0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:31:51.675162 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14663d08-919f-4220-a71e-fb157cc7b0af admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:31:51.675526 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14663d08-919f-4220-a71e-fb157cc7b0af admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:31:51.675800 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14663d08-919f-4220-a71e-fb157cc7b0af admin admin] PATH_INFO: `/v3/users` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:31:51.676494 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14663d08-919f-4220-a71e-fb157cc7b0af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:31:51.678404 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14663d08-919f-4220-a71e-fb157cc7b0af admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:31:51.698134 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1119/2223] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:31:51 2022] POST /identity/v3/users => generated 286 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:31:51.702254 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2988293-1f7a-4aa2-a1cb-531e0b7fb2d1 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:31:51.712641 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2988293-1f7a-4aa2-a1cb-531e0b7fb2d1 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:31:51.718070 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c602ab52-cb79-4eb2-b5dc-e5d40219222c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:31:51.718659 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602ab52-cb79-4eb2-b5dc-e5d40219222c admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:31:51.718939 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602ab52-cb79-4eb2-b5dc-e5d40219222c admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:31:51.719208 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602ab52-cb79-4eb2-b5dc-e5d40219222c admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:31:51.719963 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c602ab52-cb79-4eb2-b5dc-e5d40219222c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:31:51.721601 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c602ab52-cb79-4eb2-b5dc-e5d40219222c admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:31:51.734859 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1105/2224] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:31:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:31:51.736105 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14663d08-919f-4220-a71e-fb157cc7b0af admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:31:51.746776 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14663d08-919f-4220-a71e-fb157cc7b0af admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:31:51.752125 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d6f15b-5220-44f7-a64b-85146a474f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:31:51.753014 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d6f15b-5220-44f7-a64b-85146a474f8d admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:31:51.753379 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d6f15b-5220-44f7-a64b-85146a474f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:31:51.753650 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d6f15b-5220-44f7-a64b-85146a474f8d admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:31:51.755096 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d6f15b-5220-44f7-a64b-85146a474f8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:31:51.756773 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d6f15b-5220-44f7-a64b-85146a474f8d admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:31:51.770186 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1120/2225] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:31:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 09 20:31:51.772784 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c602ab52-cb79-4eb2-b5dc-e5d40219222c admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:31:51.783074 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c602ab52-cb79-4eb2-b5dc-e5d40219222c admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:31:51.788445 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f846a-5bea-4e8a-bafc-15082d341e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:31:51.789316 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f846a-5bea-4e8a-bafc-15082d341e26 admin admin] REQUEST_METHOD: `PUT` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:31:51.789595 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f846a-5bea-4e8a-bafc-15082d341e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:31:51.789854 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f846a-5bea-4e8a-bafc-15082d341e26 admin admin] PATH_INFO: `/v3/projects/bfb229f346ea497198df7849bcc3108b/users/b1bebfce9d894c1ea5f86a18b16d4d54/roles/79f90a0bf6ea43d0b3c434e31556253a` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:31:51.806328 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2f846a-5bea-4e8a-bafc-15082d341e26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfb229f346ea497198df7849bcc3108b, user_id=b1bebfce9d894c1ea5f86a18b16d4d54, role_id=79f90a0bf6ea43d0b3c434e31556253a)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:31:51.810373 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2f846a-5bea-4e8a-bafc-15082d341e26 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:31:51.823325 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1106/2226] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:31:51 2022] PUT /identity/v3/projects/bfb229f346ea497198df7849bcc3108b/users/b1bebfce9d894c1ea5f86a18b16d4d54/roles/79f90a0bf6ea43d0b3c434e31556253a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:31:51.834154 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8491669c-7564-4f66-830b-746bc1713875 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:31:51.834446 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8491669c-7564-4f66-830b-746bc1713875 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:31:51.834719 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8491669c-7564-4f66-830b-746bc1713875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:31:51.861327 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-8491669c-7564-4f66-830b-746bc1713875 None None] MFA Rules not processed for user `b1bebfce9d894c1ea5f86a18b16d4d54`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:31:51.862531 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-8491669c-7564-4f66-830b-746bc1713875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:31:51.930841 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1121/2227] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:31:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:31:51.941944 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f846a-5bea-4e8a-bafc-15082d341e26 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:31:51.943754 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-1f2f846a-5bea-4e8a-bafc-15082d341e26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:31:52.022181 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f846a-5bea-4e8a-bafc-15082d341e26 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:31:52.029267 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6728becd-d42d-48c9-8212-55c9c949d982 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb59440b21074d9da15679dc2d745f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:31:52.031362 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728becd-d42d-48c9-8212-55c9c949d982 service nova] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:31:52.031770 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728becd-d42d-48c9-8212-55c9c949d982 service nova] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:31:52.031942 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728becd-d42d-48c9-8212-55c9c949d982 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:31:52.046614 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6728becd-d42d-48c9-8212-55c9c949d982 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:31:52.049568 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6728becd-d42d-48c9-8212-55c9c949d982 service nova] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:31:52.061507 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1107/2228] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:31:51 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:31:54.922741 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8491669c-7564-4f66-830b-746bc1713875 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:31:54.986346 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8491669c-7564-4f66-830b-746bc1713875 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:31:54.990842 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c6ca07-741f-4fc2-a78a-2273441d0090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:31:54.991737 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6ca07-741f-4fc2-a78a-2273441d0090 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:31:54.992018 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6ca07-741f-4fc2-a78a-2273441d0090 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:31:54.992292 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6ca07-741f-4fc2-a78a-2273441d0090 admin admin] PATH_INFO: `/v3/users/b1bebfce9d894c1ea5f86a18b16d4d54` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:31:54.993506 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c6ca07-741f-4fc2-a78a-2273441d0090 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1bebfce9d894c1ea5f86a18b16d4d54)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:31:54.995461 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c6ca07-741f-4fc2-a78a-2273441d0090 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:31:55.051745 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-b5c6ca07-741f-4fc2-a78a-2273441d0090 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1bebfce9d894c1ea5f86a18b16d4d54'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:31:55.052402 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-b5c6ca07-741f-4fc2-a78a-2273441d0090 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1bebfce9d894c1ea5f86a18b16d4d54'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:31:55.059546 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-b5c6ca07-741f-4fc2-a78a-2273441d0090 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1bebfce9d894c1ea5f86a18b16d4d54'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:31:55.060264 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-b5c6ca07-741f-4fc2-a78a-2273441d0090 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1bebfce9d894c1ea5f86a18b16d4d54'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:31:55.068258 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-b5c6ca07-741f-4fc2-a78a-2273441d0090 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1bebfce9d894c1ea5f86a18b16d4d54'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:31:55.086856 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1122/2229] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:31:54 2022] DELETE /identity/v3/users/b1bebfce9d894c1ea5f86a18b16d4d54 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:31:55.091957 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b7466-5322-4e85-8fd7-9e99c62bb09b None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:31:55.092493 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b7466-5322-4e85-8fd7-9e99c62bb09b None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:31:55.092493 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b7466-5322-4e85-8fd7-9e99c62bb09b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:31:55.109760 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-2f1b7466-5322-4e85-8fd7-9e99c62bb09b None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:31:55.110983 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-2f1b7466-5322-4e85-8fd7-9e99c62bb09b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:31:55.172213 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1108/2230] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:31:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:31:55.182036 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c6ca07-741f-4fc2-a78a-2273441d0090 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:31:55.184168 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-b5c6ca07-741f-4fc2-a78a-2273441d0090 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:31:55.244557 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c6ca07-741f-4fc2-a78a-2273441d0090 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:31:55.248955 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4acef8-667e-47a4-b3f7-71b80cdf2ab6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:31:55.249681 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4acef8-667e-47a4-b3f7-71b80cdf2ab6 service neutron] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:31:55.249984 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4acef8-667e-47a4-b3f7-71b80cdf2ab6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:31:55.250908 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4acef8-667e-47a4-b3f7-71b80cdf2ab6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:31:55.260645 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4acef8-667e-47a4-b3f7-71b80cdf2ab6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:31:55.262919 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4acef8-667e-47a4-b3f7-71b80cdf2ab6 service neutron] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:31:55.277428 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1123/2231] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:31:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:31:55.544051 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1b7466-5322-4e85-8fd7-9e99c62bb09b None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:31:55.545756 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-2f1b7466-5322-4e85-8fd7-9e99c62bb09b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:31:55.558656 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1b7466-5322-4e85-8fd7-9e99c62bb09b None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:31:55.563385 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf858fed-9d37-480c-93b2-4f297a539e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:31:55.564264 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf858fed-9d37-480c-93b2-4f297a539e9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:31:55.564539 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf858fed-9d37-480c-93b2-4f297a539e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:31:55.564807 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf858fed-9d37-480c-93b2-4f297a539e9a admin admin] PATH_INFO: `/v3/projects/bfb229f346ea497198df7849bcc3108b` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:31:55.571098 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf858fed-9d37-480c-93b2-4f297a539e9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfb229f346ea497198df7849bcc3108b)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:31:55.573326 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf858fed-9d37-480c-93b2-4f297a539e9a admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:31:55.627711 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-cf858fed-9d37-480c-93b2-4f297a539e9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfb229f346ea497198df7849bcc3108b', 'request_id': 'req-cf858fed-9d37-480c-93b2-4f297a539e9a'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:31:55.628493 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7686d7-6589-4f1f-8da4-d8491d66ead1 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:31:55.628780 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7686d7-6589-4f1f-8da4-d8491d66ead1 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:31:55.629052 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7686d7-6589-4f1f-8da4-d8491d66ead1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:31:55.634025 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-cf858fed-9d37-480c-93b2-4f297a539e9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfb229f346ea497198df7849bcc3108b', 'request_id': 'req-cf858fed-9d37-480c-93b2-4f297a539e9a'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:31:55.641565 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-cf858fed-9d37-480c-93b2-4f297a539e9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfb229f346ea497198df7849bcc3108b', 'request_id': 'req-cf858fed-9d37-480c-93b2-4f297a539e9a'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:31:55.646640 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-8e7686d7-6589-4f1f-8da4-d8491d66ead1 None None] MFA Rules not processed for user `d9342c8759514113aeec13ce910e4a21`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:31:55.648027 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-8e7686d7-6589-4f1f-8da4-d8491d66ead1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:31:55.654705 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-cf858fed-9d37-480c-93b2-4f297a539e9a admin admin] The token cache is being invalidate because project bfb229f346ea497198df7849bcc3108b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:31:55.654992 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-cf858fed-9d37-480c-93b2-4f297a539e9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:31:55.655645 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-cf858fed-9d37-480c-93b2-4f297a539e9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:31:55.657236 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1109/2232] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:31:55 2022] DELETE /identity/v3/projects/bfb229f346ea497198df7849bcc3108b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:31:55.661906 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb92c29d-a823-48ed-b603-2f6b374fa235 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:31:55.662186 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb92c29d-a823-48ed-b603-2f6b374fa235 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:31:55.662456 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb92c29d-a823-48ed-b603-2f6b374fa235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:31:55.686102 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-fb92c29d-a823-48ed-b603-2f6b374fa235 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:31:55.687228 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-fb92c29d-a823-48ed-b603-2f6b374fa235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:31:55.704072 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1124/2233] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:31:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:31:55.746253 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1110/2234] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:31:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:31:55.755288 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311e5ce-fc0a-4f1b-b491-4be84c074133 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:31:55.755518 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311e5ce-fc0a-4f1b-b491-4be84c074133 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:31:55.755796 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311e5ce-fc0a-4f1b-b491-4be84c074133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:31:55.774533 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-b311e5ce-fc0a-4f1b-b491-4be84c074133 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:31:55.775769 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-b311e5ce-fc0a-4f1b-b491-4be84c074133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:31:55.784410 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1125/2235] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:31:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:31:55.788792 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb92c29d-a823-48ed-b603-2f6b374fa235 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:31:55.798405 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb92c29d-a823-48ed-b603-2f6b374fa235 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:31:55.802942 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c30e28-3f3a-4a6a-bfac-7f38c9cdb4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:31:55.803620 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c30e28-3f3a-4a6a-bfac-7f38c9cdb4a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:31:55.803902 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c30e28-3f3a-4a6a-bfac-7f38c9cdb4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:31:55.804173 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c30e28-3f3a-4a6a-bfac-7f38c9cdb4a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:31:55.804896 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c30e28-3f3a-4a6a-bfac-7f38c9cdb4a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:31:55.805189 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c30e28-3f3a-4a6a-bfac-7f38c9cdb4a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:31:55.806785 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c30e28-3f3a-4a6a-bfac-7f38c9cdb4a0 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:31:55.818275 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1111/2236] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 9 20:31:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:31:55.822418 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b311e5ce-fc0a-4f1b-b491-4be84c074133 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:31:55.832300 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b311e5ce-fc0a-4f1b-b491-4be84c074133 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:31:55.836946 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8240fff4-845f-4309-8780-008ac71c8642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:31:55.837582 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8240fff4-845f-4309-8780-008ac71c8642 admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:31:55.837859 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8240fff4-845f-4309-8780-008ac71c8642 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:31:55.838129 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8240fff4-845f-4309-8780-008ac71c8642 admin admin] PATH_INFO: `/v3/projects` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:31:55.838815 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8240fff4-845f-4309-8780-008ac71c8642 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:31:55.841277 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8240fff4-845f-4309-8780-008ac71c8642 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:31:55.867425 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1126/2237] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:31:55 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:31:55.870478 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c30e28-3f3a-4a6a-bfac-7f38c9cdb4a0 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:31:55.880850 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c30e28-3f3a-4a6a-bfac-7f38c9cdb4a0 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:31:55.937927 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9e453a-ff09-4a99-967c-272e8f12803d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:31:55.938518 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e453a-ff09-4a99-967c-272e8f12803d admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:31:55.938792 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e453a-ff09-4a99-967c-272e8f12803d admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:31:55.939059 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e453a-ff09-4a99-967c-272e8f12803d admin admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:31:55.939778 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9e453a-ff09-4a99-967c-272e8f12803d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:31:55.941697 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9e453a-ff09-4a99-967c-272e8f12803d admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:31:55.961653 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1112/2238] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:31:55 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:31:55.966470 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8240fff4-845f-4309-8780-008ac71c8642 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:31:55.976665 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8240fff4-845f-4309-8780-008ac71c8642 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:31:55.982011 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9713ff75-a74a-44e4-ab6e-45b088cbd04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:31:55.982660 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9713ff75-a74a-44e4-ab6e-45b088cbd04b admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:31:55.982939 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9713ff75-a74a-44e4-ab6e-45b088cbd04b admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:31:55.983210 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9713ff75-a74a-44e4-ab6e-45b088cbd04b admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:31:55.983976 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9713ff75-a74a-44e4-ab6e-45b088cbd04b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:31:55.985599 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9713ff75-a74a-44e4-ab6e-45b088cbd04b admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:31:55.997489 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1127/2239] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:31:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:31:56.001285 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9e453a-ff09-4a99-967c-272e8f12803d admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:31:56.011827 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9e453a-ff09-4a99-967c-272e8f12803d admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:31:56.016388 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ed20e5-45ee-4e47-9650-364f20178e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:31:56.017052 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed20e5-45ee-4e47-9650-364f20178e7d admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:31:56.017331 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed20e5-45ee-4e47-9650-364f20178e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:31:56.017601 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed20e5-45ee-4e47-9650-364f20178e7d admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:31:56.018323 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ed20e5-45ee-4e47-9650-364f20178e7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:31:56.019940 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ed20e5-45ee-4e47-9650-364f20178e7d admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:31:56.033484 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1113/2240] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:31:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:31:56.034587 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9713ff75-a74a-44e4-ab6e-45b088cbd04b admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:31:56.045240 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9713ff75-a74a-44e4-ab6e-45b088cbd04b admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:31:56.050356 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6241b1-2497-48c7-8925-1c170952c4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:31:56.051235 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6241b1-2497-48c7-8925-1c170952c4b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:31:56.051551 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6241b1-2497-48c7-8925-1c170952c4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:31:56.051825 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6241b1-2497-48c7-8925-1c170952c4b3 admin admin] PATH_INFO: `/v3/projects/c2775cad5dbb4421a3f5e4d414675283/users/718f0ca15a8645acb69212f06c2be8ab/roles/79f90a0bf6ea43d0b3c434e31556253a` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:31:56.066251 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6241b1-2497-48c7-8925-1c170952c4b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2775cad5dbb4421a3f5e4d414675283, user_id=718f0ca15a8645acb69212f06c2be8ab, role_id=79f90a0bf6ea43d0b3c434e31556253a)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:31:56.070106 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6241b1-2497-48c7-8925-1c170952c4b3 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:31:56.083260 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1128/2241] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:31:56 2022] PUT /identity/v3/projects/c2775cad5dbb4421a3f5e4d414675283/users/718f0ca15a8645acb69212f06c2be8ab/roles/79f90a0bf6ea43d0b3c434e31556253a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:31:56.094248 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79162d9f-b63d-4f46-9983-7b5e88d2af36 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:31:56.094742 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79162d9f-b63d-4f46-9983-7b5e88d2af36 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:31:56.094852 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79162d9f-b63d-4f46-9983-7b5e88d2af36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:31:56.122278 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-79162d9f-b63d-4f46-9983-7b5e88d2af36 None None] MFA Rules not processed for user `718f0ca15a8645acb69212f06c2be8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:31:56.123501 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-79162d9f-b63d-4f46-9983-7b5e88d2af36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:31:56.185269 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1114/2242] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:31:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:31:56.189745 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6241b1-2497-48c7-8925-1c170952c4b3 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:31:56.251207 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6241b1-2497-48c7-8925-1c170952c4b3 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:31:56.256207 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d3844d-f520-4430-92fa-f39f778f28ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:31:56.256862 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d3844d-f520-4430-92fa-f39f778f28ff admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:31:56.257138 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d3844d-f520-4430-92fa-f39f778f28ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:31:56.257409 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d3844d-f520-4430-92fa-f39f778f28ff admin admin] PATH_INFO: `/v3/projects` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:31:56.258100 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d3844d-f520-4430-92fa-f39f778f28ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:31:56.260043 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d3844d-f520-4430-92fa-f39f778f28ff admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:31:56.294587 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1129/2243] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:31:56 2022] POST /identity/v3/projects => generated 377 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:31:56.298648 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79162d9f-b63d-4f46-9983-7b5e88d2af36 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:31:56.312799 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79162d9f-b63d-4f46-9983-7b5e88d2af36 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:31:56.376073 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f51b492-03a9-4d34-a69e-49a6cecbb3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:31:56.376737 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f51b492-03a9-4d34-a69e-49a6cecbb3fb admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:31:56.377017 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f51b492-03a9-4d34-a69e-49a6cecbb3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:31:56.377285 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f51b492-03a9-4d34-a69e-49a6cecbb3fb admin admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:31:56.377962 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f51b492-03a9-4d34-a69e-49a6cecbb3fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:31:56.379969 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f51b492-03a9-4d34-a69e-49a6cecbb3fb admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:31:56.400854 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1115/2244] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:31:56 2022] POST /identity/v3/users => generated 295 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:31:56.405046 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d3844d-f520-4430-92fa-f39f778f28ff admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:31:56.415324 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d3844d-f520-4430-92fa-f39f778f28ff admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:31:56.420896 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458b0f65-59a3-4230-8da0-b3abb7fb1e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:31:56.421547 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b0f65-59a3-4230-8da0-b3abb7fb1e34 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:31:56.421828 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b0f65-59a3-4230-8da0-b3abb7fb1e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:31:56.422101 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b0f65-59a3-4230-8da0-b3abb7fb1e34 admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:31:56.422981 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458b0f65-59a3-4230-8da0-b3abb7fb1e34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:31:56.424711 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458b0f65-59a3-4230-8da0-b3abb7fb1e34 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:31:56.436367 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1130/2245] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:31:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:31:56.440602 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f51b492-03a9-4d34-a69e-49a6cecbb3fb admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:31:56.450815 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f51b492-03a9-4d34-a69e-49a6cecbb3fb admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:31:56.455612 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a2d23e-9b8b-43fc-adbd-b0fca42d3451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:31:56.456487 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a2d23e-9b8b-43fc-adbd-b0fca42d3451 admin admin] REQUEST_METHOD: `PUT` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:31:56.456764 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a2d23e-9b8b-43fc-adbd-b0fca42d3451 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:31:56.457035 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a2d23e-9b8b-43fc-adbd-b0fca42d3451 admin admin] PATH_INFO: `/v3/projects/29c12a28b7e64276b8e7b1acfd0d153b/users/f29c684688dd4527bb735e5e9380a966/roles/274130b78e304bb88789c1b349263f3c` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:31:56.475140 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a2d23e-9b8b-43fc-adbd-b0fca42d3451 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29c12a28b7e64276b8e7b1acfd0d153b, user_id=f29c684688dd4527bb735e5e9380a966, role_id=274130b78e304bb88789c1b349263f3c)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:31:56.477882 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a2d23e-9b8b-43fc-adbd-b0fca42d3451 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:31:56.491685 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1116/2246] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:31:56 2022] PUT /identity/v3/projects/29c12a28b7e64276b8e7b1acfd0d153b/users/f29c684688dd4527bb735e5e9380a966/roles/274130b78e304bb88789c1b349263f3c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:31:56.496948 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458b0f65-59a3-4230-8da0-b3abb7fb1e34 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:31:56.507094 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458b0f65-59a3-4230-8da0-b3abb7fb1e34 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:31:56.567139 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22baac62-3ece-42f1-ae19-44edbc06b662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:31:56.567845 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22baac62-3ece-42f1-ae19-44edbc06b662 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:31:56.568127 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22baac62-3ece-42f1-ae19-44edbc06b662 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:31:56.568402 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22baac62-3ece-42f1-ae19-44edbc06b662 admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:31:56.569124 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22baac62-3ece-42f1-ae19-44edbc06b662 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:31:56.570717 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22baac62-3ece-42f1-ae19-44edbc06b662 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:31:56.581318 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1131/2247] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:31:56 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:31:56.585283 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a2d23e-9b8b-43fc-adbd-b0fca42d3451 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:31:56.602164 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a2d23e-9b8b-43fc-adbd-b0fca42d3451 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:31:56.607524 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f0329d-b04b-4a2b-90d4-0c78901aa604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:31:56.608943 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f0329d-b04b-4a2b-90d4-0c78901aa604 admin admin] REQUEST_METHOD: `PUT` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:31:56.608943 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f0329d-b04b-4a2b-90d4-0c78901aa604 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:31:56.608943 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f0329d-b04b-4a2b-90d4-0c78901aa604 admin admin] PATH_INFO: `/v3/projects/29c12a28b7e64276b8e7b1acfd0d153b/users/f29c684688dd4527bb735e5e9380a966/roles/274130b78e304bb88789c1b349263f3c` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:31:56.611238 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f0329d-b04b-4a2b-90d4-0c78901aa604 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29c12a28b7e64276b8e7b1acfd0d153b, user_id=f29c684688dd4527bb735e5e9380a966, role_id=274130b78e304bb88789c1b349263f3c)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:31:56.614000 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f0329d-b04b-4a2b-90d4-0c78901aa604 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:31:56.626187 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1117/2248] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:31:56 2022] PUT /identity/v3/projects/29c12a28b7e64276b8e7b1acfd0d153b/users/f29c684688dd4527bb735e5e9380a966/roles/274130b78e304bb88789c1b349263f3c => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:31:56.636520 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754aaca-370b-4a8f-ae62-f9b99d401f30 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:31:56.636916 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754aaca-370b-4a8f-ae62-f9b99d401f30 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:31:56.637545 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754aaca-370b-4a8f-ae62-f9b99d401f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:31:56.665363 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-1754aaca-370b-4a8f-ae62-f9b99d401f30 None None] MFA Rules not processed for user `f29c684688dd4527bb735e5e9380a966`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:31:56.666577 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-1754aaca-370b-4a8f-ae62-f9b99d401f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:31:56.735888 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1132/2249] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:31:56 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:31:56.748127 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f0329d-b04b-4a2b-90d4-0c78901aa604 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:31:56.750504 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-08f0329d-b04b-4a2b-90d4-0c78901aa604 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:31:56.827883 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f0329d-b04b-4a2b-90d4-0c78901aa604 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:31:56.831579 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6588df-c225-46c8-9968-5a0dec58193c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d65e731386d44948dcc1ecd40cbda65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:31:56.832213 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6588df-c225-46c8-9968-5a0dec58193c service cinder] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:31:56.832486 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6588df-c225-46c8-9968-5a0dec58193c service cinder] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:31:56.832750 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6588df-c225-46c8-9968-5a0dec58193c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:31:56.896807 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6588df-c225-46c8-9968-5a0dec58193c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:31:56.898299 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6588df-c225-46c8-9968-5a0dec58193c service cinder] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:31:56.907897 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1118/2250] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:31:56 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:32:03.561012 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1754aaca-370b-4a8f-ae62-f9b99d401f30 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:32:03.570730 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1754aaca-370b-4a8f-ae62-f9b99d401f30 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:32:03.574541 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f405bc01-f25b-4cce-a06f-c61cebcb9dd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d65e731386d44948dcc1ecd40cbda65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:32:03.575820 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f405bc01-f25b-4cce-a06f-c61cebcb9dd8 service cinder] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:03.576105 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f405bc01-f25b-4cce-a06f-c61cebcb9dd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:03.576380 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f405bc01-f25b-4cce-a06f-c61cebcb9dd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:03.585612 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f405bc01-f25b-4cce-a06f-c61cebcb9dd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:32:03.587050 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f405bc01-f25b-4cce-a06f-c61cebcb9dd8 service cinder] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:32:03.596568 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1133/2251] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:32:03 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:32:33.430623 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6588df-c225-46c8-9968-5a0dec58193c service cinder] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:32:33.491004 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6588df-c225-46c8-9968-5a0dec58193c service cinder] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:32:33.495552 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f90ccf-6f76-44e0-a708-8ac398b40751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:32:33.496392 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f90ccf-6f76-44e0-a708-8ac398b40751 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:33.496670 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f90ccf-6f76-44e0-a708-8ac398b40751 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:33.496938 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f90ccf-6f76-44e0-a708-8ac398b40751 admin admin] PATH_INFO: `/v3/users/718f0ca15a8645acb69212f06c2be8ab` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:33.498754 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f90ccf-6f76-44e0-a708-8ac398b40751 admin admin] RBAC: Authorizing `identity:delete_user(user_id=718f0ca15a8645acb69212f06c2be8ab)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:32:33.500702 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f90ccf-6f76-44e0-a708-8ac398b40751 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:32:33.544425 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-97f90ccf-6f76-44e0-a708-8ac398b40751 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '718f0ca15a8645acb69212f06c2be8ab'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:32:33.550874 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-97f90ccf-6f76-44e0-a708-8ac398b40751 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '718f0ca15a8645acb69212f06c2be8ab'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:32:33.557654 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-97f90ccf-6f76-44e0-a708-8ac398b40751 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '718f0ca15a8645acb69212f06c2be8ab'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:32:33.558388 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-97f90ccf-6f76-44e0-a708-8ac398b40751 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '718f0ca15a8645acb69212f06c2be8ab'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:32:33.558983 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-97f90ccf-6f76-44e0-a708-8ac398b40751 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '718f0ca15a8645acb69212f06c2be8ab'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:32:33.576934 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1119/2252] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:32:33 2022] DELETE /identity/v3/users/718f0ca15a8645acb69212f06c2be8ab => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:32:33.581596 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d23acbb-ef05-492a-aade-62233c453f30 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:33.582075 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d23acbb-ef05-492a-aade-62233c453f30 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:33.582184 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d23acbb-ef05-492a-aade-62233c453f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:33.599143 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-5d23acbb-ef05-492a-aade-62233c453f30 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:32:33.600390 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-5d23acbb-ef05-492a-aade-62233c453f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:32:33.657198 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1134/2253] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:32:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:32:33.666597 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f90ccf-6f76-44e0-a708-8ac398b40751 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:32:33.668013 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-97f90ccf-6f76-44e0-a708-8ac398b40751 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:32:33.722332 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f90ccf-6f76-44e0-a708-8ac398b40751 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:32:33.725949 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1170727d-d170-46c1-baa1-c8d11e53e618 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:32:33.726579 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170727d-d170-46c1-baa1-c8d11e53e618 service neutron] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:33.726856 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170727d-d170-46c1-baa1-c8d11e53e618 service neutron] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:33.727127 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170727d-d170-46c1-baa1-c8d11e53e618 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:33.736442 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1170727d-d170-46c1-baa1-c8d11e53e618 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:32:33.737923 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1170727d-d170-46c1-baa1-c8d11e53e618 service neutron] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:32:33.748124 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1120/2254] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:32:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:32:33.808839 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d23acbb-ef05-492a-aade-62233c453f30 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:32:33.810838 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-5d23acbb-ef05-492a-aade-62233c453f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:32:33.880018 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d23acbb-ef05-492a-aade-62233c453f30 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:32:33.885243 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f99cd09-c5c0-4375-8bb0-8a8e59efa2fd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '285198b50b50431f96f9225d106417a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:32:33.886273 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99cd09-c5c0-4375-8bb0-8a8e59efa2fd service placement] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:33.886614 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99cd09-c5c0-4375-8bb0-8a8e59efa2fd service placement] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:33.886993 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99cd09-c5c0-4375-8bb0-8a8e59efa2fd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:33.888941 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-8f99cd09-c5c0-4375-8bb0-8a8e59efa2fd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:32:33.900861 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f99cd09-c5c0-4375-8bb0-8a8e59efa2fd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:32:33.902448 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f99cd09-c5c0-4375-8bb0-8a8e59efa2fd service placement] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:32:33.913188 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1135/2255] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:32:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:32:34.025018 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1170727d-d170-46c1-baa1-c8d11e53e618 service neutron] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:32:34.026571 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-1170727d-d170-46c1-baa1-c8d11e53e618 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:32:34.041415 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1170727d-d170-46c1-baa1-c8d11e53e618 service neutron] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:32:34.047171 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f6abcc-4f18-4d2c-816d-13e807ed6d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:32:34.048048 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f6abcc-4f18-4d2c-816d-13e807ed6d8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:34.048406 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f6abcc-4f18-4d2c-816d-13e807ed6d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:34.048579 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f6abcc-4f18-4d2c-816d-13e807ed6d8a admin admin] PATH_INFO: `/v3/projects/c2775cad5dbb4421a3f5e4d414675283` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:34.049830 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f6abcc-4f18-4d2c-816d-13e807ed6d8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2775cad5dbb4421a3f5e4d414675283)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:32:34.051781 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f6abcc-4f18-4d2c-816d-13e807ed6d8a admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:32:34.096971 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-c6f6abcc-4f18-4d2c-816d-13e807ed6d8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2775cad5dbb4421a3f5e4d414675283', 'request_id': 'req-c6f6abcc-4f18-4d2c-816d-13e807ed6d8a'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:32:34.102958 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-c6f6abcc-4f18-4d2c-816d-13e807ed6d8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2775cad5dbb4421a3f5e4d414675283', 'request_id': 'req-c6f6abcc-4f18-4d2c-816d-13e807ed6d8a'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:32:34.108973 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-c6f6abcc-4f18-4d2c-816d-13e807ed6d8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2775cad5dbb4421a3f5e4d414675283', 'request_id': 'req-c6f6abcc-4f18-4d2c-816d-13e807ed6d8a'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:32:34.120491 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-c6f6abcc-4f18-4d2c-816d-13e807ed6d8a admin admin] The token cache is being invalidate because project c2775cad5dbb4421a3f5e4d414675283 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:32:34.120758 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-c6f6abcc-4f18-4d2c-816d-13e807ed6d8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:32:34.121368 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-c6f6abcc-4f18-4d2c-816d-13e807ed6d8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:32:34.122920 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1121/2256] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:32:34 2022] DELETE /identity/v3/projects/c2775cad5dbb4421a3f5e4d414675283 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:32:34.126884 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f99cd09-c5c0-4375-8bb0-8a8e59efa2fd service placement] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:32:34.137233 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f99cd09-c5c0-4375-8bb0-8a8e59efa2fd service placement] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:32:34.192105 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d7850b-e77b-4db4-85df-5eae57283899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:32:34.193137 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d7850b-e77b-4db4-85df-5eae57283899 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:34.193417 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d7850b-e77b-4db4-85df-5eae57283899 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:34.193683 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d7850b-e77b-4db4-85df-5eae57283899 admin admin] PATH_INFO: `/v3/users/f29c684688dd4527bb735e5e9380a966` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:34.194919 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d7850b-e77b-4db4-85df-5eae57283899 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f29c684688dd4527bb735e5e9380a966)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:32:34.196863 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d7850b-e77b-4db4-85df-5eae57283899 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:32:34.244265 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-33d7850b-e77b-4db4-85df-5eae57283899 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f29c684688dd4527bb735e5e9380a966'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:32:34.244899 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-33d7850b-e77b-4db4-85df-5eae57283899 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f29c684688dd4527bb735e5e9380a966'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:32:34.251585 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-33d7850b-e77b-4db4-85df-5eae57283899 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f29c684688dd4527bb735e5e9380a966'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:32:34.258384 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-33d7850b-e77b-4db4-85df-5eae57283899 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f29c684688dd4527bb735e5e9380a966'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:32:34.259202 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-33d7850b-e77b-4db4-85df-5eae57283899 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f29c684688dd4527bb735e5e9380a966'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:32:34.277650 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1136/2257] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:32:34 2022] DELETE /identity/v3/users/f29c684688dd4527bb735e5e9380a966 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:32:34.540594 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f6abcc-4f18-4d2c-816d-13e807ed6d8a admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:32:34.542109 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-c6f6abcc-4f18-4d2c-816d-13e807ed6d8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:32:34.554778 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f6abcc-4f18-4d2c-816d-13e807ed6d8a admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:32:34.624289 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eefd0a8-a0a3-4a1f-806a-36c4d25c0b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:32:34.625137 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eefd0a8-a0a3-4a1f-806a-36c4d25c0b72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:34.625411 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eefd0a8-a0a3-4a1f-806a-36c4d25c0b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:34.625680 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eefd0a8-a0a3-4a1f-806a-36c4d25c0b72 admin admin] PATH_INFO: `/v3/projects/29c12a28b7e64276b8e7b1acfd0d153b` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:34.626863 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eefd0a8-a0a3-4a1f-806a-36c4d25c0b72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29c12a28b7e64276b8e7b1acfd0d153b)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:32:34.628831 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eefd0a8-a0a3-4a1f-806a-36c4d25c0b72 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:32:34.672958 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-3eefd0a8-a0a3-4a1f-806a-36c4d25c0b72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29c12a28b7e64276b8e7b1acfd0d153b', 'request_id': 'req-3eefd0a8-a0a3-4a1f-806a-36c4d25c0b72'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:32:34.678873 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-3eefd0a8-a0a3-4a1f-806a-36c4d25c0b72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29c12a28b7e64276b8e7b1acfd0d153b', 'request_id': 'req-3eefd0a8-a0a3-4a1f-806a-36c4d25c0b72'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:32:34.684034 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-3eefd0a8-a0a3-4a1f-806a-36c4d25c0b72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29c12a28b7e64276b8e7b1acfd0d153b', 'request_id': 'req-3eefd0a8-a0a3-4a1f-806a-36c4d25c0b72'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:32:34.696435 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-3eefd0a8-a0a3-4a1f-806a-36c4d25c0b72 admin admin] The token cache is being invalidate because project 29c12a28b7e64276b8e7b1acfd0d153b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:32:34.696715 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-3eefd0a8-a0a3-4a1f-806a-36c4d25c0b72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:32:34.697324 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-3eefd0a8-a0a3-4a1f-806a-36c4d25c0b72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:32:34.698843 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1122/2258] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:32:34 2022] DELETE /identity/v3/projects/29c12a28b7e64276b8e7b1acfd0d153b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:32:34.704194 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9a9e3-0f35-4fac-86d4-e6c7da3f7699 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:34.704658 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9a9e3-0f35-4fac-86d4-e6c7da3f7699 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:34.704959 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9a9e3-0f35-4fac-86d4-e6c7da3f7699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:34.723563 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-b3d9a9e3-0f35-4fac-86d4-e6c7da3f7699 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:32:34.724769 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-b3d9a9e3-0f35-4fac-86d4-e6c7da3f7699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:32:34.781676 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1137/2259] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:32:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:32:34.789359 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8504f4-7dfd-40a5-8ace-d6f1873cf378 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:34.789592 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8504f4-7dfd-40a5-8ace-d6f1873cf378 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:34.789845 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8504f4-7dfd-40a5-8ace-d6f1873cf378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:34.807623 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-ce8504f4-7dfd-40a5-8ace-d6f1873cf378 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:32:34.808809 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-ce8504f4-7dfd-40a5-8ace-d6f1873cf378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:32:34.819892 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1123/2260] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:32:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:32:34.821701 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d9a9e3-0f35-4fac-86d4-e6c7da3f7699 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:32:34.833003 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d9a9e3-0f35-4fac-86d4-e6c7da3f7699 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:32:34.837905 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6efb22-f247-48b8-b123-973334744ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:32:34.838546 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6efb22-f247-48b8-b123-973334744ff2 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:34.838829 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6efb22-f247-48b8-b123-973334744ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:34.839104 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6efb22-f247-48b8-b123-973334744ff2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:34.839861 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6efb22-f247-48b8-b123-973334744ff2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:32:34.840170 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6efb22-f247-48b8-b123-973334744ff2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:32:34.841772 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6efb22-f247-48b8-b123-973334744ff2 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:32:34.853130 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1138/2261] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 9 20:32:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:32:34.857681 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8504f4-7dfd-40a5-8ace-d6f1873cf378 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:32:34.866662 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8504f4-7dfd-40a5-8ace-d6f1873cf378 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:32:34.871320 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f833820a-fdb7-4fda-870c-c279203fcffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:32:34.871984 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f833820a-fdb7-4fda-870c-c279203fcffe admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:34.872262 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f833820a-fdb7-4fda-870c-c279203fcffe admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:34.872533 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f833820a-fdb7-4fda-870c-c279203fcffe admin admin] PATH_INFO: `/v3/projects` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:34.873206 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f833820a-fdb7-4fda-870c-c279203fcffe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:32:34.875621 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f833820a-fdb7-4fda-870c-c279203fcffe admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:32:34.905216 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1124/2262] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:32:34 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:32:34.910518 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6efb22-f247-48b8-b123-973334744ff2 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:32:34.921463 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6efb22-f247-48b8-b123-973334744ff2 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:32:34.975920 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2335cac6-43b8-47e5-a5b4-3ab2899dd16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:32:34.976571 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2335cac6-43b8-47e5-a5b4-3ab2899dd16c admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:34.976848 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2335cac6-43b8-47e5-a5b4-3ab2899dd16c admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:34.977116 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2335cac6-43b8-47e5-a5b4-3ab2899dd16c admin admin] PATH_INFO: `/v3/users` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:34.977801 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2335cac6-43b8-47e5-a5b4-3ab2899dd16c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:32:34.979719 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2335cac6-43b8-47e5-a5b4-3ab2899dd16c admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:32:34.999464 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1139/2263] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:32:34 2022] POST /identity/v3/users => generated 293 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 20:32:35.003645 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f833820a-fdb7-4fda-870c-c279203fcffe admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:32:35.013850 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f833820a-fdb7-4fda-870c-c279203fcffe admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:32:35.019761 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11d42a6-d937-4c22-862b-9fa6d8b0e5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:32:35.020439 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d42a6-d937-4c22-862b-9fa6d8b0e5e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:35.020791 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d42a6-d937-4c22-862b-9fa6d8b0e5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:35.021157 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d42a6-d937-4c22-862b-9fa6d8b0e5e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:35.021882 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11d42a6-d937-4c22-862b-9fa6d8b0e5e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:32:35.023596 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11d42a6-d937-4c22-862b-9fa6d8b0e5e2 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:32:35.034079 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1125/2264] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:32:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:32:35.038232 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2335cac6-43b8-47e5-a5b4-3ab2899dd16c admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:32:35.048303 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2335cac6-43b8-47e5-a5b4-3ab2899dd16c admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:32:35.052854 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c4a955-fc80-4777-920e-2ba947840b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:32:35.053502 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4a955-fc80-4777-920e-2ba947840b6e admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:35.053784 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4a955-fc80-4777-920e-2ba947840b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:35.054057 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4a955-fc80-4777-920e-2ba947840b6e admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:35.054773 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c4a955-fc80-4777-920e-2ba947840b6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:32:35.056396 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c4a955-fc80-4777-920e-2ba947840b6e admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:32:35.067061 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1140/2265] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:32:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:32:35.071100 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11d42a6-d937-4c22-862b-9fa6d8b0e5e2 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:32:35.081671 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11d42a6-d937-4c22-862b-9fa6d8b0e5e2 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:32:35.086226 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bffe9c-4f14-4fd0-a428-323f5faf0909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:32:35.087084 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bffe9c-4f14-4fd0-a428-323f5faf0909 admin admin] REQUEST_METHOD: `PUT` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:35.087363 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bffe9c-4f14-4fd0-a428-323f5faf0909 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:35.087667 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bffe9c-4f14-4fd0-a428-323f5faf0909 admin admin] PATH_INFO: `/v3/projects/bc85976f3a4842d2831149b499405ad6/users/75d8a4553cb0431dae56c6bdc4beea4b/roles/79f90a0bf6ea43d0b3c434e31556253a` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:35.101647 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bffe9c-4f14-4fd0-a428-323f5faf0909 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc85976f3a4842d2831149b499405ad6, user_id=75d8a4553cb0431dae56c6bdc4beea4b, role_id=79f90a0bf6ea43d0b3c434e31556253a)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:32:35.104332 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bffe9c-4f14-4fd0-a428-323f5faf0909 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:32:35.116819 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1126/2266] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:32:35 2022] PUT /identity/v3/projects/bc85976f3a4842d2831149b499405ad6/users/75d8a4553cb0431dae56c6bdc4beea4b/roles/79f90a0bf6ea43d0b3c434e31556253a => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:32:35.128475 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e3ad5-9f72-4c78-b134-e548a7da7c79 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:35.128767 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e3ad5-9f72-4c78-b134-e548a7da7c79 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:35.129047 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e3ad5-9f72-4c78-b134-e548a7da7c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:35.156965 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-da6e3ad5-9f72-4c78-b134-e548a7da7c79 None None] MFA Rules not processed for user `75d8a4553cb0431dae56c6bdc4beea4b`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:32:35.158186 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-da6e3ad5-9f72-4c78-b134-e548a7da7c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:32:35.222050 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1141/2267] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:32:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:32:35.226547 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bffe9c-4f14-4fd0-a428-323f5faf0909 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:32:35.286659 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bffe9c-4f14-4fd0-a428-323f5faf0909 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:32:35.291254 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c3c47a-62d1-41d3-876f-05eb521a2d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:32:35.291929 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c3c47a-62d1-41d3-876f-05eb521a2d28 admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:35.292207 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c3c47a-62d1-41d3-876f-05eb521a2d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:35.292476 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c3c47a-62d1-41d3-876f-05eb521a2d28 admin admin] PATH_INFO: `/v3/projects` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:35.293147 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c3c47a-62d1-41d3-876f-05eb521a2d28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:32:35.295038 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c3c47a-62d1-41d3-876f-05eb521a2d28 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:32:35.319676 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1127/2268] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:32:35 2022] POST /identity/v3/projects => generated 387 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:32:35.323559 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6e3ad5-9f72-4c78-b134-e548a7da7c79 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:32:35.333928 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6e3ad5-9f72-4c78-b134-e548a7da7c79 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:32:35.390770 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88a3f09-6a29-41ec-8f7b-f9e016d5a7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:32:35.391461 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a3f09-6a29-41ec-8f7b-f9e016d5a7f2 admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:35.391743 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a3f09-6a29-41ec-8f7b-f9e016d5a7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:35.392013 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a3f09-6a29-41ec-8f7b-f9e016d5a7f2 admin admin] PATH_INFO: `/v3/users` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:35.392697 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88a3f09-6a29-41ec-8f7b-f9e016d5a7f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:32:35.394594 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88a3f09-6a29-41ec-8f7b-f9e016d5a7f2 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:32:35.414349 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1142/2269] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:32:35 2022] POST /identity/v3/users => generated 294 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 20:32:35.417483 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c3c47a-62d1-41d3-876f-05eb521a2d28 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:32:35.428172 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c3c47a-62d1-41d3-876f-05eb521a2d28 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:32:35.432810 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b62038-5fdd-4534-aea0-1f0fef326778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:32:35.433473 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b62038-5fdd-4534-aea0-1f0fef326778 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:35.433748 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b62038-5fdd-4534-aea0-1f0fef326778 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:35.434024 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b62038-5fdd-4534-aea0-1f0fef326778 admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:35.434775 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b62038-5fdd-4534-aea0-1f0fef326778 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:32:35.437251 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b62038-5fdd-4534-aea0-1f0fef326778 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:32:35.447618 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1128/2270] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:32:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:32:35.451824 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88a3f09-6a29-41ec-8f7b-f9e016d5a7f2 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:32:35.461461 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88a3f09-6a29-41ec-8f7b-f9e016d5a7f2 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:32:35.466190 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a997337-139f-4896-a30c-662917a667f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:32:35.466838 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a997337-139f-4896-a30c-662917a667f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:35.467481 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a997337-139f-4896-a30c-662917a667f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:35.467765 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a997337-139f-4896-a30c-662917a667f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:35.468490 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a997337-139f-4896-a30c-662917a667f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:32:35.470129 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a997337-139f-4896-a30c-662917a667f7 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:32:35.479983 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1143/2271] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:32:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:32:35.484308 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b62038-5fdd-4534-aea0-1f0fef326778 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:32:35.494049 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b62038-5fdd-4534-aea0-1f0fef326778 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:32:35.499243 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2af178-6885-48ba-8949-e97c8eb0343a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:32:35.500125 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2af178-6885-48ba-8949-e97c8eb0343a admin admin] REQUEST_METHOD: `PUT` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:35.500399 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2af178-6885-48ba-8949-e97c8eb0343a admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:35.500683 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2af178-6885-48ba-8949-e97c8eb0343a admin admin] PATH_INFO: `/v3/projects/ec79ac0695414cf7a59709843f177990/users/9bbc92abd7784174bec8aa0b6fe8c7da/roles/79f90a0bf6ea43d0b3c434e31556253a` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:35.516027 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2af178-6885-48ba-8949-e97c8eb0343a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec79ac0695414cf7a59709843f177990, user_id=9bbc92abd7784174bec8aa0b6fe8c7da, role_id=79f90a0bf6ea43d0b3c434e31556253a)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:32:35.518640 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2af178-6885-48ba-8949-e97c8eb0343a admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:32:35.531508 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1129/2272] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:32:35 2022] PUT /identity/v3/projects/ec79ac0695414cf7a59709843f177990/users/9bbc92abd7784174bec8aa0b6fe8c7da/roles/79f90a0bf6ea43d0b3c434e31556253a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:32:35.542436 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334fcdcb-25ac-4357-813e-23f72b6fdf61 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:35.542758 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334fcdcb-25ac-4357-813e-23f72b6fdf61 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:35.543063 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334fcdcb-25ac-4357-813e-23f72b6fdf61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:35.570381 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-334fcdcb-25ac-4357-813e-23f72b6fdf61 None None] MFA Rules not processed for user `9bbc92abd7784174bec8aa0b6fe8c7da`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:32:35.571539 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-334fcdcb-25ac-4357-813e-23f72b6fdf61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:32:35.634727 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1144/2273] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:32:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:32:35.639560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2af178-6885-48ba-8949-e97c8eb0343a admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:32:35.697798 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2af178-6885-48ba-8949-e97c8eb0343a admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:32:35.702531 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed45ee60-4406-462d-bf52-a070aab547ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:32:35.703170 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed45ee60-4406-462d-bf52-a070aab547ac admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:35.703471 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed45ee60-4406-462d-bf52-a070aab547ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:35.703743 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed45ee60-4406-462d-bf52-a070aab547ac admin admin] PATH_INFO: `/v3/projects` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:35.704411 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed45ee60-4406-462d-bf52-a070aab547ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:32:35.706300 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed45ee60-4406-462d-bf52-a070aab547ac admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:32:35.731864 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1130/2274] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:32:35 2022] POST /identity/v3/projects => generated 383 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:32:35.736620 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334fcdcb-25ac-4357-813e-23f72b6fdf61 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:32:35.746965 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334fcdcb-25ac-4357-813e-23f72b6fdf61 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:32:35.802660 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6320686-3c98-45c8-ac74-fdd624e60b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:32:35.803322 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6320686-3c98-45c8-ac74-fdd624e60b78 admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:35.803673 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6320686-3c98-45c8-ac74-fdd624e60b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:35.803973 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6320686-3c98-45c8-ac74-fdd624e60b78 admin admin] PATH_INFO: `/v3/users` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:35.804715 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6320686-3c98-45c8-ac74-fdd624e60b78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:32:35.806622 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6320686-3c98-45c8-ac74-fdd624e60b78 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:32:35.825667 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1145/2275] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:32:35 2022] POST /identity/v3/users => generated 298 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:32:35.829738 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed45ee60-4406-462d-bf52-a070aab547ac admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:32:35.839711 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed45ee60-4406-462d-bf52-a070aab547ac admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:32:35.844873 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46587d5-b1a5-4d21-a3bd-2cd75b2401d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:32:35.845509 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46587d5-b1a5-4d21-a3bd-2cd75b2401d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:35.845784 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46587d5-b1a5-4d21-a3bd-2cd75b2401d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:35.846048 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46587d5-b1a5-4d21-a3bd-2cd75b2401d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:35.846756 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46587d5-b1a5-4d21-a3bd-2cd75b2401d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:32:35.848363 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46587d5-b1a5-4d21-a3bd-2cd75b2401d4 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:32:35.859530 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1131/2276] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:32:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:32:35.863569 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6320686-3c98-45c8-ac74-fdd624e60b78 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:32:35.873442 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6320686-3c98-45c8-ac74-fdd624e60b78 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:32:35.877997 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a847540f-cacc-42ed-b7d4-622ebf7576ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:32:35.878860 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a847540f-cacc-42ed-b7d4-622ebf7576ce admin admin] REQUEST_METHOD: `PUT` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:35.879142 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a847540f-cacc-42ed-b7d4-622ebf7576ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:35.879444 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a847540f-cacc-42ed-b7d4-622ebf7576ce admin admin] PATH_INFO: `/v3/projects/52be6d27da19489390192e6399bdb1e9/users/1b10059e382f48b28ef1b0e5f8873d9f/roles/274130b78e304bb88789c1b349263f3c` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:35.895341 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a847540f-cacc-42ed-b7d4-622ebf7576ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=52be6d27da19489390192e6399bdb1e9, user_id=1b10059e382f48b28ef1b0e5f8873d9f, role_id=274130b78e304bb88789c1b349263f3c)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:32:35.898083 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a847540f-cacc-42ed-b7d4-622ebf7576ce admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:32:35.911515 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1146/2277] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:32:35 2022] PUT /identity/v3/projects/52be6d27da19489390192e6399bdb1e9/users/1b10059e382f48b28ef1b0e5f8873d9f/roles/274130b78e304bb88789c1b349263f3c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:32:35.915521 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46587d5-b1a5-4d21-a3bd-2cd75b2401d4 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:32:35.926170 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46587d5-b1a5-4d21-a3bd-2cd75b2401d4 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:32:35.994497 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f25f6f-b7da-4055-906d-2ed8dce1cb28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:32:35.995157 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f25f6f-b7da-4055-906d-2ed8dce1cb28 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:35.995508 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f25f6f-b7da-4055-906d-2ed8dce1cb28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:35.995792 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f25f6f-b7da-4055-906d-2ed8dce1cb28 admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:35.996497 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f25f6f-b7da-4055-906d-2ed8dce1cb28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:32:35.998103 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f25f6f-b7da-4055-906d-2ed8dce1cb28 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:32:36.008045 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1132/2278] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:32:35 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:32:36.012484 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a847540f-cacc-42ed-b7d4-622ebf7576ce admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:32:36.023119 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a847540f-cacc-42ed-b7d4-622ebf7576ce admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:32:36.028047 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3775205d-3ddc-4a77-819b-2b55cf5a6172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:32:36.028924 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3775205d-3ddc-4a77-819b-2b55cf5a6172 admin admin] REQUEST_METHOD: `PUT` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:36.029209 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3775205d-3ddc-4a77-819b-2b55cf5a6172 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:36.029489 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3775205d-3ddc-4a77-819b-2b55cf5a6172 admin admin] PATH_INFO: `/v3/projects/52be6d27da19489390192e6399bdb1e9/users/1b10059e382f48b28ef1b0e5f8873d9f/roles/274130b78e304bb88789c1b349263f3c` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:36.032705 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3775205d-3ddc-4a77-819b-2b55cf5a6172 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52be6d27da19489390192e6399bdb1e9, user_id=1b10059e382f48b28ef1b0e5f8873d9f, role_id=274130b78e304bb88789c1b349263f3c)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:32:36.035336 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3775205d-3ddc-4a77-819b-2b55cf5a6172 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:32:36.045717 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1147/2279] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:32:36 2022] PUT /identity/v3/projects/52be6d27da19489390192e6399bdb1e9/users/1b10059e382f48b28ef1b0e5f8873d9f/roles/274130b78e304bb88789c1b349263f3c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:32:36.055317 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57a672-2559-46d4-9dd9-f482f834757d None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:36.055666 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57a672-2559-46d4-9dd9-f482f834757d None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:36.055941 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57a672-2559-46d4-9dd9-f482f834757d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:36.081780 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-5a57a672-2559-46d4-9dd9-f482f834757d None None] MFA Rules not processed for user `1b10059e382f48b28ef1b0e5f8873d9f`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:32:36.082885 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-5a57a672-2559-46d4-9dd9-f482f834757d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:32:36.146763 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1133/2280] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:32:36 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:32:36.158182 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3775205d-3ddc-4a77-819b-2b55cf5a6172 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:32:36.159880 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-3775205d-3ddc-4a77-819b-2b55cf5a6172 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:32:36.213110 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3775205d-3ddc-4a77-819b-2b55cf5a6172 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:32:36.216826 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd8cdb-05dd-4506-93c9-2ab83e1e9ca6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d65e731386d44948dcc1ecd40cbda65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:32:36.218041 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd8cdb-05dd-4506-93c9-2ab83e1e9ca6 service cinder] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:36.218334 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd8cdb-05dd-4506-93c9-2ab83e1e9ca6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:36.218582 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd8cdb-05dd-4506-93c9-2ab83e1e9ca6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:36.227365 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fd8cdb-05dd-4506-93c9-2ab83e1e9ca6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:32:36.228804 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fd8cdb-05dd-4506-93c9-2ab83e1e9ca6 service cinder] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:32:36.240650 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1148/2281] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:32:36 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:32:36.727215 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57a672-2559-46d4-9dd9-f482f834757d None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:32:36.728754 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-5a57a672-2559-46d4-9dd9-f482f834757d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:32:36.740993 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57a672-2559-46d4-9dd9-f482f834757d None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:32:36.744440 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6d5fc2-e694-4db5-80c9-f9f2db42d6f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d65e731386d44948dcc1ecd40cbda65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:32:36.745056 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d5fc2-e694-4db5-80c9-f9f2db42d6f3 service cinder] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:36.745331 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d5fc2-e694-4db5-80c9-f9f2db42d6f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:36.745601 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d5fc2-e694-4db5-80c9-f9f2db42d6f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:36.798755 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6d5fc2-e694-4db5-80c9-f9f2db42d6f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:32:36.800235 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6d5fc2-e694-4db5-80c9-f9f2db42d6f3 service cinder] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:32:36.809324 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1134/2282] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:32:36 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:32:40.738871 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd8cdb-05dd-4506-93c9-2ab83e1e9ca6 service cinder] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:32:40.747046 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd8cdb-05dd-4506-93c9-2ab83e1e9ca6 service cinder] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:32:40.751350 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633980c7-261f-4e5f-a7b2-d7b6b570ea0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d65e731386d44948dcc1ecd40cbda65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:32:40.752034 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633980c7-261f-4e5f-a7b2-d7b6b570ea0c service cinder] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:40.752350 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633980c7-261f-4e5f-a7b2-d7b6b570ea0c service cinder] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:40.752619 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633980c7-261f-4e5f-a7b2-d7b6b570ea0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:40.807002 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633980c7-261f-4e5f-a7b2-d7b6b570ea0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:32:40.808455 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633980c7-261f-4e5f-a7b2-d7b6b570ea0c service cinder] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:32:40.817094 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1149/2283] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:32:40 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:32:42.804080 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6d5fc2-e694-4db5-80c9-f9f2db42d6f3 service cinder] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:32:42.862654 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6d5fc2-e694-4db5-80c9-f9f2db42d6f3 service cinder] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:32:42.866987 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b90ff54-48e6-4e3f-a342-d7f4d064d706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:32:42.867857 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b90ff54-48e6-4e3f-a342-d7f4d064d706 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:42.868132 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b90ff54-48e6-4e3f-a342-d7f4d064d706 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:42.868394 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b90ff54-48e6-4e3f-a342-d7f4d064d706 admin admin] PATH_INFO: `/v3/users/75d8a4553cb0431dae56c6bdc4beea4b` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:42.869542 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b90ff54-48e6-4e3f-a342-d7f4d064d706 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75d8a4553cb0431dae56c6bdc4beea4b)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:32:42.871460 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b90ff54-48e6-4e3f-a342-d7f4d064d706 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:32:42.914273 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-3b90ff54-48e6-4e3f-a342-d7f4d064d706 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75d8a4553cb0431dae56c6bdc4beea4b'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:32:42.921352 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-3b90ff54-48e6-4e3f-a342-d7f4d064d706 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75d8a4553cb0431dae56c6bdc4beea4b'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:32:42.928412 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-3b90ff54-48e6-4e3f-a342-d7f4d064d706 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75d8a4553cb0431dae56c6bdc4beea4b'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:32:42.929123 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-3b90ff54-48e6-4e3f-a342-d7f4d064d706 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75d8a4553cb0431dae56c6bdc4beea4b'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:32:42.929911 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-3b90ff54-48e6-4e3f-a342-d7f4d064d706 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75d8a4553cb0431dae56c6bdc4beea4b'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:32:42.947278 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1135/2284] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:32:42 2022] DELETE /identity/v3/users/75d8a4553cb0431dae56c6bdc4beea4b => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:32:42.952101 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84cf37b-0d73-49ca-81ed-fe1e4bccab19 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:42.952579 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84cf37b-0d73-49ca-81ed-fe1e4bccab19 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:42.952709 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84cf37b-0d73-49ca-81ed-fe1e4bccab19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:42.969172 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-d84cf37b-0d73-49ca-81ed-fe1e4bccab19 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:32:42.970355 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-d84cf37b-0d73-49ca-81ed-fe1e4bccab19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:32:43.025992 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1150/2285] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:32:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:32:43.036280 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b90ff54-48e6-4e3f-a342-d7f4d064d706 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:32:43.037719 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-3b90ff54-48e6-4e3f-a342-d7f4d064d706 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:32:43.091203 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b90ff54-48e6-4e3f-a342-d7f4d064d706 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:32:43.094934 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f9a710-841b-4d92-b43c-2a56dd22d618 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:32:43.095591 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f9a710-841b-4d92-b43c-2a56dd22d618 service neutron] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:43.095875 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f9a710-841b-4d92-b43c-2a56dd22d618 service neutron] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:43.096220 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f9a710-841b-4d92-b43c-2a56dd22d618 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:43.104909 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f9a710-841b-4d92-b43c-2a56dd22d618 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:32:43.106328 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f9a710-841b-4d92-b43c-2a56dd22d618 service neutron] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:32:43.115473 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1136/2286] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:32:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:32:43.371385 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84cf37b-0d73-49ca-81ed-fe1e4bccab19 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:32:43.372861 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-d84cf37b-0d73-49ca-81ed-fe1e4bccab19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:32:43.386213 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84cf37b-0d73-49ca-81ed-fe1e4bccab19 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:32:43.391952 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab8aaa6-7729-47c1-9017-ba5c0b1c72cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:32:43.392828 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab8aaa6-7729-47c1-9017-ba5c0b1c72cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:43.393097 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab8aaa6-7729-47c1-9017-ba5c0b1c72cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:43.393365 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab8aaa6-7729-47c1-9017-ba5c0b1c72cc admin admin] PATH_INFO: `/v3/projects/bc85976f3a4842d2831149b499405ad6` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:43.394578 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab8aaa6-7729-47c1-9017-ba5c0b1c72cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc85976f3a4842d2831149b499405ad6)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:32:43.396553 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab8aaa6-7729-47c1-9017-ba5c0b1c72cc admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:32:43.441697 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-dab8aaa6-7729-47c1-9017-ba5c0b1c72cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc85976f3a4842d2831149b499405ad6', 'request_id': 'req-dab8aaa6-7729-47c1-9017-ba5c0b1c72cc'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:32:43.447476 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-dab8aaa6-7729-47c1-9017-ba5c0b1c72cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc85976f3a4842d2831149b499405ad6', 'request_id': 'req-dab8aaa6-7729-47c1-9017-ba5c0b1c72cc'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:32:43.452641 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-dab8aaa6-7729-47c1-9017-ba5c0b1c72cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc85976f3a4842d2831149b499405ad6', 'request_id': 'req-dab8aaa6-7729-47c1-9017-ba5c0b1c72cc'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:32:43.464884 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-dab8aaa6-7729-47c1-9017-ba5c0b1c72cc admin admin] The token cache is being invalidate because project bc85976f3a4842d2831149b499405ad6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:32:43.465162 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-dab8aaa6-7729-47c1-9017-ba5c0b1c72cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:32:43.465778 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-dab8aaa6-7729-47c1-9017-ba5c0b1c72cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:32:43.467372 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1151/2287] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:32:43 2022] DELETE /identity/v3/projects/bc85976f3a4842d2831149b499405ad6 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:32:43.471379 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f9a710-841b-4d92-b43c-2a56dd22d618 service neutron] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:32:43.480626 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f9a710-841b-4d92-b43c-2a56dd22d618 service neutron] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:32:43.533866 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eaab0b-506c-4d1d-b56d-d056b32ba7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:32:43.534708 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eaab0b-506c-4d1d-b56d-d056b32ba7c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:43.534982 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eaab0b-506c-4d1d-b56d-d056b32ba7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:43.535252 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eaab0b-506c-4d1d-b56d-d056b32ba7c3 admin admin] PATH_INFO: `/v3/users/9bbc92abd7784174bec8aa0b6fe8c7da` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:43.536434 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eaab0b-506c-4d1d-b56d-d056b32ba7c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bbc92abd7784174bec8aa0b6fe8c7da)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:32:43.538364 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eaab0b-506c-4d1d-b56d-d056b32ba7c3 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:32:43.581796 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-00eaab0b-506c-4d1d-b56d-d056b32ba7c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bbc92abd7784174bec8aa0b6fe8c7da'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:32:43.588331 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-00eaab0b-506c-4d1d-b56d-d056b32ba7c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bbc92abd7784174bec8aa0b6fe8c7da'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:32:43.595286 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-00eaab0b-506c-4d1d-b56d-d056b32ba7c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bbc92abd7784174bec8aa0b6fe8c7da'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:32:43.595917 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-00eaab0b-506c-4d1d-b56d-d056b32ba7c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bbc92abd7784174bec8aa0b6fe8c7da'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:32:43.596508 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-00eaab0b-506c-4d1d-b56d-d056b32ba7c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bbc92abd7784174bec8aa0b6fe8c7da'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:32:43.613177 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1137/2288] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:32:43 2022] DELETE /identity/v3/users/9bbc92abd7784174bec8aa0b6fe8c7da => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:32:43.884275 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab8aaa6-7729-47c1-9017-ba5c0b1c72cc admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:32:43.886029 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-dab8aaa6-7729-47c1-9017-ba5c0b1c72cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:32:43.899098 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab8aaa6-7729-47c1-9017-ba5c0b1c72cc admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:32:43.953376 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4ae092-4b95-4034-b502-fce71ee7c631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:32:43.954221 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ae092-4b95-4034-b502-fce71ee7c631 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:43.954497 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ae092-4b95-4034-b502-fce71ee7c631 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:43.954763 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ae092-4b95-4034-b502-fce71ee7c631 admin admin] PATH_INFO: `/v3/projects/ec79ac0695414cf7a59709843f177990` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:43.955954 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4ae092-4b95-4034-b502-fce71ee7c631 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec79ac0695414cf7a59709843f177990)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:32:43.957868 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4ae092-4b95-4034-b502-fce71ee7c631 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:32:44.004838 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-dd4ae092-4b95-4034-b502-fce71ee7c631 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec79ac0695414cf7a59709843f177990', 'request_id': 'req-dd4ae092-4b95-4034-b502-fce71ee7c631'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:32:44.010967 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-dd4ae092-4b95-4034-b502-fce71ee7c631 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec79ac0695414cf7a59709843f177990', 'request_id': 'req-dd4ae092-4b95-4034-b502-fce71ee7c631'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:32:44.016166 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-dd4ae092-4b95-4034-b502-fce71ee7c631 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec79ac0695414cf7a59709843f177990', 'request_id': 'req-dd4ae092-4b95-4034-b502-fce71ee7c631'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:32:44.028279 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-dd4ae092-4b95-4034-b502-fce71ee7c631 admin admin] The token cache is being invalidate because project ec79ac0695414cf7a59709843f177990 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:32:44.028558 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-dd4ae092-4b95-4034-b502-fce71ee7c631 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:32:44.029165 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-dd4ae092-4b95-4034-b502-fce71ee7c631 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:32:44.031262 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1152/2289] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:32:43 2022] DELETE /identity/v3/projects/ec79ac0695414cf7a59709843f177990 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:32:44.035232 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eaab0b-506c-4d1d-b56d-d056b32ba7c3 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:32:44.036643 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-00eaab0b-506c-4d1d-b56d-d056b32ba7c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:32:44.049510 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eaab0b-506c-4d1d-b56d-d056b32ba7c3 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:32:44.102951 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5001f9ca-9671-45f9-9d21-20986a634fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:32:44.103750 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001f9ca-9671-45f9-9d21-20986a634fd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:44.104023 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001f9ca-9671-45f9-9d21-20986a634fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:44.104286 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001f9ca-9671-45f9-9d21-20986a634fd0 admin admin] PATH_INFO: `/v3/users/1b10059e382f48b28ef1b0e5f8873d9f` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:44.105438 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5001f9ca-9671-45f9-9d21-20986a634fd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b10059e382f48b28ef1b0e5f8873d9f)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:32:44.107445 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5001f9ca-9671-45f9-9d21-20986a634fd0 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:32:44.150012 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-5001f9ca-9671-45f9-9d21-20986a634fd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b10059e382f48b28ef1b0e5f8873d9f'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:32:44.156941 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-5001f9ca-9671-45f9-9d21-20986a634fd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b10059e382f48b28ef1b0e5f8873d9f'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:32:44.163730 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-5001f9ca-9671-45f9-9d21-20986a634fd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b10059e382f48b28ef1b0e5f8873d9f'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:32:44.164316 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-5001f9ca-9671-45f9-9d21-20986a634fd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b10059e382f48b28ef1b0e5f8873d9f'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:32:44.164908 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-5001f9ca-9671-45f9-9d21-20986a634fd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b10059e382f48b28ef1b0e5f8873d9f'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:32:44.181781 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1138/2290] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:32:44 2022] DELETE /identity/v3/users/1b10059e382f48b28ef1b0e5f8873d9f => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:32:44.445024 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4ae092-4b95-4034-b502-fce71ee7c631 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:32:44.446586 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-dd4ae092-4b95-4034-b502-fce71ee7c631 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:32:44.460621 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4ae092-4b95-4034-b502-fce71ee7c631 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:32:44.515384 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e39d6ce-14d8-48e9-85fc-67ff2cb8656e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:32:44.516263 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e39d6ce-14d8-48e9-85fc-67ff2cb8656e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:44.516544 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e39d6ce-14d8-48e9-85fc-67ff2cb8656e admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:44.516818 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e39d6ce-14d8-48e9-85fc-67ff2cb8656e admin admin] PATH_INFO: `/v3/projects/52be6d27da19489390192e6399bdb1e9` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:44.517992 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e39d6ce-14d8-48e9-85fc-67ff2cb8656e admin admin] RBAC: Authorizing `identity:delete_project(project_id=52be6d27da19489390192e6399bdb1e9)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:32:44.519927 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e39d6ce-14d8-48e9-85fc-67ff2cb8656e admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:32:44.563503 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-1e39d6ce-14d8-48e9-85fc-67ff2cb8656e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52be6d27da19489390192e6399bdb1e9', 'request_id': 'req-1e39d6ce-14d8-48e9-85fc-67ff2cb8656e'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:32:44.569635 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-1e39d6ce-14d8-48e9-85fc-67ff2cb8656e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52be6d27da19489390192e6399bdb1e9', 'request_id': 'req-1e39d6ce-14d8-48e9-85fc-67ff2cb8656e'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:32:44.574969 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-1e39d6ce-14d8-48e9-85fc-67ff2cb8656e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52be6d27da19489390192e6399bdb1e9', 'request_id': 'req-1e39d6ce-14d8-48e9-85fc-67ff2cb8656e'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:32:44.587844 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-1e39d6ce-14d8-48e9-85fc-67ff2cb8656e admin admin] The token cache is being invalidate because project 52be6d27da19489390192e6399bdb1e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:32:44.588331 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-1e39d6ce-14d8-48e9-85fc-67ff2cb8656e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:32:44.588984 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-1e39d6ce-14d8-48e9-85fc-67ff2cb8656e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:32:44.590553 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1153/2291] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:32:44 2022] DELETE /identity/v3/projects/52be6d27da19489390192e6399bdb1e9 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:32:44.596614 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b23e91f-fa6a-4ee9-ba91-0c9da8c17a18 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:44.596896 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b23e91f-fa6a-4ee9-ba91-0c9da8c17a18 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:44.597167 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b23e91f-fa6a-4ee9-ba91-0c9da8c17a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:44.614909 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-8b23e91f-fa6a-4ee9-ba91-0c9da8c17a18 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:32:44.616128 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-8b23e91f-fa6a-4ee9-ba91-0c9da8c17a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:32:44.673318 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1139/2292] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:32:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:32:44.682659 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e38638-7e1b-4418-bd3a-0393a7397e21 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:44.682946 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e38638-7e1b-4418-bd3a-0393a7397e21 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:44.683224 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e38638-7e1b-4418-bd3a-0393a7397e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:44.702232 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-a9e38638-7e1b-4418-bd3a-0393a7397e21 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:32:44.703550 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-a9e38638-7e1b-4418-bd3a-0393a7397e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:32:44.711246 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1154/2293] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:32:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:32:44.715373 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b23e91f-fa6a-4ee9-ba91-0c9da8c17a18 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:32:44.724988 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b23e91f-fa6a-4ee9-ba91-0c9da8c17a18 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:32:44.729525 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe06d972-1852-408f-83f9-46b48110a245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:32:44.730188 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe06d972-1852-408f-83f9-46b48110a245 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:44.730465 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe06d972-1852-408f-83f9-46b48110a245 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:44.730844 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe06d972-1852-408f-83f9-46b48110a245 admin admin] PATH_INFO: `/v3/domains` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:44.731602 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe06d972-1852-408f-83f9-46b48110a245 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:32:44.731906 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe06d972-1852-408f-83f9-46b48110a245 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:32:44.733574 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe06d972-1852-408f-83f9-46b48110a245 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:32:44.744618 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1140/2294] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 9 20:32:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:32:44.749167 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e38638-7e1b-4418-bd3a-0393a7397e21 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:32:44.758070 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e38638-7e1b-4418-bd3a-0393a7397e21 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:32:44.763127 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698304d1-d2ae-48cd-9221-8f08ee5a9191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:32:44.764683 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698304d1-d2ae-48cd-9221-8f08ee5a9191 admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:44.764845 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698304d1-d2ae-48cd-9221-8f08ee5a9191 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:44.765119 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698304d1-d2ae-48cd-9221-8f08ee5a9191 admin admin] PATH_INFO: `/v3/projects` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:44.765801 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698304d1-d2ae-48cd-9221-8f08ee5a9191 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:32:44.767734 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698304d1-d2ae-48cd-9221-8f08ee5a9191 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:32:44.791593 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1155/2295] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:32:44 2022] POST /identity/v3/projects => generated 393 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:32:44.795803 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe06d972-1852-408f-83f9-46b48110a245 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:32:44.805507 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe06d972-1852-408f-83f9-46b48110a245 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:32:44.859360 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d503a960-748d-49ac-8cbf-b3a1cf16a652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:32:44.860035 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d503a960-748d-49ac-8cbf-b3a1cf16a652 admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:44.860315 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d503a960-748d-49ac-8cbf-b3a1cf16a652 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:44.860587 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d503a960-748d-49ac-8cbf-b3a1cf16a652 admin admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:44.861255 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d503a960-748d-49ac-8cbf-b3a1cf16a652 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:32:44.863156 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d503a960-748d-49ac-8cbf-b3a1cf16a652 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:32:44.881925 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1141/2296] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:32:44 2022] POST /identity/v3/users => generated 297 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:32:44.886237 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698304d1-d2ae-48cd-9221-8f08ee5a9191 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:32:44.896890 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698304d1-d2ae-48cd-9221-8f08ee5a9191 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:32:44.901355 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb236f5-543f-41d8-abed-e7e69ef3cfa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:32:44.901993 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb236f5-543f-41d8-abed-e7e69ef3cfa0 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:44.902276 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb236f5-543f-41d8-abed-e7e69ef3cfa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:44.902548 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb236f5-543f-41d8-abed-e7e69ef3cfa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:44.903256 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb236f5-543f-41d8-abed-e7e69ef3cfa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:32:44.905007 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb236f5-543f-41d8-abed-e7e69ef3cfa0 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:32:44.915028 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1156/2297] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 09 20:32:44.919046 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d503a960-748d-49ac-8cbf-b3a1cf16a652 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:32:44.929302 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d503a960-748d-49ac-8cbf-b3a1cf16a652 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:32:44.933931 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c56ddd-f08a-4d96-8e02-17b765b94352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:32:44.934597 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c56ddd-f08a-4d96-8e02-17b765b94352 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:44.934877 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c56ddd-f08a-4d96-8e02-17b765b94352 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:44.935142 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c56ddd-f08a-4d96-8e02-17b765b94352 admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:44.936445 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c56ddd-f08a-4d96-8e02-17b765b94352 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:32:44.938031 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c56ddd-f08a-4d96-8e02-17b765b94352 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:32:44.947717 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1142/2298] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:32:44.951757 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb236f5-543f-41d8-abed-e7e69ef3cfa0 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:32:44.961344 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb236f5-543f-41d8-abed-e7e69ef3cfa0 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:32:44.965948 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea73e75-8a4e-46cb-aa31-2bb914de1f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:32:44.966936 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea73e75-8a4e-46cb-aa31-2bb914de1f64 admin admin] REQUEST_METHOD: `PUT` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:44.967217 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea73e75-8a4e-46cb-aa31-2bb914de1f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:44.967524 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea73e75-8a4e-46cb-aa31-2bb914de1f64 admin admin] PATH_INFO: `/v3/projects/de9c29d4a36c492ba49af574c620e3ad/users/a7a4b90a2f234c07a711e12ee906bf90/roles/79f90a0bf6ea43d0b3c434e31556253a` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:44.981373 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea73e75-8a4e-46cb-aa31-2bb914de1f64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de9c29d4a36c492ba49af574c620e3ad, user_id=a7a4b90a2f234c07a711e12ee906bf90, role_id=79f90a0bf6ea43d0b3c434e31556253a)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:32:44.984586 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea73e75-8a4e-46cb-aa31-2bb914de1f64 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:32:44.996634 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1157/2299] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:32:44 2022] PUT /identity/v3/projects/de9c29d4a36c492ba49af574c620e3ad/users/a7a4b90a2f234c07a711e12ee906bf90/roles/79f90a0bf6ea43d0b3c434e31556253a => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:32:45.009481 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e21bb-12a3-43da-8f2e-1a9f3e29ad60 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:45.009772 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e21bb-12a3-43da-8f2e-1a9f3e29ad60 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:45.010047 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e21bb-12a3-43da-8f2e-1a9f3e29ad60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:45.037082 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-ec3e21bb-12a3-43da-8f2e-1a9f3e29ad60 None None] MFA Rules not processed for user `a7a4b90a2f234c07a711e12ee906bf90`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:32:45.038318 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-ec3e21bb-12a3-43da-8f2e-1a9f3e29ad60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:32:45.100421 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1143/2300] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:32:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:32:45.104887 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea73e75-8a4e-46cb-aa31-2bb914de1f64 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:32:45.164865 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea73e75-8a4e-46cb-aa31-2bb914de1f64 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:32:45.169669 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d63759a-bf62-4444-82d3-4741006a58d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:32:45.170867 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63759a-bf62-4444-82d3-4741006a58d3 admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:45.171145 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63759a-bf62-4444-82d3-4741006a58d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:45.171438 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63759a-bf62-4444-82d3-4741006a58d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:45.172138 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d63759a-bf62-4444-82d3-4741006a58d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:32:45.174008 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d63759a-bf62-4444-82d3-4741006a58d3 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:32:45.198848 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1158/2301] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:32:45 2022] POST /identity/v3/projects => generated 391 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 20:32:45.203129 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e21bb-12a3-43da-8f2e-1a9f3e29ad60 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:32:45.213920 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e21bb-12a3-43da-8f2e-1a9f3e29ad60 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:32:45.268309 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b2fb26-0203-4d74-b79a-c906116b97ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:32:45.268965 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b2fb26-0203-4d74-b79a-c906116b97ea admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:45.269240 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b2fb26-0203-4d74-b79a-c906116b97ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:45.269508 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b2fb26-0203-4d74-b79a-c906116b97ea admin admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:45.270189 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b2fb26-0203-4d74-b79a-c906116b97ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:32:45.272162 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b2fb26-0203-4d74-b79a-c906116b97ea admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:32:45.292957 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1144/2302] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:32:45 2022] POST /identity/v3/users => generated 302 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 20:32:45.298682 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d63759a-bf62-4444-82d3-4741006a58d3 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:32:45.312898 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d63759a-bf62-4444-82d3-4741006a58d3 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:32:45.317476 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68f9b3a-eebd-49bd-ac1e-89007c8a75fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:32:45.318122 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f9b3a-eebd-49bd-ac1e-89007c8a75fb admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:45.318398 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f9b3a-eebd-49bd-ac1e-89007c8a75fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:45.318663 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f9b3a-eebd-49bd-ac1e-89007c8a75fb admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:45.319374 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68f9b3a-eebd-49bd-ac1e-89007c8a75fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:32:45.320978 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68f9b3a-eebd-49bd-ac1e-89007c8a75fb admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:32:45.332032 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1159/2303] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:32:45.336311 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b2fb26-0203-4d74-b79a-c906116b97ea admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:32:45.346812 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b2fb26-0203-4d74-b79a-c906116b97ea admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:32:45.351366 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c62fa7-89dd-4af7-bd45-6542e11d4eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:32:45.352371 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c62fa7-89dd-4af7-bd45-6542e11d4eab admin admin] REQUEST_METHOD: `PUT` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:45.352676 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c62fa7-89dd-4af7-bd45-6542e11d4eab admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:45.352964 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c62fa7-89dd-4af7-bd45-6542e11d4eab admin admin] PATH_INFO: `/v3/projects/221cc669085c4ba9bd5b35270f4b22f6/users/00d82b630c9347388e8c9e4e9afdc439/roles/274130b78e304bb88789c1b349263f3c` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:45.367974 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c62fa7-89dd-4af7-bd45-6542e11d4eab admin admin] RBAC: Authorizing `identity:create_grant(project_id=221cc669085c4ba9bd5b35270f4b22f6, user_id=00d82b630c9347388e8c9e4e9afdc439, role_id=274130b78e304bb88789c1b349263f3c)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:32:45.370615 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c62fa7-89dd-4af7-bd45-6542e11d4eab admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:32:45.383095 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1145/2304] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:32:45 2022] PUT /identity/v3/projects/221cc669085c4ba9bd5b35270f4b22f6/users/00d82b630c9347388e8c9e4e9afdc439/roles/274130b78e304bb88789c1b349263f3c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:32:45.387375 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68f9b3a-eebd-49bd-ac1e-89007c8a75fb admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:32:45.397088 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68f9b3a-eebd-49bd-ac1e-89007c8a75fb admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:32:45.449616 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cbc124-d2bf-4f2a-9496-f2537854a012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:32:45.450187 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cbc124-d2bf-4f2a-9496-f2537854a012 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:45.450464 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cbc124-d2bf-4f2a-9496-f2537854a012 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:45.450730 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cbc124-d2bf-4f2a-9496-f2537854a012 admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:45.451518 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cbc124-d2bf-4f2a-9496-f2537854a012 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:32:45.453087 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cbc124-d2bf-4f2a-9496-f2537854a012 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:32:45.462248 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1160/2305] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:32:45.466327 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c62fa7-89dd-4af7-bd45-6542e11d4eab admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:32:45.477033 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c62fa7-89dd-4af7-bd45-6542e11d4eab admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:32:45.481555 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea85da3a-485e-43c7-9662-3cc9997e2c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:32:45.483045 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea85da3a-485e-43c7-9662-3cc9997e2c3a admin admin] REQUEST_METHOD: `PUT` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:45.483323 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea85da3a-485e-43c7-9662-3cc9997e2c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:45.483626 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea85da3a-485e-43c7-9662-3cc9997e2c3a admin admin] PATH_INFO: `/v3/projects/221cc669085c4ba9bd5b35270f4b22f6/users/00d82b630c9347388e8c9e4e9afdc439/roles/274130b78e304bb88789c1b349263f3c` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:45.485560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea85da3a-485e-43c7-9662-3cc9997e2c3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=221cc669085c4ba9bd5b35270f4b22f6, user_id=00d82b630c9347388e8c9e4e9afdc439, role_id=274130b78e304bb88789c1b349263f3c)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:32:45.488216 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea85da3a-485e-43c7-9662-3cc9997e2c3a admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:32:45.498019 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1146/2306] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:32:45 2022] PUT /identity/v3/projects/221cc669085c4ba9bd5b35270f4b22f6/users/00d82b630c9347388e8c9e4e9afdc439/roles/274130b78e304bb88789c1b349263f3c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:32:45.508046 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fba5b01-9f71-44f2-8f0b-cedae2f1ba39 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:45.508361 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fba5b01-9f71-44f2-8f0b-cedae2f1ba39 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:45.508657 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fba5b01-9f71-44f2-8f0b-cedae2f1ba39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:45.535508 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-5fba5b01-9f71-44f2-8f0b-cedae2f1ba39 None None] MFA Rules not processed for user `00d82b630c9347388e8c9e4e9afdc439`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:32:45.536691 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-5fba5b01-9f71-44f2-8f0b-cedae2f1ba39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:32:45.605809 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1161/2307] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:32:45 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:32:45.617076 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea85da3a-485e-43c7-9662-3cc9997e2c3a admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:32:45.618760 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-ea85da3a-485e-43c7-9662-3cc9997e2c3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:32:45.673846 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea85da3a-485e-43c7-9662-3cc9997e2c3a admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:32:45.677465 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5388ff92-c81e-4dfc-b2d4-3158ab0ff863 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d65e731386d44948dcc1ecd40cbda65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:32:45.678090 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5388ff92-c81e-4dfc-b2d4-3158ab0ff863 service cinder] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:45.678369 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5388ff92-c81e-4dfc-b2d4-3158ab0ff863 service cinder] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:45.678641 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5388ff92-c81e-4dfc-b2d4-3158ab0ff863 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:45.687322 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5388ff92-c81e-4dfc-b2d4-3158ab0ff863 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:32:45.688771 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5388ff92-c81e-4dfc-b2d4-3158ab0ff863 service cinder] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:32:45.697955 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1147/2308] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:32:45 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:32:45.742076 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fba5b01-9f71-44f2-8f0b-cedae2f1ba39 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:32:45.743559 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-5fba5b01-9f71-44f2-8f0b-cedae2f1ba39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:32:45.755262 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fba5b01-9f71-44f2-8f0b-cedae2f1ba39 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:32:45.758763 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c674bac-5d5b-44d3-a277-4d3bf31457b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d65e731386d44948dcc1ecd40cbda65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:32:45.759386 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c674bac-5d5b-44d3-a277-4d3bf31457b6 service cinder] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:45.759689 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c674bac-5d5b-44d3-a277-4d3bf31457b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:45.759956 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c674bac-5d5b-44d3-a277-4d3bf31457b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:45.814685 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c674bac-5d5b-44d3-a277-4d3bf31457b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:32:45.816149 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c674bac-5d5b-44d3-a277-4d3bf31457b6 service cinder] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:32:45.824821 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1162/2309] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:32:45 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:32:48.997744 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5388ff92-c81e-4dfc-b2d4-3158ab0ff863 service cinder] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:32:49.057641 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5388ff92-c81e-4dfc-b2d4-3158ab0ff863 service cinder] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:32:49.062126 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db5f775-e208-4187-81f7-7e69d71e98b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:32:49.062968 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5f775-e208-4187-81f7-7e69d71e98b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:49.063245 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5f775-e208-4187-81f7-7e69d71e98b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:49.063546 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5f775-e208-4187-81f7-7e69d71e98b6 admin admin] PATH_INFO: `/v3/users/a7a4b90a2f234c07a711e12ee906bf90` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:49.064697 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db5f775-e208-4187-81f7-7e69d71e98b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7a4b90a2f234c07a711e12ee906bf90)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:32:49.066607 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db5f775-e208-4187-81f7-7e69d71e98b6 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:32:49.110371 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-5db5f775-e208-4187-81f7-7e69d71e98b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7a4b90a2f234c07a711e12ee906bf90'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:32:49.116742 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-5db5f775-e208-4187-81f7-7e69d71e98b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7a4b90a2f234c07a711e12ee906bf90'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:32:49.123533 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-5db5f775-e208-4187-81f7-7e69d71e98b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7a4b90a2f234c07a711e12ee906bf90'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:32:49.124159 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-5db5f775-e208-4187-81f7-7e69d71e98b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7a4b90a2f234c07a711e12ee906bf90'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:32:49.124855 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-5db5f775-e208-4187-81f7-7e69d71e98b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7a4b90a2f234c07a711e12ee906bf90'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:32:49.141163 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1148/2310] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:32:48 2022] DELETE /identity/v3/users/a7a4b90a2f234c07a711e12ee906bf90 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:32:49.145670 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b6df5-5e62-4d74-9ccc-1a6e336d11d2 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:49.146147 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b6df5-5e62-4d74-9ccc-1a6e336d11d2 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:49.146261 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b6df5-5e62-4d74-9ccc-1a6e336d11d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:49.163043 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-255b6df5-5e62-4d74-9ccc-1a6e336d11d2 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:32:49.164258 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-255b6df5-5e62-4d74-9ccc-1a6e336d11d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:32:49.220476 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1163/2311] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:32:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:32:49.230078 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db5f775-e208-4187-81f7-7e69d71e98b6 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:32:49.231490 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-5db5f775-e208-4187-81f7-7e69d71e98b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:32:49.296361 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db5f775-e208-4187-81f7-7e69d71e98b6 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:32:49.300457 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fb4241-0b8c-48ec-8e60-d55ea4e836d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:32:49.301091 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb4241-0b8c-48ec-8e60-d55ea4e836d5 service neutron] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:49.301366 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb4241-0b8c-48ec-8e60-d55ea4e836d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:49.301634 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb4241-0b8c-48ec-8e60-d55ea4e836d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:49.310916 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fb4241-0b8c-48ec-8e60-d55ea4e836d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:32:49.312386 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fb4241-0b8c-48ec-8e60-d55ea4e836d5 service neutron] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:32:49.321640 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1149/2312] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:32:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:32:49.584093 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255b6df5-5e62-4d74-9ccc-1a6e336d11d2 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:32:49.585608 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-255b6df5-5e62-4d74-9ccc-1a6e336d11d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:32:49.600524 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255b6df5-5e62-4d74-9ccc-1a6e336d11d2 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:32:49.605167 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be3500-4b60-4e7f-9527-b7cf5a6e9a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:32:49.606025 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be3500-4b60-4e7f-9527-b7cf5a6e9a6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:49.606449 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be3500-4b60-4e7f-9527-b7cf5a6e9a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:49.606727 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be3500-4b60-4e7f-9527-b7cf5a6e9a6b admin admin] PATH_INFO: `/v3/projects/de9c29d4a36c492ba49af574c620e3ad` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:49.609099 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6be3500-4b60-4e7f-9527-b7cf5a6e9a6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=de9c29d4a36c492ba49af574c620e3ad)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:32:49.611057 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6be3500-4b60-4e7f-9527-b7cf5a6e9a6b admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:32:49.656784 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-f6be3500-4b60-4e7f-9527-b7cf5a6e9a6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de9c29d4a36c492ba49af574c620e3ad', 'request_id': 'req-f6be3500-4b60-4e7f-9527-b7cf5a6e9a6b'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:32:49.666718 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-f6be3500-4b60-4e7f-9527-b7cf5a6e9a6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de9c29d4a36c492ba49af574c620e3ad', 'request_id': 'req-f6be3500-4b60-4e7f-9527-b7cf5a6e9a6b'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:32:49.672036 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-f6be3500-4b60-4e7f-9527-b7cf5a6e9a6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de9c29d4a36c492ba49af574c620e3ad', 'request_id': 'req-f6be3500-4b60-4e7f-9527-b7cf5a6e9a6b'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:32:49.684012 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-f6be3500-4b60-4e7f-9527-b7cf5a6e9a6b admin admin] The token cache is being invalidate because project de9c29d4a36c492ba49af574c620e3ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:32:49.684291 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-f6be3500-4b60-4e7f-9527-b7cf5a6e9a6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:32:49.684896 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-f6be3500-4b60-4e7f-9527-b7cf5a6e9a6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:32:49.686450 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1164/2313] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:32:49 2022] DELETE /identity/v3/projects/de9c29d4a36c492ba49af574c620e3ad => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:32:49.690375 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fb4241-0b8c-48ec-8e60-d55ea4e836d5 service neutron] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:32:49.699921 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fb4241-0b8c-48ec-8e60-d55ea4e836d5 service neutron] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:32:49.753061 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75196e47-fce7-4c5f-ac4e-beaea74680cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:32:49.754001 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75196e47-fce7-4c5f-ac4e-beaea74680cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:49.754380 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75196e47-fce7-4c5f-ac4e-beaea74680cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:49.754653 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75196e47-fce7-4c5f-ac4e-beaea74680cc admin admin] PATH_INFO: `/v3/users/00d82b630c9347388e8c9e4e9afdc439` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:49.755859 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75196e47-fce7-4c5f-ac4e-beaea74680cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=00d82b630c9347388e8c9e4e9afdc439)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:32:49.757791 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75196e47-fce7-4c5f-ac4e-beaea74680cc admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:32:49.802090 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-75196e47-fce7-4c5f-ac4e-beaea74680cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00d82b630c9347388e8c9e4e9afdc439'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:32:49.808611 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-75196e47-fce7-4c5f-ac4e-beaea74680cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00d82b630c9347388e8c9e4e9afdc439'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:32:49.815807 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-75196e47-fce7-4c5f-ac4e-beaea74680cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00d82b630c9347388e8c9e4e9afdc439'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:32:49.816648 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-75196e47-fce7-4c5f-ac4e-beaea74680cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00d82b630c9347388e8c9e4e9afdc439'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:32:49.818439 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-75196e47-fce7-4c5f-ac4e-beaea74680cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00d82b630c9347388e8c9e4e9afdc439'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:32:49.836203 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1150/2314] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:32:49 2022] DELETE /identity/v3/users/00d82b630c9347388e8c9e4e9afdc439 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:32:50.099303 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be3500-4b60-4e7f-9527-b7cf5a6e9a6b admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:32:50.100816 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-f6be3500-4b60-4e7f-9527-b7cf5a6e9a6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:32:50.113778 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be3500-4b60-4e7f-9527-b7cf5a6e9a6b admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:32:50.168534 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16999852-e994-4710-ba10-5c4a2cce4315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:32:50.169383 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16999852-e994-4710-ba10-5c4a2cce4315 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:50.170347 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16999852-e994-4710-ba10-5c4a2cce4315 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:50.170634 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16999852-e994-4710-ba10-5c4a2cce4315 admin admin] PATH_INFO: `/v3/projects/221cc669085c4ba9bd5b35270f4b22f6` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:50.171840 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16999852-e994-4710-ba10-5c4a2cce4315 admin admin] RBAC: Authorizing `identity:delete_project(project_id=221cc669085c4ba9bd5b35270f4b22f6)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:32:50.173730 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16999852-e994-4710-ba10-5c4a2cce4315 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:32:50.216870 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-16999852-e994-4710-ba10-5c4a2cce4315 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '221cc669085c4ba9bd5b35270f4b22f6', 'request_id': 'req-16999852-e994-4710-ba10-5c4a2cce4315'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:32:50.222659 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-16999852-e994-4710-ba10-5c4a2cce4315 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '221cc669085c4ba9bd5b35270f4b22f6', 'request_id': 'req-16999852-e994-4710-ba10-5c4a2cce4315'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:32:50.227789 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-16999852-e994-4710-ba10-5c4a2cce4315 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '221cc669085c4ba9bd5b35270f4b22f6', 'request_id': 'req-16999852-e994-4710-ba10-5c4a2cce4315'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:32:50.239936 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-16999852-e994-4710-ba10-5c4a2cce4315 admin admin] The token cache is being invalidate because project 221cc669085c4ba9bd5b35270f4b22f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:32:50.240217 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-16999852-e994-4710-ba10-5c4a2cce4315 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:32:50.240825 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-16999852-e994-4710-ba10-5c4a2cce4315 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:32:50.242361 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1165/2315] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:32:50 2022] DELETE /identity/v3/projects/221cc669085c4ba9bd5b35270f4b22f6 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:32:50.247589 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8372850-f714-48b0-806d-c3cb6c67588b None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:50.248700 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8372850-f714-48b0-806d-c3cb6c67588b None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:50.248814 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8372850-f714-48b0-806d-c3cb6c67588b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:50.271614 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-f8372850-f714-48b0-806d-c3cb6c67588b None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:32:50.272848 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-f8372850-f714-48b0-806d-c3cb6c67588b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:32:50.330825 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1151/2316] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:32:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:32:50.339834 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255789a-b31e-4e3a-b4ce-9c6ce985f585 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:50.340121 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255789a-b31e-4e3a-b4ce-9c6ce985f585 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:50.340396 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255789a-b31e-4e3a-b4ce-9c6ce985f585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:50.358497 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-2255789a-b31e-4e3a-b4ce-9c6ce985f585 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:32:50.359731 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-2255789a-b31e-4e3a-b4ce-9c6ce985f585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:32:50.367476 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1166/2317] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:32:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:32:50.371686 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8372850-f714-48b0-806d-c3cb6c67588b None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:32:50.381675 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8372850-f714-48b0-806d-c3cb6c67588b None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:32:50.391824 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0070a7-f4a6-4108-b17a-b6eaf84469d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:32:50.392512 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0070a7-f4a6-4108-b17a-b6eaf84469d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:50.392791 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0070a7-f4a6-4108-b17a-b6eaf84469d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:50.393061 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0070a7-f4a6-4108-b17a-b6eaf84469d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:50.393785 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0070a7-f4a6-4108-b17a-b6eaf84469d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:32:50.394084 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0070a7-f4a6-4108-b17a-b6eaf84469d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:32:50.395724 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0070a7-f4a6-4108-b17a-b6eaf84469d8 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:32:50.407282 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1152/2318] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 9 20:32:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:32:50.411661 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2255789a-b31e-4e3a-b4ce-9c6ce985f585 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:32:50.421803 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2255789a-b31e-4e3a-b4ce-9c6ce985f585 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:32:50.426425 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b696aa-8224-45c2-92ff-d5d95c406537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:32:50.427064 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b696aa-8224-45c2-92ff-d5d95c406537 admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:50.427344 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b696aa-8224-45c2-92ff-d5d95c406537 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:50.427650 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b696aa-8224-45c2-92ff-d5d95c406537 admin admin] PATH_INFO: `/v3/projects` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:50.428326 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b696aa-8224-45c2-92ff-d5d95c406537 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:32:50.430249 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b696aa-8224-45c2-92ff-d5d95c406537 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:32:50.454795 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1167/2319] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:32:50 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:32:50.458856 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0070a7-f4a6-4108-b17a-b6eaf84469d8 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:32:50.469176 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0070a7-f4a6-4108-b17a-b6eaf84469d8 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:32:50.523816 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a3f6bb-3832-4b09-b096-4e026e8a8044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:32:50.524466 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a3f6bb-3832-4b09-b096-4e026e8a8044 admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:50.524746 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a3f6bb-3832-4b09-b096-4e026e8a8044 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:50.525018 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a3f6bb-3832-4b09-b096-4e026e8a8044 admin admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:50.525686 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a3f6bb-3832-4b09-b096-4e026e8a8044 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:32:50.527656 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a3f6bb-3832-4b09-b096-4e026e8a8044 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:32:50.549033 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1153/2320] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:32:50 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:32:50.553289 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b696aa-8224-45c2-92ff-d5d95c406537 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:32:50.563583 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b696aa-8224-45c2-92ff-d5d95c406537 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:32:50.568188 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b658616d-9148-4641-802b-437346b88525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:32:50.568831 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b658616d-9148-4641-802b-437346b88525 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:50.569110 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b658616d-9148-4641-802b-437346b88525 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:50.569382 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b658616d-9148-4641-802b-437346b88525 admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:50.570105 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b658616d-9148-4641-802b-437346b88525 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:32:50.571722 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b658616d-9148-4641-802b-437346b88525 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:32:50.582433 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1168/2321] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:32:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:32:50.586406 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a3f6bb-3832-4b09-b096-4e026e8a8044 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:32:50.596763 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a3f6bb-3832-4b09-b096-4e026e8a8044 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:32:50.601291 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7287cb-1c17-41a1-8742-011c782eb065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:32:50.601925 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7287cb-1c17-41a1-8742-011c782eb065 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:50.602199 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7287cb-1c17-41a1-8742-011c782eb065 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:50.602465 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7287cb-1c17-41a1-8742-011c782eb065 admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:50.603170 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7287cb-1c17-41a1-8742-011c782eb065 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:32:50.604811 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7287cb-1c17-41a1-8742-011c782eb065 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:32:50.614828 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1154/2322] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:32:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:32:50.619031 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b658616d-9148-4641-802b-437346b88525 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:32:50.628987 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b658616d-9148-4641-802b-437346b88525 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:32:50.633731 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629540e1-8174-469f-b078-cb884cc422f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:32:50.634586 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629540e1-8174-469f-b078-cb884cc422f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:50.634861 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629540e1-8174-469f-b078-cb884cc422f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:50.635131 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629540e1-8174-469f-b078-cb884cc422f7 admin admin] PATH_INFO: `/v3/projects/b3fb70385deb4b48b3dfc0b18c0b2e7e/users/63fa8b998fa74430b43ce87d94acf392/roles/79f90a0bf6ea43d0b3c434e31556253a` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:50.650484 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629540e1-8174-469f-b078-cb884cc422f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3fb70385deb4b48b3dfc0b18c0b2e7e, user_id=63fa8b998fa74430b43ce87d94acf392, role_id=79f90a0bf6ea43d0b3c434e31556253a)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:32:50.653129 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629540e1-8174-469f-b078-cb884cc422f7 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:32:50.666096 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1169/2323] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:32:50 2022] PUT /identity/v3/projects/b3fb70385deb4b48b3dfc0b18c0b2e7e/users/63fa8b998fa74430b43ce87d94acf392/roles/79f90a0bf6ea43d0b3c434e31556253a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:32:50.671996 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d89d0-42be-496f-9247-a9522683509b None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:50.672285 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d89d0-42be-496f-9247-a9522683509b None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:50.672558 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d89d0-42be-496f-9247-a9522683509b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:50.689760 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-4a1d89d0-42be-496f-9247-a9522683509b None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:32:50.690964 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-4a1d89d0-42be-496f-9247-a9522683509b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:32:50.748267 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1155/2324] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:32:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:32:50.757784 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629540e1-8174-469f-b078-cb884cc422f7 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:32:50.759470 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-629540e1-8174-469f-b078-cb884cc422f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:32:50.814247 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629540e1-8174-469f-b078-cb884cc422f7 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:32:50.817836 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040dd44f-c755-4f07-a559-6d811b2257c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:32:50.818462 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040dd44f-c755-4f07-a559-6d811b2257c7 service neutron] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:50.818738 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040dd44f-c755-4f07-a559-6d811b2257c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:50.819009 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040dd44f-c755-4f07-a559-6d811b2257c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:50.827701 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040dd44f-c755-4f07-a559-6d811b2257c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:32:50.829109 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040dd44f-c755-4f07-a559-6d811b2257c7 service neutron] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:32:50.838123 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1170/2325] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:32:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:32:51.434201 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf7787-5c52-4487-9ac7-f409b8b134b5 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:51.434708 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf7787-5c52-4487-9ac7-f409b8b134b5 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:51.434809 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf7787-5c52-4487-9ac7-f409b8b134b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:51.461988 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-66cf7787-5c52-4487-9ac7-f409b8b134b5 None None] MFA Rules not processed for user `63fa8b998fa74430b43ce87d94acf392`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:32:51.463237 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-66cf7787-5c52-4487-9ac7-f409b8b134b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:32:51.527213 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1156/2326] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:32:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:32:51.532585 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040dd44f-c755-4f07-a559-6d811b2257c7 service neutron] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:32:51.541994 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040dd44f-c755-4f07-a559-6d811b2257c7 service neutron] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:32:51.547206 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a300263b-474e-413a-87af-8a8a0b707fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:32:51.547901 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300263b-474e-413a-87af-8a8a0b707fb7 admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:51.548170 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300263b-474e-413a-87af-8a8a0b707fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:51.548442 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300263b-474e-413a-87af-8a8a0b707fb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:51.549129 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a300263b-474e-413a-87af-8a8a0b707fb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:32:51.551050 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a300263b-474e-413a-87af-8a8a0b707fb7 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:32:51.577553 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1171/2327] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:32:51 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:32:51.581614 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cf7787-5c52-4487-9ac7-f409b8b134b5 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:32:51.592865 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cf7787-5c52-4487-9ac7-f409b8b134b5 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:32:51.651068 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba3db15-25a5-4c47-9585-f20a8799a577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:32:51.651796 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3db15-25a5-4c47-9585-f20a8799a577 admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:51.652072 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3db15-25a5-4c47-9585-f20a8799a577 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:51.652337 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3db15-25a5-4c47-9585-f20a8799a577 admin admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:51.653038 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba3db15-25a5-4c47-9585-f20a8799a577 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:32:51.656081 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba3db15-25a5-4c47-9585-f20a8799a577 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:32:51.676489 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1157/2328] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:32:51 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:32:51.680670 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a300263b-474e-413a-87af-8a8a0b707fb7 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:32:51.691066 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a300263b-474e-413a-87af-8a8a0b707fb7 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:32:51.697357 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708ccea4-fcbb-4983-a804-3751f492b0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:32:51.698003 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ccea4-fcbb-4983-a804-3751f492b0ef admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:51.698281 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ccea4-fcbb-4983-a804-3751f492b0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:51.698551 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ccea4-fcbb-4983-a804-3751f492b0ef admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:51.699280 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708ccea4-fcbb-4983-a804-3751f492b0ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:32:51.701390 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708ccea4-fcbb-4983-a804-3751f492b0ef admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:32:51.711968 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1172/2329] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:32:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:32:51.716113 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba3db15-25a5-4c47-9585-f20a8799a577 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:32:51.726310 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba3db15-25a5-4c47-9585-f20a8799a577 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:32:51.730836 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca7a1a-363f-4c3b-97fd-f853c7d9df99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:32:51.731728 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca7a1a-363f-4c3b-97fd-f853c7d9df99 admin admin] REQUEST_METHOD: `PUT` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:51.732010 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca7a1a-363f-4c3b-97fd-f853c7d9df99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:51.732281 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca7a1a-363f-4c3b-97fd-f853c7d9df99 admin admin] PATH_INFO: `/v3/projects/40686b68d5864dd6839670525666aeec/users/6482182c7f2d4e079c057e080705ce18/roles/274130b78e304bb88789c1b349263f3c` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:51.746439 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bca7a1a-363f-4c3b-97fd-f853c7d9df99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40686b68d5864dd6839670525666aeec, user_id=6482182c7f2d4e079c057e080705ce18, role_id=274130b78e304bb88789c1b349263f3c)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:32:51.749396 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bca7a1a-363f-4c3b-97fd-f853c7d9df99 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:32:51.762174 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1158/2330] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:32:51 2022] PUT /identity/v3/projects/40686b68d5864dd6839670525666aeec/users/6482182c7f2d4e079c057e080705ce18/roles/274130b78e304bb88789c1b349263f3c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:32:51.767060 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708ccea4-fcbb-4983-a804-3751f492b0ef admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:32:51.776749 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708ccea4-fcbb-4983-a804-3751f492b0ef admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:32:51.831481 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46977130-87d4-421f-a79c-ce856b2ab4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:32:51.832067 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46977130-87d4-421f-a79c-ce856b2ab4b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:51.832350 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46977130-87d4-421f-a79c-ce856b2ab4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:51.832708 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46977130-87d4-421f-a79c-ce856b2ab4b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:51.833428 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46977130-87d4-421f-a79c-ce856b2ab4b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:32:51.835012 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46977130-87d4-421f-a79c-ce856b2ab4b7 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:32:51.845695 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1173/2331] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:32:51 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:32:51.849923 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca7a1a-363f-4c3b-97fd-f853c7d9df99 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:32:51.860321 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca7a1a-363f-4c3b-97fd-f853c7d9df99 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:32:51.864866 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc740b3b-7c94-4061-9a9c-1d1cdd09c887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:32:51.865723 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc740b3b-7c94-4061-9a9c-1d1cdd09c887 admin admin] REQUEST_METHOD: `PUT` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:51.866005 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc740b3b-7c94-4061-9a9c-1d1cdd09c887 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:51.866271 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc740b3b-7c94-4061-9a9c-1d1cdd09c887 admin admin] PATH_INFO: `/v3/projects/40686b68d5864dd6839670525666aeec/users/6482182c7f2d4e079c057e080705ce18/roles/274130b78e304bb88789c1b349263f3c` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:51.868272 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc740b3b-7c94-4061-9a9c-1d1cdd09c887 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40686b68d5864dd6839670525666aeec, user_id=6482182c7f2d4e079c057e080705ce18, role_id=274130b78e304bb88789c1b349263f3c)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:32:51.870946 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc740b3b-7c94-4061-9a9c-1d1cdd09c887 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:32:51.881034 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1159/2332] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:32:51 2022] PUT /identity/v3/projects/40686b68d5864dd6839670525666aeec/users/6482182c7f2d4e079c057e080705ce18/roles/274130b78e304bb88789c1b349263f3c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:32:52.511090 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc449ed-bd36-4340-84f0-0b4de890932e None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:52.511719 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc449ed-bd36-4340-84f0-0b4de890932e None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:52.512459 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc449ed-bd36-4340-84f0-0b4de890932e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:52.542290 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-dcc449ed-bd36-4340-84f0-0b4de890932e None None] MFA Rules not processed for user `6482182c7f2d4e079c057e080705ce18`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:32:52.543733 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-dcc449ed-bd36-4340-84f0-0b4de890932e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:32:52.674145 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1174/2333] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:32:52 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:32:52.688968 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc740b3b-7c94-4061-9a9c-1d1cdd09c887 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:32:52.690744 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-bc740b3b-7c94-4061-9a9c-1d1cdd09c887 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:32:52.775649 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc740b3b-7c94-4061-9a9c-1d1cdd09c887 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:32:52.779979 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0e3323-8ff3-422a-aaba-3293d194b23f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d65e731386d44948dcc1ecd40cbda65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:32:52.780851 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e3323-8ff3-422a-aaba-3293d194b23f service cinder] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:52.781189 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e3323-8ff3-422a-aaba-3293d194b23f service cinder] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:52.781525 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e3323-8ff3-422a-aaba-3293d194b23f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:52.837819 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0e3323-8ff3-422a-aaba-3293d194b23f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:32:52.839362 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0e3323-8ff3-422a-aaba-3293d194b23f service cinder] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:32:52.849166 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1160/2334] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:32:52 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:32:54.183964 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc449ed-bd36-4340-84f0-0b4de890932e None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:32:54.186086 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-dcc449ed-bd36-4340-84f0-0b4de890932e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:32:54.197706 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc449ed-bd36-4340-84f0-0b4de890932e None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:32:54.201323 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f797a162-db55-41d2-8141-f23d3d50bdce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d65e731386d44948dcc1ecd40cbda65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:32:54.202115 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797a162-db55-41d2-8141-f23d3d50bdce service cinder] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:32:54.202397 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797a162-db55-41d2-8141-f23d3d50bdce service cinder] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:32:54.202669 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797a162-db55-41d2-8141-f23d3d50bdce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:32:54.211294 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f797a162-db55-41d2-8141-f23d3d50bdce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:32:54.212742 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f797a162-db55-41d2-8141-f23d3d50bdce service cinder] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:32:54.222787 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1175/2335] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:32:54 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:33:07.381026 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0e3323-8ff3-422a-aaba-3293d194b23f service cinder] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:33:07.447437 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0e3323-8ff3-422a-aaba-3293d194b23f service cinder] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:33:07.451892 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30931df3-c1d3-40c3-a09b-d7367f06a909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:33:07.453406 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30931df3-c1d3-40c3-a09b-d7367f06a909 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:33:07.453682 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30931df3-c1d3-40c3-a09b-d7367f06a909 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:33:07.453951 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30931df3-c1d3-40c3-a09b-d7367f06a909 admin admin] PATH_INFO: `/v3/users/63fa8b998fa74430b43ce87d94acf392` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:33:07.455129 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30931df3-c1d3-40c3-a09b-d7367f06a909 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63fa8b998fa74430b43ce87d94acf392)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:33:07.457093 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30931df3-c1d3-40c3-a09b-d7367f06a909 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:33:07.504402 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-30931df3-c1d3-40c3-a09b-d7367f06a909 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63fa8b998fa74430b43ce87d94acf392'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:33:07.511232 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-30931df3-c1d3-40c3-a09b-d7367f06a909 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63fa8b998fa74430b43ce87d94acf392'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:33:07.520696 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-30931df3-c1d3-40c3-a09b-d7367f06a909 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63fa8b998fa74430b43ce87d94acf392'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:33:07.521495 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-30931df3-c1d3-40c3-a09b-d7367f06a909 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63fa8b998fa74430b43ce87d94acf392'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:33:07.522085 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-30931df3-c1d3-40c3-a09b-d7367f06a909 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63fa8b998fa74430b43ce87d94acf392'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:33:07.540355 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1161/2336] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:33:07 2022] DELETE /identity/v3/users/63fa8b998fa74430b43ce87d94acf392 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:33:07.753372 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f797a162-db55-41d2-8141-f23d3d50bdce service cinder] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:33:07.774913 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f797a162-db55-41d2-8141-f23d3d50bdce service cinder] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:33:07.859125 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6871bb89-443a-40ec-bd0f-4d1a6c3afc27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:33:07.860116 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6871bb89-443a-40ec-bd0f-4d1a6c3afc27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:33:07.860620 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6871bb89-443a-40ec-bd0f-4d1a6c3afc27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:33:07.862345 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6871bb89-443a-40ec-bd0f-4d1a6c3afc27 admin admin] PATH_INFO: `/v3/projects/b3fb70385deb4b48b3dfc0b18c0b2e7e` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:33:07.864220 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6871bb89-443a-40ec-bd0f-4d1a6c3afc27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3fb70385deb4b48b3dfc0b18c0b2e7e)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:33:07.867969 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6871bb89-443a-40ec-bd0f-4d1a6c3afc27 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:33:07.938150 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-6871bb89-443a-40ec-bd0f-4d1a6c3afc27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3fb70385deb4b48b3dfc0b18c0b2e7e', 'request_id': 'req-6871bb89-443a-40ec-bd0f-4d1a6c3afc27'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:33:07.944665 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-6871bb89-443a-40ec-bd0f-4d1a6c3afc27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3fb70385deb4b48b3dfc0b18c0b2e7e', 'request_id': 'req-6871bb89-443a-40ec-bd0f-4d1a6c3afc27'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:33:07.950702 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-6871bb89-443a-40ec-bd0f-4d1a6c3afc27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3fb70385deb4b48b3dfc0b18c0b2e7e', 'request_id': 'req-6871bb89-443a-40ec-bd0f-4d1a6c3afc27'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:33:07.965829 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-6871bb89-443a-40ec-bd0f-4d1a6c3afc27 admin admin] The token cache is being invalidate because project b3fb70385deb4b48b3dfc0b18c0b2e7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:33:07.966109 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-6871bb89-443a-40ec-bd0f-4d1a6c3afc27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:33:07.967010 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-6871bb89-443a-40ec-bd0f-4d1a6c3afc27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:33:07.968981 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1176/2337] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:33:07 2022] DELETE /identity/v3/projects/b3fb70385deb4b48b3dfc0b18c0b2e7e => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:33:07.973045 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30931df3-c1d3-40c3-a09b-d7367f06a909 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:33:07.974493 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-30931df3-c1d3-40c3-a09b-d7367f06a909 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:33:07.989695 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30931df3-c1d3-40c3-a09b-d7367f06a909 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:33:08.054396 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db509fee-6272-4ff4-8f2d-d29b6947c733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:33:08.055261 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db509fee-6272-4ff4-8f2d-d29b6947c733 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:33:08.055577 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db509fee-6272-4ff4-8f2d-d29b6947c733 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:33:08.055847 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db509fee-6272-4ff4-8f2d-d29b6947c733 admin admin] PATH_INFO: `/v3/users/6482182c7f2d4e079c057e080705ce18` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:33:08.057390 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db509fee-6272-4ff4-8f2d-d29b6947c733 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6482182c7f2d4e079c057e080705ce18)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:33:08.059312 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db509fee-6272-4ff4-8f2d-d29b6947c733 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:33:08.106513 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-db509fee-6272-4ff4-8f2d-d29b6947c733 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6482182c7f2d4e079c057e080705ce18'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:33:08.114263 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-db509fee-6272-4ff4-8f2d-d29b6947c733 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6482182c7f2d4e079c057e080705ce18'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:33:08.121895 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-db509fee-6272-4ff4-8f2d-d29b6947c733 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6482182c7f2d4e079c057e080705ce18'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:33:08.122834 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-db509fee-6272-4ff4-8f2d-d29b6947c733 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6482182c7f2d4e079c057e080705ce18'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:33:08.123551 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-db509fee-6272-4ff4-8f2d-d29b6947c733 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6482182c7f2d4e079c057e080705ce18'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:33:08.143210 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1162/2338] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:33:07 2022] DELETE /identity/v3/users/6482182c7f2d4e079c057e080705ce18 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:33:08.370713 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6871bb89-443a-40ec-bd0f-4d1a6c3afc27 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:33:08.372236 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-6871bb89-443a-40ec-bd0f-4d1a6c3afc27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:33:08.385292 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6871bb89-443a-40ec-bd0f-4d1a6c3afc27 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:33:08.445916 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3f5505-6b71-4bef-8bdc-055e02d3be45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:33:08.446868 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3f5505-6b71-4bef-8bdc-055e02d3be45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:33:08.447154 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3f5505-6b71-4bef-8bdc-055e02d3be45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:33:08.447460 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3f5505-6b71-4bef-8bdc-055e02d3be45 admin admin] PATH_INFO: `/v3/projects/40686b68d5864dd6839670525666aeec` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:33:08.448639 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3f5505-6b71-4bef-8bdc-055e02d3be45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40686b68d5864dd6839670525666aeec)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:33:08.450539 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3f5505-6b71-4bef-8bdc-055e02d3be45 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:33:08.495884 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-3c3f5505-6b71-4bef-8bdc-055e02d3be45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40686b68d5864dd6839670525666aeec', 'request_id': 'req-3c3f5505-6b71-4bef-8bdc-055e02d3be45'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:33:08.502692 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-3c3f5505-6b71-4bef-8bdc-055e02d3be45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40686b68d5864dd6839670525666aeec', 'request_id': 'req-3c3f5505-6b71-4bef-8bdc-055e02d3be45'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:33:08.507984 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-3c3f5505-6b71-4bef-8bdc-055e02d3be45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40686b68d5864dd6839670525666aeec', 'request_id': 'req-3c3f5505-6b71-4bef-8bdc-055e02d3be45'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:33:08.520884 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-3c3f5505-6b71-4bef-8bdc-055e02d3be45 admin admin] The token cache is being invalidate because project 40686b68d5864dd6839670525666aeec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:33:08.521239 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-3c3f5505-6b71-4bef-8bdc-055e02d3be45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:33:08.522066 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-3c3f5505-6b71-4bef-8bdc-055e02d3be45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:33:08.523757 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1177/2339] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:33:08 2022] DELETE /identity/v3/projects/40686b68d5864dd6839670525666aeec => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:33:08.528655 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b35956-8a95-4ae0-9cb0-13d048a69f21 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:33:08.529158 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b35956-8a95-4ae0-9cb0-13d048a69f21 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:33:08.529322 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b35956-8a95-4ae0-9cb0-13d048a69f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:33:08.548804 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-42b35956-8a95-4ae0-9cb0-13d048a69f21 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:33:08.550004 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-42b35956-8a95-4ae0-9cb0-13d048a69f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:33:08.613079 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1163/2340] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:33:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:33:08.621117 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc10221-7413-436a-8032-f5f13235dc93 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:33:08.621401 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc10221-7413-436a-8032-f5f13235dc93 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:33:08.621671 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc10221-7413-436a-8032-f5f13235dc93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:33:08.640361 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-edc10221-7413-436a-8032-f5f13235dc93 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:33:08.641611 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-edc10221-7413-436a-8032-f5f13235dc93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:33:08.649415 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1178/2341] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:33:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:33:08.653573 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b35956-8a95-4ae0-9cb0-13d048a69f21 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:33:08.663977 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b35956-8a95-4ae0-9cb0-13d048a69f21 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:33:08.668561 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6882d070-1a63-4e31-b7de-a4ced1540179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:33:08.669224 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6882d070-1a63-4e31-b7de-a4ced1540179 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:33:08.669501 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6882d070-1a63-4e31-b7de-a4ced1540179 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:33:08.669769 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6882d070-1a63-4e31-b7de-a4ced1540179 admin admin] PATH_INFO: `/v3/domains` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:33:08.670488 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6882d070-1a63-4e31-b7de-a4ced1540179 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:33:08.670845 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6882d070-1a63-4e31-b7de-a4ced1540179 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:33:08.673321 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6882d070-1a63-4e31-b7de-a4ced1540179 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:33:08.685982 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1164/2342] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 9 20:33:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:33:08.690757 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc10221-7413-436a-8032-f5f13235dc93 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:33:08.700927 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc10221-7413-436a-8032-f5f13235dc93 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:33:08.707143 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab5e4e3-17d1-496e-a8fa-3b32a1b9f85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:33:08.707899 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab5e4e3-17d1-496e-a8fa-3b32a1b9f85f admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:33:08.708293 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab5e4e3-17d1-496e-a8fa-3b32a1b9f85f admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:33:08.708630 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab5e4e3-17d1-496e-a8fa-3b32a1b9f85f admin admin] PATH_INFO: `/v3/projects` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:33:08.709409 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab5e4e3-17d1-496e-a8fa-3b32a1b9f85f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:33:08.711582 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab5e4e3-17d1-496e-a8fa-3b32a1b9f85f admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:33:08.742245 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1179/2343] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:33:08 2022] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 20:33:08.746268 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6882d070-1a63-4e31-b7de-a4ced1540179 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:33:08.757573 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6882d070-1a63-4e31-b7de-a4ced1540179 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:33:08.817394 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2f3479-200b-4ffd-bd2b-72bd9cc084e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:33:08.818072 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2f3479-200b-4ffd-bd2b-72bd9cc084e9 admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:33:08.818365 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2f3479-200b-4ffd-bd2b-72bd9cc084e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:33:08.818603 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2f3479-200b-4ffd-bd2b-72bd9cc084e9 admin admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:33:08.819291 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2f3479-200b-4ffd-bd2b-72bd9cc084e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:33:08.821311 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2f3479-200b-4ffd-bd2b-72bd9cc084e9 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:33:08.845600 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1165/2344] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:33:08 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 20:33:08.846896 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab5e4e3-17d1-496e-a8fa-3b32a1b9f85f admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:33:08.857010 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab5e4e3-17d1-496e-a8fa-3b32a1b9f85f admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:33:08.861937 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4347ec50-ba19-4a3e-9a96-d8211d827281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:33:08.862670 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347ec50-ba19-4a3e-9a96-d8211d827281 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:33:08.862959 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347ec50-ba19-4a3e-9a96-d8211d827281 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:33:08.863234 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347ec50-ba19-4a3e-9a96-d8211d827281 admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:33:08.864001 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4347ec50-ba19-4a3e-9a96-d8211d827281 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:33:08.865593 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4347ec50-ba19-4a3e-9a96-d8211d827281 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:33:08.876593 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1180/2345] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:33:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:33:08.880334 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2f3479-200b-4ffd-bd2b-72bd9cc084e9 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:33:08.892114 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2f3479-200b-4ffd-bd2b-72bd9cc084e9 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:33:08.896921 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0aaee3-62cd-4780-b90a-ee2b5c0bd6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:33:08.897773 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0aaee3-62cd-4780-b90a-ee2b5c0bd6f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:33:08.898045 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0aaee3-62cd-4780-b90a-ee2b5c0bd6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:33:08.898311 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0aaee3-62cd-4780-b90a-ee2b5c0bd6f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:33:08.899029 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0aaee3-62cd-4780-b90a-ee2b5c0bd6f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:33:08.900673 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0aaee3-62cd-4780-b90a-ee2b5c0bd6f7 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:33:08.910885 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1166/2346] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:33:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:33:08.915255 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4347ec50-ba19-4a3e-9a96-d8211d827281 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:33:08.926264 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4347ec50-ba19-4a3e-9a96-d8211d827281 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:33:08.931752 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31067e18-56d0-4fe9-89eb-af9ab148fdb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:33:08.933042 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31067e18-56d0-4fe9-89eb-af9ab148fdb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:33:08.933544 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31067e18-56d0-4fe9-89eb-af9ab148fdb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:33:08.934053 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31067e18-56d0-4fe9-89eb-af9ab148fdb5 admin admin] PATH_INFO: `/v3/projects/999e834c2390469e901ca837b714d3f5/users/5e7a16481a934d9182997139768aed21/roles/79f90a0bf6ea43d0b3c434e31556253a` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:33:08.952826 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31067e18-56d0-4fe9-89eb-af9ab148fdb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=999e834c2390469e901ca837b714d3f5, user_id=5e7a16481a934d9182997139768aed21, role_id=79f90a0bf6ea43d0b3c434e31556253a)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:33:08.955372 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31067e18-56d0-4fe9-89eb-af9ab148fdb5 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:33:08.974993 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1181/2347] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:33:08 2022] PUT /identity/v3/projects/999e834c2390469e901ca837b714d3f5/users/5e7a16481a934d9182997139768aed21/roles/79f90a0bf6ea43d0b3c434e31556253a => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:33:08.981813 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a31e4-a664-40fb-a837-1904296b806e None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:33:08.982108 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a31e4-a664-40fb-a837-1904296b806e None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:33:08.982387 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a31e4-a664-40fb-a837-1904296b806e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:33:09.009479 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-485a31e4-a664-40fb-a837-1904296b806e None None] MFA Rules not processed for user `5e7a16481a934d9182997139768aed21`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:33:09.010942 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-485a31e4-a664-40fb-a837-1904296b806e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:33:09.076504 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1167/2348] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:33:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:33:09.080947 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31067e18-56d0-4fe9-89eb-af9ab148fdb5 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:33:09.136030 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f9cefd-75ac-4f4f-84bc-a89e06964ae7 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:33:09.136314 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f9cefd-75ac-4f4f-84bc-a89e06964ae7 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:33:09.136579 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f9cefd-75ac-4f4f-84bc-a89e06964ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:33:09.146512 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31067e18-56d0-4fe9-89eb-af9ab148fdb5 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:33:09.151343 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216b6555-6ffd-4c59-8db5-c639d604adaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:33:09.152135 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b6555-6ffd-4c59-8db5-c639d604adaf admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:33:09.152520 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b6555-6ffd-4c59-8db5-c639d604adaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:33:09.152802 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b6555-6ffd-4c59-8db5-c639d604adaf admin admin] PATH_INFO: `/v3/projects` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:33:09.153373 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-56f9cefd-75ac-4f4f-84bc-a89e06964ae7 None None] MFA Rules not processed for user `dee809a4a41f4d2c91edb83c1f4d224c`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:33:09.153499 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216b6555-6ffd-4c59-8db5-c639d604adaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:33:09.154551 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-56f9cefd-75ac-4f4f-84bc-a89e06964ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:33:09.155451 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216b6555-6ffd-4c59-8db5-c639d604adaf admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:33:09.183972 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1182/2349] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:33:09 2022] POST /identity/v3/projects => generated 375 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:33:09.187481 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216b6555-6ffd-4c59-8db5-c639d604adaf admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:33:09.210654 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1168/2350] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:33:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:33:09.248512 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216b6555-6ffd-4c59-8db5-c639d604adaf admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:33:09.254462 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75310f34-34a0-45a0-905c-5c2f0fa0c010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:33:09.255069 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75310f34-34a0-45a0-905c-5c2f0fa0c010 admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:33:09.255364 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75310f34-34a0-45a0-905c-5c2f0fa0c010 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:33:09.255701 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75310f34-34a0-45a0-905c-5c2f0fa0c010 admin admin] PATH_INFO: `/v3/users` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:33:09.256417 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75310f34-34a0-45a0-905c-5c2f0fa0c010 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:33:09.258324 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75310f34-34a0-45a0-905c-5c2f0fa0c010 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:33:09.286546 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1183/2351] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:33:09 2022] POST /identity/v3/users => generated 294 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:33:09.287875 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f9cefd-75ac-4f4f-84bc-a89e06964ae7 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:33:09.299167 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f9cefd-75ac-4f4f-84bc-a89e06964ae7 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:33:09.303866 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18978007-9221-4939-b692-fa0dea6b2bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:33:09.304480 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18978007-9221-4939-b692-fa0dea6b2bd0 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:33:09.304751 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18978007-9221-4939-b692-fa0dea6b2bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:33:09.305086 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18978007-9221-4939-b692-fa0dea6b2bd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:33:09.305732 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18978007-9221-4939-b692-fa0dea6b2bd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:33:09.307309 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18978007-9221-4939-b692-fa0dea6b2bd0 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:33:09.317327 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1169/2352] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:33:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:33:09.321448 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75310f34-34a0-45a0-905c-5c2f0fa0c010 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:33:09.331751 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75310f34-34a0-45a0-905c-5c2f0fa0c010 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:33:09.336435 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4edc8b-c47a-4580-8b73-f8b72a65e6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:33:09.337308 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4edc8b-c47a-4580-8b73-f8b72a65e6db admin admin] REQUEST_METHOD: `PUT` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:33:09.337593 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4edc8b-c47a-4580-8b73-f8b72a65e6db admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:33:09.337870 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4edc8b-c47a-4580-8b73-f8b72a65e6db admin admin] PATH_INFO: `/v3/projects/76af978b0c734973bda74e61071bd10d/users/9fab34832df84d2ea35e63df7c7c8142/roles/274130b78e304bb88789c1b349263f3c` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:33:09.353241 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4edc8b-c47a-4580-8b73-f8b72a65e6db admin admin] RBAC: Authorizing `identity:create_grant(project_id=76af978b0c734973bda74e61071bd10d, user_id=9fab34832df84d2ea35e63df7c7c8142, role_id=274130b78e304bb88789c1b349263f3c)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:33:09.355938 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4edc8b-c47a-4580-8b73-f8b72a65e6db admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:33:09.369532 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1184/2353] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:33:09 2022] PUT /identity/v3/projects/76af978b0c734973bda74e61071bd10d/users/9fab34832df84d2ea35e63df7c7c8142/roles/274130b78e304bb88789c1b349263f3c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:33:09.373767 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18978007-9221-4939-b692-fa0dea6b2bd0 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:33:09.384365 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18978007-9221-4939-b692-fa0dea6b2bd0 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:33:09.442904 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4d6a20-d7c1-4ff1-9d85-4d7643bcde47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:33:09.443699 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d6a20-d7c1-4ff1-9d85-4d7643bcde47 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:33:09.443979 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d6a20-d7c1-4ff1-9d85-4d7643bcde47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:33:09.444249 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d6a20-d7c1-4ff1-9d85-4d7643bcde47 admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:33:09.444970 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4d6a20-d7c1-4ff1-9d85-4d7643bcde47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:33:09.446579 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4d6a20-d7c1-4ff1-9d85-4d7643bcde47 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:33:09.457318 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1170/2354] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:33:09 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:33:09.461634 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4edc8b-c47a-4580-8b73-f8b72a65e6db admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:33:09.473233 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4edc8b-c47a-4580-8b73-f8b72a65e6db admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:33:09.478558 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ee1e12-85a1-47d3-8b16-a46e86a75a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:33:09.479554 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee1e12-85a1-47d3-8b16-a46e86a75a27 admin admin] REQUEST_METHOD: `PUT` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:33:09.479855 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee1e12-85a1-47d3-8b16-a46e86a75a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:33:09.480112 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee1e12-85a1-47d3-8b16-a46e86a75a27 admin admin] PATH_INFO: `/v3/projects/76af978b0c734973bda74e61071bd10d/users/9fab34832df84d2ea35e63df7c7c8142/roles/274130b78e304bb88789c1b349263f3c` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:33:09.482035 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ee1e12-85a1-47d3-8b16-a46e86a75a27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76af978b0c734973bda74e61071bd10d, user_id=9fab34832df84d2ea35e63df7c7c8142, role_id=274130b78e304bb88789c1b349263f3c)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:33:09.484994 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ee1e12-85a1-47d3-8b16-a46e86a75a27 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:33:09.498536 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1185/2355] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:33:09 2022] PUT /identity/v3/projects/76af978b0c734973bda74e61071bd10d/users/9fab34832df84d2ea35e63df7c7c8142/roles/274130b78e304bb88789c1b349263f3c => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:33:09.564293 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2036c0-1b50-42db-a150-fe01070d3d4f None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:33:09.565171 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2036c0-1b50-42db-a150-fe01070d3d4f None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:33:09.565591 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2036c0-1b50-42db-a150-fe01070d3d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:33:09.596740 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-2a2036c0-1b50-42db-a150-fe01070d3d4f None None] MFA Rules not processed for user `9fab34832df84d2ea35e63df7c7c8142`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:33:09.597934 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-2a2036c0-1b50-42db-a150-fe01070d3d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:33:09.668658 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1171/2356] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:33:09 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:33:09.679988 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ee1e12-85a1-47d3-8b16-a46e86a75a27 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:33:09.681792 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-48ee1e12-85a1-47d3-8b16-a46e86a75a27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:33:09.745776 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ee1e12-85a1-47d3-8b16-a46e86a75a27 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:33:09.749938 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e34ad37-84db-4a76-8df8-184c67b39744 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d65e731386d44948dcc1ecd40cbda65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:33:09.750584 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e34ad37-84db-4a76-8df8-184c67b39744 service cinder] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:33:09.750871 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e34ad37-84db-4a76-8df8-184c67b39744 service cinder] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:33:09.751141 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e34ad37-84db-4a76-8df8-184c67b39744 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:33:09.823779 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e34ad37-84db-4a76-8df8-184c67b39744 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:33:09.826273 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e34ad37-84db-4a76-8df8-184c67b39744 service cinder] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:33:09.838660 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1186/2357] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:33:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:33:12.390703 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2036c0-1b50-42db-a150-fe01070d3d4f None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:33:12.461949 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2036c0-1b50-42db-a150-fe01070d3d4f None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:33:12.467042 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dc2bc1-6400-4876-920a-486e4fbd2515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:33:12.469124 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc2bc1-6400-4876-920a-486e4fbd2515 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:33:12.469652 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc2bc1-6400-4876-920a-486e4fbd2515 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:33:12.470108 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc2bc1-6400-4876-920a-486e4fbd2515 admin admin] PATH_INFO: `/v3/users/5e7a16481a934d9182997139768aed21` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:33:12.472174 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dc2bc1-6400-4876-920a-486e4fbd2515 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e7a16481a934d9182997139768aed21)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:33:12.475025 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dc2bc1-6400-4876-920a-486e4fbd2515 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:33:12.531085 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-00dc2bc1-6400-4876-920a-486e4fbd2515 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e7a16481a934d9182997139768aed21'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:33:12.538482 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-00dc2bc1-6400-4876-920a-486e4fbd2515 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e7a16481a934d9182997139768aed21'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:33:12.546616 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-00dc2bc1-6400-4876-920a-486e4fbd2515 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e7a16481a934d9182997139768aed21'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:33:12.547380 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-00dc2bc1-6400-4876-920a-486e4fbd2515 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e7a16481a934d9182997139768aed21'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:33:12.548151 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-00dc2bc1-6400-4876-920a-486e4fbd2515 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e7a16481a934d9182997139768aed21'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:33:12.578630 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1172/2358] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:33:12 2022] DELETE /identity/v3/users/5e7a16481a934d9182997139768aed21 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:33:12.583545 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b884e3af-0e7f-474e-b335-844b0f80b14d None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:33:12.583545 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b884e3af-0e7f-474e-b335-844b0f80b14d None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:33:12.583545 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b884e3af-0e7f-474e-b335-844b0f80b14d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:33:12.605444 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-b884e3af-0e7f-474e-b335-844b0f80b14d None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:33:12.606813 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-b884e3af-0e7f-474e-b335-844b0f80b14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:33:12.676575 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1187/2359] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:33:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:33:12.686108 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dc2bc1-6400-4876-920a-486e4fbd2515 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:33:12.688265 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-00dc2bc1-6400-4876-920a-486e4fbd2515 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:33:12.753810 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dc2bc1-6400-4876-920a-486e4fbd2515 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:33:12.757336 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c12782f-45a4-4266-af2b-1982fb6a87ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:33:12.757972 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c12782f-45a4-4266-af2b-1982fb6a87ff service neutron] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:33:12.758248 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c12782f-45a4-4266-af2b-1982fb6a87ff service neutron] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:33:12.758515 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c12782f-45a4-4266-af2b-1982fb6a87ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:33:12.767734 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c12782f-45a4-4266-af2b-1982fb6a87ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:33:12.769131 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c12782f-45a4-4266-af2b-1982fb6a87ff service neutron] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:33:12.778490 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1173/2360] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:33:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:33:13.045445 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b884e3af-0e7f-474e-b335-844b0f80b14d None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:33:13.047731 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-b884e3af-0e7f-474e-b335-844b0f80b14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:33:13.059282 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b884e3af-0e7f-474e-b335-844b0f80b14d None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:33:13.064135 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3391bd77-50ca-4d72-ba28-82eee9a783a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:33:13.064977 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391bd77-50ca-4d72-ba28-82eee9a783a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:33:13.065253 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391bd77-50ca-4d72-ba28-82eee9a783a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:33:13.065520 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391bd77-50ca-4d72-ba28-82eee9a783a8 admin admin] PATH_INFO: `/v3/projects/999e834c2390469e901ca837b714d3f5` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:33:13.066756 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3391bd77-50ca-4d72-ba28-82eee9a783a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=999e834c2390469e901ca837b714d3f5)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:33:13.068773 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3391bd77-50ca-4d72-ba28-82eee9a783a8 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:33:13.116933 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-3391bd77-50ca-4d72-ba28-82eee9a783a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '999e834c2390469e901ca837b714d3f5', 'request_id': 'req-3391bd77-50ca-4d72-ba28-82eee9a783a8'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:33:13.124675 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-3391bd77-50ca-4d72-ba28-82eee9a783a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '999e834c2390469e901ca837b714d3f5', 'request_id': 'req-3391bd77-50ca-4d72-ba28-82eee9a783a8'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:33:13.130809 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-3391bd77-50ca-4d72-ba28-82eee9a783a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '999e834c2390469e901ca837b714d3f5', 'request_id': 'req-3391bd77-50ca-4d72-ba28-82eee9a783a8'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:33:13.144381 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-3391bd77-50ca-4d72-ba28-82eee9a783a8 admin admin] The token cache is being invalidate because project 999e834c2390469e901ca837b714d3f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:33:13.144652 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-3391bd77-50ca-4d72-ba28-82eee9a783a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:33:13.145321 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-3391bd77-50ca-4d72-ba28-82eee9a783a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:33:13.147019 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1188/2361] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:33:13 2022] DELETE /identity/v3/projects/999e834c2390469e901ca837b714d3f5 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:33:13.151363 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c12782f-45a4-4266-af2b-1982fb6a87ff service neutron] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:33:13.162376 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c12782f-45a4-4266-af2b-1982fb6a87ff service neutron] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:33:13.221842 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5079ec2a-afe0-49f7-a28d-048e2bbf1cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:33:13.222708 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079ec2a-afe0-49f7-a28d-048e2bbf1cd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:33:13.223013 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079ec2a-afe0-49f7-a28d-048e2bbf1cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:33:13.223280 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079ec2a-afe0-49f7-a28d-048e2bbf1cd9 admin admin] PATH_INFO: `/v3/users/9fab34832df84d2ea35e63df7c7c8142` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:33:13.224552 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5079ec2a-afe0-49f7-a28d-048e2bbf1cd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fab34832df84d2ea35e63df7c7c8142)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:33:13.226517 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5079ec2a-afe0-49f7-a28d-048e2bbf1cd9 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:33:13.275195 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-5079ec2a-afe0-49f7-a28d-048e2bbf1cd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fab34832df84d2ea35e63df7c7c8142'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:33:13.282030 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-5079ec2a-afe0-49f7-a28d-048e2bbf1cd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fab34832df84d2ea35e63df7c7c8142'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:33:13.289485 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-5079ec2a-afe0-49f7-a28d-048e2bbf1cd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fab34832df84d2ea35e63df7c7c8142'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:33:13.290048 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-5079ec2a-afe0-49f7-a28d-048e2bbf1cd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fab34832df84d2ea35e63df7c7c8142'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:33:13.290688 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-5079ec2a-afe0-49f7-a28d-048e2bbf1cd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fab34832df84d2ea35e63df7c7c8142'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:33:13.307048 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1174/2362] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:33:13 2022] DELETE /identity/v3/users/9fab34832df84d2ea35e63df7c7c8142 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:33:13.622140 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3391bd77-50ca-4d72-ba28-82eee9a783a8 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:33:13.623865 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-3391bd77-50ca-4d72-ba28-82eee9a783a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:33:13.637234 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3391bd77-50ca-4d72-ba28-82eee9a783a8 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:33:13.694722 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2e7b3b-5330-4d04-b7a3-74dec018b828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:33:13.695613 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2e7b3b-5330-4d04-b7a3-74dec018b828 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:33:13.695900 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2e7b3b-5330-4d04-b7a3-74dec018b828 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:33:13.696177 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2e7b3b-5330-4d04-b7a3-74dec018b828 admin admin] PATH_INFO: `/v3/projects/76af978b0c734973bda74e61071bd10d` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:33:13.697357 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2e7b3b-5330-4d04-b7a3-74dec018b828 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76af978b0c734973bda74e61071bd10d)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:33:13.699283 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2e7b3b-5330-4d04-b7a3-74dec018b828 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:33:13.744959 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-aa2e7b3b-5330-4d04-b7a3-74dec018b828 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76af978b0c734973bda74e61071bd10d', 'request_id': 'req-aa2e7b3b-5330-4d04-b7a3-74dec018b828'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:33:13.751570 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-aa2e7b3b-5330-4d04-b7a3-74dec018b828 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76af978b0c734973bda74e61071bd10d', 'request_id': 'req-aa2e7b3b-5330-4d04-b7a3-74dec018b828'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:33:13.756877 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-aa2e7b3b-5330-4d04-b7a3-74dec018b828 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76af978b0c734973bda74e61071bd10d', 'request_id': 'req-aa2e7b3b-5330-4d04-b7a3-74dec018b828'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:33:13.770571 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-aa2e7b3b-5330-4d04-b7a3-74dec018b828 admin admin] The token cache is being invalidate because project 76af978b0c734973bda74e61071bd10d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:33:13.770880 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-aa2e7b3b-5330-4d04-b7a3-74dec018b828 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:33:13.771511 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-aa2e7b3b-5330-4d04-b7a3-74dec018b828 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:33:13.773091 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1189/2363] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:33:13 2022] DELETE /identity/v3/projects/76af978b0c734973bda74e61071bd10d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:33:13.777943 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8ee911-bdfd-491b-97e3-db2487fe22fc None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:33:13.778439 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8ee911-bdfd-491b-97e3-db2487fe22fc None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:33:13.778541 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8ee911-bdfd-491b-97e3-db2487fe22fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:33:13.796579 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-5e8ee911-bdfd-491b-97e3-db2487fe22fc None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:33:13.797922 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-5e8ee911-bdfd-491b-97e3-db2487fe22fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:33:13.856180 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1175/2364] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:33:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:33:13.863647 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d477d23-18d2-423d-b462-71a1f01ebdcc None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:33:13.863936 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d477d23-18d2-423d-b462-71a1f01ebdcc None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:33:13.864209 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d477d23-18d2-423d-b462-71a1f01ebdcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:33:13.882278 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-9d477d23-18d2-423d-b462-71a1f01ebdcc None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:33:13.883506 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-9d477d23-18d2-423d-b462-71a1f01ebdcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:33:13.892208 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1190/2365] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:33:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:33:13.896425 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8ee911-bdfd-491b-97e3-db2487fe22fc None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:33:13.906307 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8ee911-bdfd-491b-97e3-db2487fe22fc None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:33:13.910880 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a8e970-2b21-43ef-b39b-c916e3300840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:33:13.911564 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a8e970-2b21-43ef-b39b-c916e3300840 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:33:13.911851 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a8e970-2b21-43ef-b39b-c916e3300840 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:33:13.912123 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a8e970-2b21-43ef-b39b-c916e3300840 admin admin] PATH_INFO: `/v3/domains` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:33:13.912849 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a8e970-2b21-43ef-b39b-c916e3300840 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:33:13.913152 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a8e970-2b21-43ef-b39b-c916e3300840 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:33:13.914745 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a8e970-2b21-43ef-b39b-c916e3300840 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:33:13.926047 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1176/2366] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 9 20:33:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:33:13.930305 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d477d23-18d2-423d-b462-71a1f01ebdcc None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:33:13.940282 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d477d23-18d2-423d-b462-71a1f01ebdcc None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:33:13.944906 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f745c43d-dd33-4558-81dc-ab166d2ffc72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:33:13.945542 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f745c43d-dd33-4558-81dc-ab166d2ffc72 admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:33:13.945821 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f745c43d-dd33-4558-81dc-ab166d2ffc72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:33:13.946099 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f745c43d-dd33-4558-81dc-ab166d2ffc72 admin admin] PATH_INFO: `/v3/projects` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:33:13.946791 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f745c43d-dd33-4558-81dc-ab166d2ffc72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:33:13.948705 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f745c43d-dd33-4558-81dc-ab166d2ffc72 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:33:13.974547 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1191/2367] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:33:13 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 20:33:13.978512 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a8e970-2b21-43ef-b39b-c916e3300840 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:33:13.988492 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a8e970-2b21-43ef-b39b-c916e3300840 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:33:14.042142 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d23d9e-eff2-4676-b120-c4162a7a80c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:33:14.042798 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d23d9e-eff2-4676-b120-c4162a7a80c4 admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:33:14.043072 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d23d9e-eff2-4676-b120-c4162a7a80c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:33:14.043339 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d23d9e-eff2-4676-b120-c4162a7a80c4 admin admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:33:14.044054 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d23d9e-eff2-4676-b120-c4162a7a80c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:33:14.045994 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d23d9e-eff2-4676-b120-c4162a7a80c4 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:33:14.066383 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1177/2368] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:33:13 2022] POST /identity/v3/users => generated 288 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:33:14.069849 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f745c43d-dd33-4558-81dc-ab166d2ffc72 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:33:14.080585 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f745c43d-dd33-4558-81dc-ab166d2ffc72 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:33:14.085190 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00141bee-b1fa-401b-abbd-f86a038b91e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:33:14.085836 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00141bee-b1fa-401b-abbd-f86a038b91e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:33:14.086117 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00141bee-b1fa-401b-abbd-f86a038b91e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:33:14.086415 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00141bee-b1fa-401b-abbd-f86a038b91e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:33:14.087133 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00141bee-b1fa-401b-abbd-f86a038b91e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:33:14.088775 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00141bee-b1fa-401b-abbd-f86a038b91e8 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:33:14.099156 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1192/2369] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:33:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:33:14.105465 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d23d9e-eff2-4676-b120-c4162a7a80c4 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:33:14.117540 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d23d9e-eff2-4676-b120-c4162a7a80c4 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:33:14.122185 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa2f74-bb2a-49f5-996e-0eed84e74871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:33:14.122831 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa2f74-bb2a-49f5-996e-0eed84e74871 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:33:14.123110 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa2f74-bb2a-49f5-996e-0eed84e74871 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:33:14.123382 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa2f74-bb2a-49f5-996e-0eed84e74871 admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:33:14.124938 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfa2f74-bb2a-49f5-996e-0eed84e74871 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:33:14.126529 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfa2f74-bb2a-49f5-996e-0eed84e74871 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:33:14.139520 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1178/2370] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:33:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:33:14.143093 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00141bee-b1fa-401b-abbd-f86a038b91e8 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:33:14.153262 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00141bee-b1fa-401b-abbd-f86a038b91e8 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:33:14.158092 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05565f1-09c6-46ea-94bf-7f0d5632fc83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:33:14.158958 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05565f1-09c6-46ea-94bf-7f0d5632fc83 admin admin] REQUEST_METHOD: `PUT` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:33:14.159238 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05565f1-09c6-46ea-94bf-7f0d5632fc83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:33:14.159552 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05565f1-09c6-46ea-94bf-7f0d5632fc83 admin admin] PATH_INFO: `/v3/projects/185be95c368b4e4db244d8d528ab17b1/users/978c4f44edc1438d938c226bc2f072ed/roles/79f90a0bf6ea43d0b3c434e31556253a` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:33:14.175320 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05565f1-09c6-46ea-94bf-7f0d5632fc83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=185be95c368b4e4db244d8d528ab17b1, user_id=978c4f44edc1438d938c226bc2f072ed, role_id=79f90a0bf6ea43d0b3c434e31556253a)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:33:14.178050 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05565f1-09c6-46ea-94bf-7f0d5632fc83 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:33:14.191771 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1193/2371] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:33:14 2022] PUT /identity/v3/projects/185be95c368b4e4db244d8d528ab17b1/users/978c4f44edc1438d938c226bc2f072ed/roles/79f90a0bf6ea43d0b3c434e31556253a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:33:14.201779 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efbd9d2-75f1-4f9d-b2de-7cd7bcbfb309 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:33:14.202759 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efbd9d2-75f1-4f9d-b2de-7cd7bcbfb309 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:33:14.203031 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efbd9d2-75f1-4f9d-b2de-7cd7bcbfb309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:33:14.229394 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-5efbd9d2-75f1-4f9d-b2de-7cd7bcbfb309 None None] MFA Rules not processed for user `978c4f44edc1438d938c226bc2f072ed`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:33:14.230582 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-5efbd9d2-75f1-4f9d-b2de-7cd7bcbfb309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:33:14.290340 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1179/2372] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:33:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:33:14.300680 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05565f1-09c6-46ea-94bf-7f0d5632fc83 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:33:14.302442 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-d05565f1-09c6-46ea-94bf-7f0d5632fc83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:33:14.356780 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05565f1-09c6-46ea-94bf-7f0d5632fc83 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:33:14.360383 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab19b24-3830-417a-b098-4b8ff2547152 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d65e731386d44948dcc1ecd40cbda65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:33:14.361011 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab19b24-3830-417a-b098-4b8ff2547152 service cinder] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:33:14.361290 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab19b24-3830-417a-b098-4b8ff2547152 service cinder] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:33:14.361562 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab19b24-3830-417a-b098-4b8ff2547152 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:33:14.369861 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab19b24-3830-417a-b098-4b8ff2547152 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:33:14.371273 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab19b24-3830-417a-b098-4b8ff2547152 service cinder] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:33:14.380034 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1194/2373] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:33:14 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:33:17.513491 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efbd9d2-75f1-4f9d-b2de-7cd7bcbfb309 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:33:17.572708 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efbd9d2-75f1-4f9d-b2de-7cd7bcbfb309 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:33:17.577345 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ac92e0-5446-421a-84ad-25492a772b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:33:17.578196 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac92e0-5446-421a-84ad-25492a772b99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:33:17.578473 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac92e0-5446-421a-84ad-25492a772b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:33:17.578744 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac92e0-5446-421a-84ad-25492a772b99 admin admin] PATH_INFO: `/v3/users/978c4f44edc1438d938c226bc2f072ed` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:33:17.579963 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ac92e0-5446-421a-84ad-25492a772b99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=978c4f44edc1438d938c226bc2f072ed)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:33:17.581891 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ac92e0-5446-421a-84ad-25492a772b99 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:33:17.626378 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-f6ac92e0-5446-421a-84ad-25492a772b99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '978c4f44edc1438d938c226bc2f072ed'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:33:17.632897 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-f6ac92e0-5446-421a-84ad-25492a772b99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '978c4f44edc1438d938c226bc2f072ed'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:33:17.639387 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-f6ac92e0-5446-421a-84ad-25492a772b99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '978c4f44edc1438d938c226bc2f072ed'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:33:17.640252 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-f6ac92e0-5446-421a-84ad-25492a772b99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '978c4f44edc1438d938c226bc2f072ed'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:33:17.640852 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-f6ac92e0-5446-421a-84ad-25492a772b99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '978c4f44edc1438d938c226bc2f072ed'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:33:17.657515 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1180/2374] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:33:17 2022] DELETE /identity/v3/users/978c4f44edc1438d938c226bc2f072ed => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:33:17.662091 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8592ce90-c08f-4c39-985a-2affca37e738 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:33:17.662577 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8592ce90-c08f-4c39-985a-2affca37e738 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:33:17.662675 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8592ce90-c08f-4c39-985a-2affca37e738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:33:17.680088 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-8592ce90-c08f-4c39-985a-2affca37e738 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:33:17.681272 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-8592ce90-c08f-4c39-985a-2affca37e738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:33:17.737662 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1195/2375] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:33:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:33:17.747930 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ac92e0-5446-421a-84ad-25492a772b99 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:33:17.749308 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-f6ac92e0-5446-421a-84ad-25492a772b99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:33:17.803703 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ac92e0-5446-421a-84ad-25492a772b99 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:33:17.807282 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5fffa1-f231-4eda-836e-5b4282bdb26a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:33:17.807936 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5fffa1-f231-4eda-836e-5b4282bdb26a service neutron] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:33:17.808219 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5fffa1-f231-4eda-836e-5b4282bdb26a service neutron] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:33:17.808484 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5fffa1-f231-4eda-836e-5b4282bdb26a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:33:17.817224 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5fffa1-f231-4eda-836e-5b4282bdb26a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:33:17.818642 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5fffa1-f231-4eda-836e-5b4282bdb26a service neutron] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:33:17.827726 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1181/2376] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:33:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:33:18.086501 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8592ce90-c08f-4c39-985a-2affca37e738 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:33:18.087989 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-8592ce90-c08f-4c39-985a-2affca37e738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:33:18.099644 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8592ce90-c08f-4c39-985a-2affca37e738 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:33:18.105823 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa6ffc5-7909-418e-8b32-0d312844e790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:33:18.106681 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa6ffc5-7909-418e-8b32-0d312844e790 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:33:18.106959 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa6ffc5-7909-418e-8b32-0d312844e790 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:33:18.107232 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa6ffc5-7909-418e-8b32-0d312844e790 admin admin] PATH_INFO: `/v3/projects/185be95c368b4e4db244d8d528ab17b1` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:33:18.108972 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa6ffc5-7909-418e-8b32-0d312844e790 admin admin] RBAC: Authorizing `identity:delete_project(project_id=185be95c368b4e4db244d8d528ab17b1)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:33:18.110917 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa6ffc5-7909-418e-8b32-0d312844e790 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:33:18.162459 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-2fa6ffc5-7909-418e-8b32-0d312844e790 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '185be95c368b4e4db244d8d528ab17b1', 'request_id': 'req-2fa6ffc5-7909-418e-8b32-0d312844e790'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:33:18.168560 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-2fa6ffc5-7909-418e-8b32-0d312844e790 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '185be95c368b4e4db244d8d528ab17b1', 'request_id': 'req-2fa6ffc5-7909-418e-8b32-0d312844e790'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:33:18.175045 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-2fa6ffc5-7909-418e-8b32-0d312844e790 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '185be95c368b4e4db244d8d528ab17b1', 'request_id': 'req-2fa6ffc5-7909-418e-8b32-0d312844e790'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:33:18.188645 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-2fa6ffc5-7909-418e-8b32-0d312844e790 admin admin] The token cache is being invalidate because project 185be95c368b4e4db244d8d528ab17b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:33:18.188935 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-2fa6ffc5-7909-418e-8b32-0d312844e790 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:33:18.189559 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-2fa6ffc5-7909-418e-8b32-0d312844e790 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:33:18.191117 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1196/2377] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:33:18 2022] DELETE /identity/v3/projects/185be95c368b4e4db244d8d528ab17b1 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:33:18.196046 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a68de04-d957-48e1-81a2-43e935e38275 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:33:18.196350 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a68de04-d957-48e1-81a2-43e935e38275 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:33:18.196621 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a68de04-d957-48e1-81a2-43e935e38275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:33:18.213877 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-1a68de04-d957-48e1-81a2-43e935e38275 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:33:18.215066 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-1a68de04-d957-48e1-81a2-43e935e38275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:33:18.274129 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1182/2378] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:33:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:33:18.282169 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d471ad6e-1e53-4365-9849-8bbcf9e5de97 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:33:18.282448 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d471ad6e-1e53-4365-9849-8bbcf9e5de97 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:33:18.282719 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d471ad6e-1e53-4365-9849-8bbcf9e5de97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:33:18.301141 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-d471ad6e-1e53-4365-9849-8bbcf9e5de97 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:33:18.302346 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-d471ad6e-1e53-4365-9849-8bbcf9e5de97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:33:18.310127 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1197/2379] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:33:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:33:18.314537 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a68de04-d957-48e1-81a2-43e935e38275 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:33:18.324017 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a68de04-d957-48e1-81a2-43e935e38275 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:33:18.328569 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b32a5be-7e2c-4902-96c2-b3df2e5e0340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:33:18.329202 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b32a5be-7e2c-4902-96c2-b3df2e5e0340 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:33:18.329475 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b32a5be-7e2c-4902-96c2-b3df2e5e0340 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:33:18.329766 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b32a5be-7e2c-4902-96c2-b3df2e5e0340 admin admin] PATH_INFO: `/v3/domains` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:33:18.330517 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b32a5be-7e2c-4902-96c2-b3df2e5e0340 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:33:18.330819 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b32a5be-7e2c-4902-96c2-b3df2e5e0340 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:33:18.332440 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b32a5be-7e2c-4902-96c2-b3df2e5e0340 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:33:18.345062 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1183/2380] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 9 20:33:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:33:18.349067 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d471ad6e-1e53-4365-9849-8bbcf9e5de97 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:33:18.359254 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d471ad6e-1e53-4365-9849-8bbcf9e5de97 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:33:18.364579 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacae423-cdf7-4660-aca9-3e712fd07dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:33:18.365264 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacae423-cdf7-4660-aca9-3e712fd07dec admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:33:18.365547 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacae423-cdf7-4660-aca9-3e712fd07dec admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:33:18.365818 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacae423-cdf7-4660-aca9-3e712fd07dec admin admin] PATH_INFO: `/v3/projects` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:33:18.366513 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacae423-cdf7-4660-aca9-3e712fd07dec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:33:18.368599 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacae423-cdf7-4660-aca9-3e712fd07dec admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:33:18.398983 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1198/2381] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:33:18 2022] POST /identity/v3/projects => generated 369 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:33:18.400296 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b32a5be-7e2c-4902-96c2-b3df2e5e0340 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:33:18.410799 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b32a5be-7e2c-4902-96c2-b3df2e5e0340 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:33:18.465188 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c85a5ad-12dc-4233-b4b1-030d8c0024b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:33:18.465848 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85a5ad-12dc-4233-b4b1-030d8c0024b2 admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:33:18.466120 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85a5ad-12dc-4233-b4b1-030d8c0024b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:33:18.466391 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85a5ad-12dc-4233-b4b1-030d8c0024b2 admin admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:33:18.467069 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c85a5ad-12dc-4233-b4b1-030d8c0024b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:33:18.469501 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c85a5ad-12dc-4233-b4b1-030d8c0024b2 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:33:18.490267 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1184/2382] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:33:18 2022] POST /identity/v3/users => generated 285 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:33:18.496675 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacae423-cdf7-4660-aca9-3e712fd07dec admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:33:18.506893 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacae423-cdf7-4660-aca9-3e712fd07dec admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:33:18.511768 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d4f87b-eeae-463e-a72d-f2b77c78d08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:33:18.512405 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d4f87b-eeae-463e-a72d-f2b77c78d08e admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:33:18.512691 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d4f87b-eeae-463e-a72d-f2b77c78d08e admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:33:18.512962 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d4f87b-eeae-463e-a72d-f2b77c78d08e admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:33:18.513674 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d4f87b-eeae-463e-a72d-f2b77c78d08e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:33:18.515306 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d4f87b-eeae-463e-a72d-f2b77c78d08e admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:33:18.525593 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1199/2383] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:33:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:33:18.529285 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c85a5ad-12dc-4233-b4b1-030d8c0024b2 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:33:18.539628 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c85a5ad-12dc-4233-b4b1-030d8c0024b2 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:33:18.544158 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d6b985-8485-4357-a0e1-9ac367c013d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:33:18.544788 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6b985-8485-4357-a0e1-9ac367c013d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:33:18.545063 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6b985-8485-4357-a0e1-9ac367c013d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:33:18.545327 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6b985-8485-4357-a0e1-9ac367c013d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:33:18.546746 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d6b985-8485-4357-a0e1-9ac367c013d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:33:18.548356 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d6b985-8485-4357-a0e1-9ac367c013d2 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:33:18.558242 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1185/2384] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:33:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:33:18.562332 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d4f87b-eeae-463e-a72d-f2b77c78d08e admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:33:18.572167 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d4f87b-eeae-463e-a72d-f2b77c78d08e admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:33:18.576875 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4516a1f-0069-4144-a430-baf9aedee20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:33:18.577742 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4516a1f-0069-4144-a430-baf9aedee20c admin admin] REQUEST_METHOD: `PUT` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:33:18.578018 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4516a1f-0069-4144-a430-baf9aedee20c admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:33:18.578287 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4516a1f-0069-4144-a430-baf9aedee20c admin admin] PATH_INFO: `/v3/projects/6cb3f86664bf42b5a26dabed328f6eae/users/41c6cd4289b542aaa6919acc0644d233/roles/79f90a0bf6ea43d0b3c434e31556253a` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:33:18.593281 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4516a1f-0069-4144-a430-baf9aedee20c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cb3f86664bf42b5a26dabed328f6eae, user_id=41c6cd4289b542aaa6919acc0644d233, role_id=79f90a0bf6ea43d0b3c434e31556253a)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:33:18.595959 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4516a1f-0069-4144-a430-baf9aedee20c admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:33:18.608818 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1200/2385] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:33:18 2022] PUT /identity/v3/projects/6cb3f86664bf42b5a26dabed328f6eae/users/41c6cd4289b542aaa6919acc0644d233/roles/79f90a0bf6ea43d0b3c434e31556253a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:33:18.613946 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624962e-66f8-4885-9ee1-51a97417db74 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:33:18.614231 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624962e-66f8-4885-9ee1-51a97417db74 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:33:18.614503 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624962e-66f8-4885-9ee1-51a97417db74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:33:18.631718 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-8624962e-66f8-4885-9ee1-51a97417db74 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:33:18.632905 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-8624962e-66f8-4885-9ee1-51a97417db74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:33:18.694741 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1186/2386] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:33:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:33:18.705272 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4516a1f-0069-4144-a430-baf9aedee20c admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:33:18.707005 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-f4516a1f-0069-4144-a430-baf9aedee20c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:33:18.760877 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4516a1f-0069-4144-a430-baf9aedee20c admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:33:18.765357 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb350c-6394-41e7-aaae-506fdfd17888 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:33:18.765774 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb350c-6394-41e7-aaae-506fdfd17888 service neutron] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:33:18.766052 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb350c-6394-41e7-aaae-506fdfd17888 service neutron] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:33:18.766323 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb350c-6394-41e7-aaae-506fdfd17888 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:33:18.775246 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbb350c-6394-41e7-aaae-506fdfd17888 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:33:18.776763 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbb350c-6394-41e7-aaae-506fdfd17888 service neutron] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:33:18.786720 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1201/2387] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:33:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:33:19.427651 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d623b-e5aa-43a1-8292-7730c512872a None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:33:19.428052 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d623b-e5aa-43a1-8292-7730c512872a None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:33:19.428461 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d623b-e5aa-43a1-8292-7730c512872a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:33:19.461004 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-a02d623b-e5aa-43a1-8292-7730c512872a None None] MFA Rules not processed for user `41c6cd4289b542aaa6919acc0644d233`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:33:19.462354 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-a02d623b-e5aa-43a1-8292-7730c512872a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:33:19.532904 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1187/2388] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:33:19 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:33:19.544086 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb350c-6394-41e7-aaae-506fdfd17888 service neutron] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:33:19.545827 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-8dbb350c-6394-41e7-aaae-506fdfd17888 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:33:19.611451 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb350c-6394-41e7-aaae-506fdfd17888 service neutron] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:33:19.615181 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bf3ec1-9db8-4a93-8b0e-4496b81baabd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d65e731386d44948dcc1ecd40cbda65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:33:19.616027 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf3ec1-9db8-4a93-8b0e-4496b81baabd service cinder] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:33:19.616377 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf3ec1-9db8-4a93-8b0e-4496b81baabd service cinder] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:33:19.616716 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf3ec1-9db8-4a93-8b0e-4496b81baabd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:33:19.625563 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bf3ec1-9db8-4a93-8b0e-4496b81baabd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:33:19.627352 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bf3ec1-9db8-4a93-8b0e-4496b81baabd service cinder] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:33:19.636587 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1202/2389] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:33:19 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:33:20.967189 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196302a4-7a33-415b-b6f8-e9994d811c58 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:33:20.967741 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196302a4-7a33-415b-b6f8-e9994d811c58 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:33:20.967840 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196302a4-7a33-415b-b6f8-e9994d811c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:33:20.987792 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-196302a4-7a33-415b-b6f8-e9994d811c58 None None] MFA Rules not processed for user `41c6cd4289b542aaa6919acc0644d233`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:33:20.988985 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-196302a4-7a33-415b-b6f8-e9994d811c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:33:20.995850 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1188/2390] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:33:20 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:33:29.467441 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a78c7a-32c2-4729-84e6-4fb2673d9ba9 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:33:29.468715 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a78c7a-32c2-4729-84e6-4fb2673d9ba9 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:33:29.468715 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a78c7a-32c2-4729-84e6-4fb2673d9ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:33:29.486411 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-69a78c7a-32c2-4729-84e6-4fb2673d9ba9 None None] MFA Rules not processed for user `0227b2954e61426388214e96e1741eb2`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:33:29.487863 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-69a78c7a-32c2-4729-84e6-4fb2673d9ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:33:29.544482 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1203/2391] 10.222.0.44 () {58 vars in 1009 bytes} [Mon May 9 20:33:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:33:29.592367 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196302a4-7a33-415b-b6f8-e9994d811c58 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:33:29.594689 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-196302a4-7a33-415b-b6f8-e9994d811c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:33:29.665258 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196302a4-7a33-415b-b6f8-e9994d811c58 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:33:29.670209 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f35bf6-c106-4d04-a0d2-744b33930f3f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965089f1a92f49bd883b337d6042c69f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:33:29.670888 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f35bf6-c106-4d04-a0d2-744b33930f3f service swift] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:33:29.671381 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f35bf6-c106-4d04-a0d2-744b33930f3f service swift] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:33:29.671769 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f35bf6-c106-4d04-a0d2-744b33930f3f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:33:29.680220 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f35bf6-c106-4d04-a0d2-744b33930f3f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:33:29.681815 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f35bf6-c106-4d04-a0d2-744b33930f3f service swift] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:33:29.691042 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1189/2392] 10.222.0.44 () {60 vars in 1384 bytes} [Mon May 9 20:33:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 09 20:33:40.062527 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb50467b-7543-429c-abcd-e535716a292e None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:33:40.062968 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb50467b-7543-429c-abcd-e535716a292e None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:33:40.063083 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb50467b-7543-429c-abcd-e535716a292e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:33:40.080180 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-cb50467b-7543-429c-abcd-e535716a292e None None] MFA Rules not processed for user `41c6cd4289b542aaa6919acc0644d233`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:33:40.081360 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-cb50467b-7543-429c-abcd-e535716a292e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:33:40.088129 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1204/2393] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:33:40 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:33:44.532753 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa328401-dadf-476c-958e-508d8ab18291 None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:33:44.533249 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa328401-dadf-476c-958e-508d8ab18291 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:33:44.533381 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa328401-dadf-476c-958e-508d8ab18291 None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:33:44.534647 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1190/2394] 10.222.0.44 () {54 vars in 921 bytes} [Mon May 9 20:33:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:33:44.540825 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3377c3-468f-4f8d-8e19-c5949d5177ce None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:33:44.541314 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3377c3-468f-4f8d-8e19-c5949d5177ce None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:33:44.541431 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3377c3-468f-4f8d-8e19-c5949d5177ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:33:44.559897 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-0f3377c3-468f-4f8d-8e19-c5949d5177ce None None] MFA Rules not processed for user `eb59440b21074d9da15679dc2d745f72`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:33:44.564872 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-0f3377c3-468f-4f8d-8e19-c5949d5177ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:33:44.640867 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1205/2395] 10.222.0.44 () {58 vars in 1018 bytes} [Mon May 9 20:33:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:33:44.653365 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa328401-dadf-476c-958e-508d8ab18291 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:33:44.655985 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-aa328401-dadf-476c-958e-508d8ab18291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:33:44.713750 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa328401-dadf-476c-958e-508d8ab18291 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:33:44.717599 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af2b971-8c09-4d30-ba7c-72472da5d938 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65db5d9a86fd48acb5874df0165c0ef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:33:44.718326 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2b971-8c09-4d30-ba7c-72472da5d938 service glance] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:33:44.718607 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2b971-8c09-4d30-ba7c-72472da5d938 service glance] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:33:44.718882 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2b971-8c09-4d30-ba7c-72472da5d938 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:33:44.729020 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af2b971-8c09-4d30-ba7c-72472da5d938 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:33:44.730447 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af2b971-8c09-4d30-ba7c-72472da5d938 service glance] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:33:44.741692 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1191/2396] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:33:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 09 20:33:44.809874 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b8b12-370e-49d7-857d-ce4a1d53b9dc None None] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:33:44.810072 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b8b12-370e-49d7-857d-ce4a1d53b9dc None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:33:44.810328 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b8b12-370e-49d7-857d-ce4a1d53b9dc None None] PATH_INFO: `/` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:33:44.812221 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1206/2397] 10.222.0.44 () {54 vars in 921 bytes} [Mon May 9 20:33:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:33:44.816982 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde8561-1d18-4466-b410-a8ad3d1d14b8 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:33:44.817263 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde8561-1d18-4466-b410-a8ad3d1d14b8 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:33:44.817532 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde8561-1d18-4466-b410-a8ad3d1d14b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:33:44.836952 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-1fde8561-1d18-4466-b410-a8ad3d1d14b8 None None] MFA Rules not processed for user `b2a13ad25f27471792ba0758602b6e63`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:33:44.838159 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-1fde8561-1d18-4466-b410-a8ad3d1d14b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:33:44.844874 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1192/2398] 10.222.0.44 () {58 vars in 1018 bytes} [Mon May 9 20:33:44 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:33:44.856887 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7b8b12-370e-49d7-857d-ce4a1d53b9dc None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:33:44.868392 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7b8b12-370e-49d7-857d-ce4a1d53b9dc None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:33:44.871846 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f3ee3f-5145-414a-9109-cbdcb5090a14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:33:44.872470 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3ee3f-5145-414a-9109-cbdcb5090a14 service neutron] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:33:44.872750 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3ee3f-5145-414a-9109-cbdcb5090a14 service neutron] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:33:44.873023 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3ee3f-5145-414a-9109-cbdcb5090a14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:33:44.880650 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f3ee3f-5145-414a-9109-cbdcb5090a14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:33:44.882061 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f3ee3f-5145-414a-9109-cbdcb5090a14 service neutron] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:33:44.889996 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1207/2399] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:33:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:33:44.975508 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240d983-5f92-43e7-a5b3-6558d134237d None None] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:33:44.975800 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240d983-5f92-43e7-a5b3-6558d134237d None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:33:44.976072 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240d983-5f92-43e7-a5b3-6558d134237d None None] PATH_INFO: `/` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:33:44.977427 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1193/2400] 10.222.0.44 () {54 vars in 921 bytes} [Mon May 9 20:33:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 20:33:44.982759 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a8fe7-9679-4309-87dc-b25536ddf9e6 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:33:44.983613 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a8fe7-9679-4309-87dc-b25536ddf9e6 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:33:44.983887 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a8fe7-9679-4309-87dc-b25536ddf9e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:33:45.002519 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-407a8fe7-9679-4309-87dc-b25536ddf9e6 None None] MFA Rules not processed for user `eb59440b21074d9da15679dc2d745f72`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:33:45.003735 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-407a8fe7-9679-4309-87dc-b25536ddf9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:33:45.012976 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1208/2401] 10.222.0.44 () {58 vars in 1018 bytes} [Mon May 9 20:33:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:33:45.023617 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2240d983-5f92-43e7-a5b3-6558d134237d None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:33:45.035361 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2240d983-5f92-43e7-a5b3-6558d134237d None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:33:45.039508 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59deea89-fc7b-4862-922c-f5d26325a3a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:33:45.040137 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59deea89-fc7b-4862-922c-f5d26325a3a0 service neutron] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:33:45.040411 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59deea89-fc7b-4862-922c-f5d26325a3a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:33:45.040679 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59deea89-fc7b-4862-922c-f5d26325a3a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:33:45.053296 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59deea89-fc7b-4862-922c-f5d26325a3a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:33:45.054909 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59deea89-fc7b-4862-922c-f5d26325a3a0 service neutron] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:33:45.067791 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1194/2402] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:33:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:33:48.407831 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df3443f-93f6-4dd8-813c-0810dab49e6d None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:33:48.408318 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df3443f-93f6-4dd8-813c-0810dab49e6d None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:33:48.408418 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df3443f-93f6-4dd8-813c-0810dab49e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:33:48.426523 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-2df3443f-93f6-4dd8-813c-0810dab49e6d None None] MFA Rules not processed for user `0227b2954e61426388214e96e1741eb2`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:33:48.427736 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-2df3443f-93f6-4dd8-813c-0810dab49e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:33:48.442133 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1209/2403] 10.222.0.44 () {58 vars in 1009 bytes} [Mon May 9 20:33:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:33:48.454259 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59deea89-fc7b-4862-922c-f5d26325a3a0 service neutron] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:33:48.465137 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59deea89-fc7b-4862-922c-f5d26325a3a0 service neutron] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:33:48.471800 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc090483-5c8b-4275-b7d0-84f7d87556f4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965089f1a92f49bd883b337d6042c69f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:33:48.472381 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc090483-5c8b-4275-b7d0-84f7d87556f4 service swift] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:33:48.472660 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc090483-5c8b-4275-b7d0-84f7d87556f4 service swift] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:33:48.472930 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc090483-5c8b-4275-b7d0-84f7d87556f4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:33:48.484909 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc090483-5c8b-4275-b7d0-84f7d87556f4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:33:48.487123 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc090483-5c8b-4275-b7d0-84f7d87556f4 service swift] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:33:48.496685 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1195/2404] 10.222.0.44 () {60 vars in 1384 bytes} [Mon May 9 20:33:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 09 20:34:09.828262 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b27ee1-228f-4ba0-9f9a-c5ee5b7c5f6e None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:34:09.828786 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b27ee1-228f-4ba0-9f9a-c5ee5b7c5f6e None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:34:09.828786 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b27ee1-228f-4ba0-9f9a-c5ee5b7c5f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:34:09.849171 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-35b27ee1-228f-4ba0-9f9a-c5ee5b7c5f6e None None] MFA Rules not processed for user `0227b2954e61426388214e96e1741eb2`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:34:09.850658 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-35b27ee1-228f-4ba0-9f9a-c5ee5b7c5f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:34:09.857942 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1210/2405] 10.222.0.44 () {58 vars in 967 bytes} [Mon May 9 20:34:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:34:09.870294 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc090483-5c8b-4275-b7d0-84f7d87556f4 service swift] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:34:09.881243 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc090483-5c8b-4275-b7d0-84f7d87556f4 service swift] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:34:09.886425 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3cf039-2333-42a5-b5c8-f5e8cfc232a5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965089f1a92f49bd883b337d6042c69f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:34:09.887054 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3cf039-2333-42a5-b5c8-f5e8cfc232a5 service swift] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:34:09.887489 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3cf039-2333-42a5-b5c8-f5e8cfc232a5 service swift] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:34:09.887767 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3cf039-2333-42a5-b5c8-f5e8cfc232a5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:34:09.896490 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3cf039-2333-42a5-b5c8-f5e8cfc232a5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:34:09.898061 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3cf039-2333-42a5-b5c8-f5e8cfc232a5 service swift] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:34:09.905897 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1196/2406] 10.222.0.44 () {60 vars in 1384 bytes} [Mon May 9 20:34:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 09 20:34:16.531950 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83045dbb-7f1e-4137-8778-20469c767798 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:34:16.532500 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83045dbb-7f1e-4137-8778-20469c767798 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:34:16.532500 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83045dbb-7f1e-4137-8778-20469c767798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:34:16.550292 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-83045dbb-7f1e-4137-8778-20469c767798 None None] MFA Rules not processed for user `0227b2954e61426388214e96e1741eb2`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:34:16.551579 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-83045dbb-7f1e-4137-8778-20469c767798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:34:16.558531 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1211/2407] 10.222.0.44 () {58 vars in 1009 bytes} [Mon May 9 20:34:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:34:16.571489 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3cf039-2333-42a5-b5c8-f5e8cfc232a5 service swift] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:34:16.584483 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3cf039-2333-42a5-b5c8-f5e8cfc232a5 service swift] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:34:16.589538 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c57b211-8372-4019-9725-238335bdeafe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965089f1a92f49bd883b337d6042c69f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:34:16.590164 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c57b211-8372-4019-9725-238335bdeafe service swift] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:34:16.590437 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c57b211-8372-4019-9725-238335bdeafe service swift] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:34:16.590701 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c57b211-8372-4019-9725-238335bdeafe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:34:16.598741 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c57b211-8372-4019-9725-238335bdeafe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:34:16.600334 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c57b211-8372-4019-9725-238335bdeafe service swift] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:34:16.608282 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1197/2408] 10.222.0.44 () {60 vars in 1384 bytes} [Mon May 9 20:34:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 09 20:34:30.895890 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83045dbb-7f1e-4137-8778-20469c767798 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:34:30.905083 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83045dbb-7f1e-4137-8778-20469c767798 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:34:30.908674 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02b1ad5-957e-4aba-afd5-3cfaaaf91a1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:34:30.909357 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b1ad5-957e-4aba-afd5-3cfaaaf91a1e service neutron] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:34:30.909630 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b1ad5-957e-4aba-afd5-3cfaaaf91a1e service neutron] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:34:30.909901 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b1ad5-957e-4aba-afd5-3cfaaaf91a1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:34:30.911735 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-e02b1ad5-957e-4aba-afd5-3cfaaaf91a1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:34:30.925651 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02b1ad5-957e-4aba-afd5-3cfaaaf91a1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:34:30.927065 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02b1ad5-957e-4aba-afd5-3cfaaaf91a1e service neutron] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:34:30.938016 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1212/2409] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:34:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:34:31.792929 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30fc7f-dea8-4a82-93b0-e74348251db7 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:34:31.793403 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30fc7f-dea8-4a82-93b0-e74348251db7 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:34:31.793547 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30fc7f-dea8-4a82-93b0-e74348251db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:34:31.811096 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-1e30fc7f-dea8-4a82-93b0-e74348251db7 None None] MFA Rules not processed for user `0227b2954e61426388214e96e1741eb2`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:34:31.812295 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-1e30fc7f-dea8-4a82-93b0-e74348251db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:34:31.819268 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1198/2410] 10.222.0.44 () {58 vars in 967 bytes} [Mon May 9 20:34:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:34:31.831331 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02b1ad5-957e-4aba-afd5-3cfaaaf91a1e service neutron] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:34:31.842638 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02b1ad5-957e-4aba-afd5-3cfaaaf91a1e service neutron] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:34:31.848261 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a8e4fe-6655-4551-a24f-eb9224374666 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965089f1a92f49bd883b337d6042c69f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:34:31.848898 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a8e4fe-6655-4551-a24f-eb9224374666 service swift] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:34:31.849183 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a8e4fe-6655-4551-a24f-eb9224374666 service swift] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:34:31.850376 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a8e4fe-6655-4551-a24f-eb9224374666 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:34:31.859691 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a8e4fe-6655-4551-a24f-eb9224374666 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:34:31.860898 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a8e4fe-6655-4551-a24f-eb9224374666 service swift] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:34:31.869912 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1213/2411] 10.222.0.44 () {60 vars in 1384 bytes} [Mon May 9 20:34:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 09 20:34:32.122900 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e30fc7f-dea8-4a82-93b0-e74348251db7 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:34:32.124833 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-1e30fc7f-dea8-4a82-93b0-e74348251db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:34:32.138726 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e30fc7f-dea8-4a82-93b0-e74348251db7 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:34:32.142718 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a43bc3-4459-4290-b53b-763bab98c52e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:34:32.143375 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a43bc3-4459-4290-b53b-763bab98c52e service neutron] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:34:32.144412 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a43bc3-4459-4290-b53b-763bab98c52e service neutron] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:34:32.144856 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a43bc3-4459-4290-b53b-763bab98c52e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:34:32.146652 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-35a43bc3-4459-4290-b53b-763bab98c52e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:34:32.164166 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a43bc3-4459-4290-b53b-763bab98c52e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:34:32.165849 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a43bc3-4459-4290-b53b-763bab98c52e service neutron] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:34:32.178792 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1199/2412] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:34:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:34:33.843031 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a8e4fe-6655-4551-a24f-eb9224374666 service swift] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:34:33.855645 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a8e4fe-6655-4551-a24f-eb9224374666 service swift] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:34:33.861371 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279e4143-b1c1-405c-88d4-c6f1a9750606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:34:33.862918 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e4143-b1c1-405c-88d4-c6f1a9750606 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:34:33.863450 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e4143-b1c1-405c-88d4-c6f1a9750606 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:34:33.863754 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e4143-b1c1-405c-88d4-c6f1a9750606 admin admin] PATH_INFO: `/v3/users/41c6cd4289b542aaa6919acc0644d233` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:34:33.864997 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279e4143-b1c1-405c-88d4-c6f1a9750606 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41c6cd4289b542aaa6919acc0644d233)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:34:33.866941 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279e4143-b1c1-405c-88d4-c6f1a9750606 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:34:33.926539 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-279e4143-b1c1-405c-88d4-c6f1a9750606 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41c6cd4289b542aaa6919acc0644d233'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:34:33.927252 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-279e4143-b1c1-405c-88d4-c6f1a9750606 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41c6cd4289b542aaa6919acc0644d233'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:34:33.934393 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-279e4143-b1c1-405c-88d4-c6f1a9750606 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41c6cd4289b542aaa6919acc0644d233'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:34:33.935063 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-279e4143-b1c1-405c-88d4-c6f1a9750606 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41c6cd4289b542aaa6919acc0644d233'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:34:33.943299 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-279e4143-b1c1-405c-88d4-c6f1a9750606 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41c6cd4289b542aaa6919acc0644d233'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:34:33.960789 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1214/2413] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:34:33 2022] DELETE /identity/v3/users/41c6cd4289b542aaa6919acc0644d233 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:34:34.135999 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a43bc3-4459-4290-b53b-763bab98c52e service neutron] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:34:34.148059 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a43bc3-4459-4290-b53b-763bab98c52e service neutron] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:34:34.202534 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc78d16-0f0e-4b41-a323-59bd2f2ee3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:34:34.203366 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc78d16-0f0e-4b41-a323-59bd2f2ee3fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:34:34.203679 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc78d16-0f0e-4b41-a323-59bd2f2ee3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:34:34.203945 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc78d16-0f0e-4b41-a323-59bd2f2ee3fe admin admin] PATH_INFO: `/v3/projects/6cb3f86664bf42b5a26dabed328f6eae` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:34:34.205086 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc78d16-0f0e-4b41-a323-59bd2f2ee3fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cb3f86664bf42b5a26dabed328f6eae)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:34:34.207595 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc78d16-0f0e-4b41-a323-59bd2f2ee3fe admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:34:34.250686 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-afc78d16-0f0e-4b41-a323-59bd2f2ee3fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cb3f86664bf42b5a26dabed328f6eae', 'request_id': 'req-afc78d16-0f0e-4b41-a323-59bd2f2ee3fe'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:34:34.256483 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-afc78d16-0f0e-4b41-a323-59bd2f2ee3fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cb3f86664bf42b5a26dabed328f6eae', 'request_id': 'req-afc78d16-0f0e-4b41-a323-59bd2f2ee3fe'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:34:34.262169 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-afc78d16-0f0e-4b41-a323-59bd2f2ee3fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cb3f86664bf42b5a26dabed328f6eae', 'request_id': 'req-afc78d16-0f0e-4b41-a323-59bd2f2ee3fe'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:34:34.274846 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-afc78d16-0f0e-4b41-a323-59bd2f2ee3fe admin admin] The token cache is being invalidate because project 6cb3f86664bf42b5a26dabed328f6eae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:34:34.275130 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-afc78d16-0f0e-4b41-a323-59bd2f2ee3fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:34:34.275780 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-afc78d16-0f0e-4b41-a323-59bd2f2ee3fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:34:34.277302 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1200/2414] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:34:34 2022] DELETE /identity/v3/projects/6cb3f86664bf42b5a26dabed328f6eae => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:34:38.624182 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279e4143-b1c1-405c-88d4-c6f1a9750606 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:34:38.625553 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-279e4143-b1c1-405c-88d4-c6f1a9750606 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:34:38.680080 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279e4143-b1c1-405c-88d4-c6f1a9750606 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:34:38.725530 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13000f90-c732-487e-9f1f-6caf9f1a3e99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:34:38.726159 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13000f90-c732-487e-9f1f-6caf9f1a3e99 service neutron] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:34:38.726435 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13000f90-c732-487e-9f1f-6caf9f1a3e99 service neutron] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:34:38.726702 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13000f90-c732-487e-9f1f-6caf9f1a3e99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:34:38.728446 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-13000f90-c732-487e-9f1f-6caf9f1a3e99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:34:38.787822 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13000f90-c732-487e-9f1f-6caf9f1a3e99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:34:38.789164 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13000f90-c732-487e-9f1f-6caf9f1a3e99 service neutron] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:34:38.798456 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1215/2415] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:34:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:34:41.956874 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc78d16-0f0e-4b41-a323-59bd2f2ee3fe admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:34:41.959592 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-afc78d16-0f0e-4b41-a323-59bd2f2ee3fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:34:41.972379 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc78d16-0f0e-4b41-a323-59bd2f2ee3fe admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:34:41.981691 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2284f5-9531-4a5c-8409-e2814b937d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:34:41.982598 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2284f5-9531-4a5c-8409-e2814b937d1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:34:41.982879 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2284f5-9531-4a5c-8409-e2814b937d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:34:41.983458 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2284f5-9531-4a5c-8409-e2814b937d1f admin admin] PATH_INFO: `/v3/users/d9342c8759514113aeec13ce910e4a21` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:34:42.007260 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2284f5-9531-4a5c-8409-e2814b937d1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9342c8759514113aeec13ce910e4a21)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:34:42.009386 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2284f5-9531-4a5c-8409-e2814b937d1f admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:34:42.056208 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-ba2284f5-9531-4a5c-8409-e2814b937d1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9342c8759514113aeec13ce910e4a21'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:34:42.063072 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-ba2284f5-9531-4a5c-8409-e2814b937d1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9342c8759514113aeec13ce910e4a21'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:34:42.071755 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-ba2284f5-9531-4a5c-8409-e2814b937d1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9342c8759514113aeec13ce910e4a21'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:34:42.072408 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-ba2284f5-9531-4a5c-8409-e2814b937d1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9342c8759514113aeec13ce910e4a21'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:34:42.073002 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-ba2284f5-9531-4a5c-8409-e2814b937d1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9342c8759514113aeec13ce910e4a21'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:34:42.092776 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1201/2416] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:34:41 2022] DELETE /identity/v3/users/d9342c8759514113aeec13ce910e4a21 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:34:42.278414 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13000f90-c732-487e-9f1f-6caf9f1a3e99 service neutron] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:34:42.288127 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13000f90-c732-487e-9f1f-6caf9f1a3e99 service neutron] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:34:42.343961 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e01a886-7e6c-4dca-9fb1-d927a0d858d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:34:42.344734 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e01a886-7e6c-4dca-9fb1-d927a0d858d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:34:42.345012 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e01a886-7e6c-4dca-9fb1-d927a0d858d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:34:42.345281 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e01a886-7e6c-4dca-9fb1-d927a0d858d7 admin admin] PATH_INFO: `/v3/projects/1689d104c0184a36816bb6e361733e16` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:34:42.355287 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e01a886-7e6c-4dca-9fb1-d927a0d858d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1689d104c0184a36816bb6e361733e16)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:34:42.357216 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e01a886-7e6c-4dca-9fb1-d927a0d858d7 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:34:42.400492 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-5e01a886-7e6c-4dca-9fb1-d927a0d858d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1689d104c0184a36816bb6e361733e16', 'request_id': 'req-5e01a886-7e6c-4dca-9fb1-d927a0d858d7'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:34:42.407291 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-5e01a886-7e6c-4dca-9fb1-d927a0d858d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1689d104c0184a36816bb6e361733e16', 'request_id': 'req-5e01a886-7e6c-4dca-9fb1-d927a0d858d7'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:34:42.412565 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-5e01a886-7e6c-4dca-9fb1-d927a0d858d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1689d104c0184a36816bb6e361733e16', 'request_id': 'req-5e01a886-7e6c-4dca-9fb1-d927a0d858d7'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:34:42.423858 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-5e01a886-7e6c-4dca-9fb1-d927a0d858d7 admin admin] The token cache is being invalidate because project 1689d104c0184a36816bb6e361733e16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:34:42.424315 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-5e01a886-7e6c-4dca-9fb1-d927a0d858d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:34:42.424903 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-5e01a886-7e6c-4dca-9fb1-d927a0d858d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:34:42.426978 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1216/2417] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:34:42 2022] DELETE /identity/v3/projects/1689d104c0184a36816bb6e361733e16 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:34:42.432195 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c14195-1ce6-40c8-b917-61deff27c250 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:34:42.432553 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c14195-1ce6-40c8-b917-61deff27c250 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:34:42.432827 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c14195-1ce6-40c8-b917-61deff27c250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:34:42.450734 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-81c14195-1ce6-40c8-b917-61deff27c250 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:34:42.451936 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-81c14195-1ce6-40c8-b917-61deff27c250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:34:42.508717 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1202/2418] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:34:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:34:42.517086 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4ce08-5fb5-4768-a899-d2d8a1375155 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:34:42.517365 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4ce08-5fb5-4768-a899-d2d8a1375155 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:34:42.517659 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4ce08-5fb5-4768-a899-d2d8a1375155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:34:42.536405 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-2db4ce08-5fb5-4768-a899-d2d8a1375155 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:34:42.537508 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-2db4ce08-5fb5-4768-a899-d2d8a1375155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:34:42.545381 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1217/2419] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:34:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:34:42.549544 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c14195-1ce6-40c8-b917-61deff27c250 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:34:42.559447 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c14195-1ce6-40c8-b917-61deff27c250 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:34:42.563928 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e707058-40db-48ed-a23c-22308d23501f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:34:42.564559 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e707058-40db-48ed-a23c-22308d23501f admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:34:42.564834 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e707058-40db-48ed-a23c-22308d23501f admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:34:42.565101 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e707058-40db-48ed-a23c-22308d23501f admin admin] PATH_INFO: `/v3/domains` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:34:42.565823 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e707058-40db-48ed-a23c-22308d23501f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:34:42.566149 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e707058-40db-48ed-a23c-22308d23501f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:34:42.568373 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e707058-40db-48ed-a23c-22308d23501f admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:34:42.579791 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1203/2420] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 9 20:34:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:34:42.584210 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db4ce08-5fb5-4768-a899-d2d8a1375155 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:34:42.593311 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db4ce08-5fb5-4768-a899-d2d8a1375155 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:34:42.597923 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b208b91-f468-4978-bd19-1c8b60ecdaee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:34:42.598555 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b208b91-f468-4978-bd19-1c8b60ecdaee admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:34:42.598845 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b208b91-f468-4978-bd19-1c8b60ecdaee admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:34:42.599116 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b208b91-f468-4978-bd19-1c8b60ecdaee admin admin] PATH_INFO: `/v3/projects` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:34:42.599846 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b208b91-f468-4978-bd19-1c8b60ecdaee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:34:42.601798 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b208b91-f468-4978-bd19-1c8b60ecdaee admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:34:42.627503 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1218/2421] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:34:42 2022] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:34:42.632172 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e707058-40db-48ed-a23c-22308d23501f admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:34:42.641976 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e707058-40db-48ed-a23c-22308d23501f admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:34:42.694866 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe5b442-1087-4333-a38d-7a3cb1623f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:34:42.695533 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe5b442-1087-4333-a38d-7a3cb1623f4d admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:34:42.695810 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe5b442-1087-4333-a38d-7a3cb1623f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:34:42.696170 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe5b442-1087-4333-a38d-7a3cb1623f4d admin admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:34:42.696834 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe5b442-1087-4333-a38d-7a3cb1623f4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:34:42.698735 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe5b442-1087-4333-a38d-7a3cb1623f4d admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:34:42.718884 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1204/2422] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:34:42 2022] POST /identity/v3/users => generated 292 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:34:42.723759 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b208b91-f468-4978-bd19-1c8b60ecdaee admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:34:42.733834 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b208b91-f468-4978-bd19-1c8b60ecdaee admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:34:42.738414 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c3d9f5-c508-4796-b933-6451adc2fd05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:34:42.739059 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c3d9f5-c508-4796-b933-6451adc2fd05 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:34:42.739340 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c3d9f5-c508-4796-b933-6451adc2fd05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:34:42.739653 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c3d9f5-c508-4796-b933-6451adc2fd05 admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:34:42.740373 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c3d9f5-c508-4796-b933-6451adc2fd05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:34:42.741957 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c3d9f5-c508-4796-b933-6451adc2fd05 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:34:42.752035 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1219/2423] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:34:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:34:42.756108 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe5b442-1087-4333-a38d-7a3cb1623f4d admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:34:42.766239 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe5b442-1087-4333-a38d-7a3cb1623f4d admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:34:42.771274 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931febdf-7c12-4739-8eab-a9f7a6aa47bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:34:42.771930 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931febdf-7c12-4739-8eab-a9f7a6aa47bc admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:34:42.772207 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931febdf-7c12-4739-8eab-a9f7a6aa47bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:34:42.772476 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931febdf-7c12-4739-8eab-a9f7a6aa47bc admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:34:42.773185 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931febdf-7c12-4739-8eab-a9f7a6aa47bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:34:42.774756 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931febdf-7c12-4739-8eab-a9f7a6aa47bc admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:34:42.784139 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1205/2424] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:34:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:34:42.788798 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c3d9f5-c508-4796-b933-6451adc2fd05 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:34:42.798425 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c3d9f5-c508-4796-b933-6451adc2fd05 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:34:42.803102 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d4dcc-63e3-4999-8ecd-f10c1f464f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:34:42.804001 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d4dcc-63e3-4999-8ecd-f10c1f464f08 admin admin] REQUEST_METHOD: `PUT` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:34:42.804281 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d4dcc-63e3-4999-8ecd-f10c1f464f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:34:42.804557 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d4dcc-63e3-4999-8ecd-f10c1f464f08 admin admin] PATH_INFO: `/v3/projects/35bee25bb75b4c47ade16f1dd2cc0a79/users/130d833489e540cca9333bc60990de72/roles/79f90a0bf6ea43d0b3c434e31556253a` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:34:42.819265 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4d4dcc-63e3-4999-8ecd-f10c1f464f08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35bee25bb75b4c47ade16f1dd2cc0a79, user_id=130d833489e540cca9333bc60990de72, role_id=79f90a0bf6ea43d0b3c434e31556253a)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:34:42.821938 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4d4dcc-63e3-4999-8ecd-f10c1f464f08 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:34:42.835055 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1220/2425] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:34:42 2022] PUT /identity/v3/projects/35bee25bb75b4c47ade16f1dd2cc0a79/users/130d833489e540cca9333bc60990de72/roles/79f90a0bf6ea43d0b3c434e31556253a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:34:42.845450 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee5083-3bd2-4bfd-bd38-ac358bb59eea None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:34:42.845756 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee5083-3bd2-4bfd-bd38-ac358bb59eea None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:34:42.846055 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee5083-3bd2-4bfd-bd38-ac358bb59eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:34:42.871496 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-8fee5083-3bd2-4bfd-bd38-ac358bb59eea None None] MFA Rules not processed for user `130d833489e540cca9333bc60990de72`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:34:42.872665 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-8fee5083-3bd2-4bfd-bd38-ac358bb59eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:34:42.934828 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1206/2426] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:34:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:34:42.946972 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d4dcc-63e3-4999-8ecd-f10c1f464f08 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:34:42.948693 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-0c4d4dcc-63e3-4999-8ecd-f10c1f464f08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:34:43.018783 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d4dcc-63e3-4999-8ecd-f10c1f464f08 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:34:43.024979 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b39fa-f5e6-42ea-9792-a99fb6417bd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb59440b21074d9da15679dc2d745f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:34:43.025607 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b39fa-f5e6-42ea-9792-a99fb6417bd3 service nova] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:34:43.025881 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b39fa-f5e6-42ea-9792-a99fb6417bd3 service nova] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:34:43.026152 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b39fa-f5e6-42ea-9792-a99fb6417bd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:34:43.033602 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26b39fa-f5e6-42ea-9792-a99fb6417bd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:34:43.035159 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26b39fa-f5e6-42ea-9792-a99fb6417bd3 service nova] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:34:43.043919 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1221/2427] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:34:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:34:51.294164 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fee5083-3bd2-4bfd-bd38-ac358bb59eea None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:34:51.351133 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fee5083-3bd2-4bfd-bd38-ac358bb59eea None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:34:51.355617 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276e7532-dcb1-44b0-8d9c-c4342ae814ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:34:51.356462 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e7532-dcb1-44b0-8d9c-c4342ae814ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:34:51.356734 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e7532-dcb1-44b0-8d9c-c4342ae814ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:34:51.356999 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e7532-dcb1-44b0-8d9c-c4342ae814ed admin admin] PATH_INFO: `/v3/users/130d833489e540cca9333bc60990de72` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:34:51.358157 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276e7532-dcb1-44b0-8d9c-c4342ae814ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=130d833489e540cca9333bc60990de72)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:34:51.360148 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276e7532-dcb1-44b0-8d9c-c4342ae814ed admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:34:51.403989 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-276e7532-dcb1-44b0-8d9c-c4342ae814ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '130d833489e540cca9333bc60990de72'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:34:51.410476 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-276e7532-dcb1-44b0-8d9c-c4342ae814ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '130d833489e540cca9333bc60990de72'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:34:51.417651 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-276e7532-dcb1-44b0-8d9c-c4342ae814ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '130d833489e540cca9333bc60990de72'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:34:51.418264 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-276e7532-dcb1-44b0-8d9c-c4342ae814ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '130d833489e540cca9333bc60990de72'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:34:51.418861 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-276e7532-dcb1-44b0-8d9c-c4342ae814ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '130d833489e540cca9333bc60990de72'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:34:51.435664 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1207/2428] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:34:51 2022] DELETE /identity/v3/users/130d833489e540cca9333bc60990de72 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:34:51.440345 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f620bea1-1b6a-4164-b4dc-e47c94c2fcf7 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:34:51.440849 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f620bea1-1b6a-4164-b4dc-e47c94c2fcf7 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:34:51.440948 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f620bea1-1b6a-4164-b4dc-e47c94c2fcf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:34:51.457876 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-f620bea1-1b6a-4164-b4dc-e47c94c2fcf7 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:34:51.459168 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-f620bea1-1b6a-4164-b4dc-e47c94c2fcf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:34:51.516525 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1222/2429] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:34:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:34:51.526184 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276e7532-dcb1-44b0-8d9c-c4342ae814ed admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:34:51.527614 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-276e7532-dcb1-44b0-8d9c-c4342ae814ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:34:51.582641 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276e7532-dcb1-44b0-8d9c-c4342ae814ed admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:34:51.586306 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3601de6a-b1f9-4aec-b958-ef764e6724b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:34:51.586939 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3601de6a-b1f9-4aec-b958-ef764e6724b7 service neutron] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:34:51.587212 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3601de6a-b1f9-4aec-b958-ef764e6724b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:34:51.587514 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3601de6a-b1f9-4aec-b958-ef764e6724b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:34:51.596255 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3601de6a-b1f9-4aec-b958-ef764e6724b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:34:51.597667 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3601de6a-b1f9-4aec-b958-ef764e6724b7 service neutron] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:34:51.606763 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1208/2430] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:34:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:34:51.868928 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f620bea1-1b6a-4164-b4dc-e47c94c2fcf7 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:34:51.870441 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-f620bea1-1b6a-4164-b4dc-e47c94c2fcf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:34:51.887301 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f620bea1-1b6a-4164-b4dc-e47c94c2fcf7 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:34:51.892267 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21b76dc-af34-47ca-9094-cf4047c5a6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:34:51.893009 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b76dc-af34-47ca-9094-cf4047c5a6bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:34:51.893356 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b76dc-af34-47ca-9094-cf4047c5a6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:34:51.893505 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b76dc-af34-47ca-9094-cf4047c5a6bb admin admin] PATH_INFO: `/v3/projects/35bee25bb75b4c47ade16f1dd2cc0a79` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:34:51.894690 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21b76dc-af34-47ca-9094-cf4047c5a6bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=35bee25bb75b4c47ade16f1dd2cc0a79)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:34:51.896634 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21b76dc-af34-47ca-9094-cf4047c5a6bb admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:34:51.942173 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-e21b76dc-af34-47ca-9094-cf4047c5a6bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35bee25bb75b4c47ade16f1dd2cc0a79', 'request_id': 'req-e21b76dc-af34-47ca-9094-cf4047c5a6bb'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:34:51.948531 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-e21b76dc-af34-47ca-9094-cf4047c5a6bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35bee25bb75b4c47ade16f1dd2cc0a79', 'request_id': 'req-e21b76dc-af34-47ca-9094-cf4047c5a6bb'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:34:51.953674 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-e21b76dc-af34-47ca-9094-cf4047c5a6bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35bee25bb75b4c47ade16f1dd2cc0a79', 'request_id': 'req-e21b76dc-af34-47ca-9094-cf4047c5a6bb'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:34:51.965309 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-e21b76dc-af34-47ca-9094-cf4047c5a6bb admin admin] The token cache is being invalidate because project 35bee25bb75b4c47ade16f1dd2cc0a79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:34:51.965620 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-e21b76dc-af34-47ca-9094-cf4047c5a6bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:34:51.966233 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-e21b76dc-af34-47ca-9094-cf4047c5a6bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:34:51.967832 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1223/2431] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:34:51 2022] DELETE /identity/v3/projects/35bee25bb75b4c47ade16f1dd2cc0a79 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:34:51.972733 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7b051-a71b-4e79-94ad-e507e55734ed None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:34:51.973019 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7b051-a71b-4e79-94ad-e507e55734ed None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:34:51.973323 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7b051-a71b-4e79-94ad-e507e55734ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:34:51.991753 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-a5a7b051-a71b-4e79-94ad-e507e55734ed None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:34:51.992977 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-a5a7b051-a71b-4e79-94ad-e507e55734ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:34:52.051063 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1209/2432] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:34:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:34:52.059276 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b11c0-9422-4055-8f05-4a50e96a6d39 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:34:52.059591 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b11c0-9422-4055-8f05-4a50e96a6d39 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:34:52.059866 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b11c0-9422-4055-8f05-4a50e96a6d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:34:52.077477 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-186b11c0-9422-4055-8f05-4a50e96a6d39 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:34:52.078664 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-186b11c0-9422-4055-8f05-4a50e96a6d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:34:52.086494 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1224/2433] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:34:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:34:52.090519 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a7b051-a71b-4e79-94ad-e507e55734ed None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:34:52.100714 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a7b051-a71b-4e79-94ad-e507e55734ed None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:34:52.105192 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf4c23b-a14d-44a5-9f93-5e716fd9888e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:34:52.105833 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4c23b-a14d-44a5-9f93-5e716fd9888e admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:34:52.106107 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4c23b-a14d-44a5-9f93-5e716fd9888e admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:34:52.106372 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4c23b-a14d-44a5-9f93-5e716fd9888e admin admin] PATH_INFO: `/v3/domains` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:34:52.107079 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf4c23b-a14d-44a5-9f93-5e716fd9888e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:34:52.107375 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf4c23b-a14d-44a5-9f93-5e716fd9888e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:34:52.108992 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf4c23b-a14d-44a5-9f93-5e716fd9888e admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:34:52.121223 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1210/2434] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 9 20:34:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:34:52.125298 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186b11c0-9422-4055-8f05-4a50e96a6d39 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:34:52.134312 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186b11c0-9422-4055-8f05-4a50e96a6d39 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:34:52.139141 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9a0bd1-d5e5-464e-9766-821161b8f7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:34:52.139833 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a0bd1-d5e5-464e-9766-821161b8f7e3 admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:34:52.140120 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a0bd1-d5e5-464e-9766-821161b8f7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:34:52.140393 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a0bd1-d5e5-464e-9766-821161b8f7e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:34:52.141079 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9a0bd1-d5e5-464e-9766-821161b8f7e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:34:52.142970 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9a0bd1-d5e5-464e-9766-821161b8f7e3 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:34:52.169921 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1225/2435] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:34:52 2022] POST /identity/v3/projects => generated 405 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:34:52.174034 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf4c23b-a14d-44a5-9f93-5e716fd9888e admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:34:52.184094 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf4c23b-a14d-44a5-9f93-5e716fd9888e admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:34:52.250705 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171b3796-13d5-433a-9e6d-342542a95ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:34:52.251358 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b3796-13d5-433a-9e6d-342542a95ddd admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:34:52.251693 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b3796-13d5-433a-9e6d-342542a95ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:34:52.251982 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b3796-13d5-433a-9e6d-342542a95ddd admin admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:34:52.252665 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171b3796-13d5-433a-9e6d-342542a95ddd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:34:52.254581 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171b3796-13d5-433a-9e6d-342542a95ddd admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:34:52.274017 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1211/2436] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:34:52 2022] POST /identity/v3/users => generated 303 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:34:52.278132 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9a0bd1-d5e5-464e-9766-821161b8f7e3 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:34:52.288945 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9a0bd1-d5e5-464e-9766-821161b8f7e3 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:34:52.293548 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051c1230-9daa-4ae1-a924-949c53173fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:34:52.294192 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c1230-9daa-4ae1-a924-949c53173fca admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:34:52.294472 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c1230-9daa-4ae1-a924-949c53173fca admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:34:52.294769 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c1230-9daa-4ae1-a924-949c53173fca admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:34:52.295518 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051c1230-9daa-4ae1-a924-949c53173fca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:34:52.297105 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051c1230-9daa-4ae1-a924-949c53173fca admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:34:52.307221 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1226/2437] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:34:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:34:52.311006 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171b3796-13d5-433a-9e6d-342542a95ddd admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:34:52.321295 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171b3796-13d5-433a-9e6d-342542a95ddd admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:34:52.325788 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2898416-c7bd-4e72-8a09-9f8083c99c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:34:52.326421 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2898416-c7bd-4e72-8a09-9f8083c99c8b admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:34:52.326696 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2898416-c7bd-4e72-8a09-9f8083c99c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:34:52.326963 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2898416-c7bd-4e72-8a09-9f8083c99c8b admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:34:52.327696 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2898416-c7bd-4e72-8a09-9f8083c99c8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:34:52.329279 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2898416-c7bd-4e72-8a09-9f8083c99c8b admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:34:52.339271 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1212/2438] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:34:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:34:52.343306 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051c1230-9daa-4ae1-a924-949c53173fca admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:34:52.354077 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051c1230-9daa-4ae1-a924-949c53173fca admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:34:52.358732 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ffc4b9-6b07-4474-b33a-0984909079a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:34:52.359616 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ffc4b9-6b07-4474-b33a-0984909079a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:34:52.359900 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ffc4b9-6b07-4474-b33a-0984909079a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:34:52.360175 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ffc4b9-6b07-4474-b33a-0984909079a4 admin admin] PATH_INFO: `/v3/projects/b8ef02ba4ab84f029bca759ce2c3374d/users/7fd66798ddfd47c8a476c04fa9a223f9/roles/79f90a0bf6ea43d0b3c434e31556253a` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:34:52.374129 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ffc4b9-6b07-4474-b33a-0984909079a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8ef02ba4ab84f029bca759ce2c3374d, user_id=7fd66798ddfd47c8a476c04fa9a223f9, role_id=79f90a0bf6ea43d0b3c434e31556253a)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:34:52.376806 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ffc4b9-6b07-4474-b33a-0984909079a4 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:34:52.390289 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1227/2439] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:34:52 2022] PUT /identity/v3/projects/b8ef02ba4ab84f029bca759ce2c3374d/users/7fd66798ddfd47c8a476c04fa9a223f9/roles/79f90a0bf6ea43d0b3c434e31556253a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:34:52.395451 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b453ccb-c1a8-4140-bf85-17f13cf11651 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:34:52.395741 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b453ccb-c1a8-4140-bf85-17f13cf11651 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:34:52.396865 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b453ccb-c1a8-4140-bf85-17f13cf11651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:34:52.414465 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-8b453ccb-c1a8-4140-bf85-17f13cf11651 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:34:52.415670 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-8b453ccb-c1a8-4140-bf85-17f13cf11651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:34:52.469859 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1213/2440] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:34:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:34:52.479976 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ffc4b9-6b07-4474-b33a-0984909079a4 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:34:52.481735 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-35ffc4b9-6b07-4474-b33a-0984909079a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:34:52.542166 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ffc4b9-6b07-4474-b33a-0984909079a4 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:34:52.545733 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88dc354-4604-45b9-a038-907f6868b9bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:34:52.546369 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88dc354-4604-45b9-a038-907f6868b9bb service neutron] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:34:52.546658 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88dc354-4604-45b9-a038-907f6868b9bb service neutron] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:34:52.546930 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88dc354-4604-45b9-a038-907f6868b9bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:34:52.555767 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88dc354-4604-45b9-a038-907f6868b9bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:34:52.557184 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88dc354-4604-45b9-a038-907f6868b9bb service neutron] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:34:52.566374 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1228/2441] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:34:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:34:53.163031 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de6041a-144a-4a3b-ad34-475012f1c44d None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:34:53.163315 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de6041a-144a-4a3b-ad34-475012f1c44d None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:34:53.163639 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de6041a-144a-4a3b-ad34-475012f1c44d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:34:53.196336 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-6de6041a-144a-4a3b-ad34-475012f1c44d None None] MFA Rules not processed for user `7fd66798ddfd47c8a476c04fa9a223f9`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:34:53.197561 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-6de6041a-144a-4a3b-ad34-475012f1c44d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:34:53.271948 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1214/2442] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:34:53 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:34:53.276395 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88dc354-4604-45b9-a038-907f6868b9bb service neutron] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:34:53.289889 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88dc354-4604-45b9-a038-907f6868b9bb service neutron] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:34:53.295366 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c87bc2a-9646-46cb-8e1b-dd895b82fc77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:34:53.296052 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c87bc2a-9646-46cb-8e1b-dd895b82fc77 admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:34:53.296334 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c87bc2a-9646-46cb-8e1b-dd895b82fc77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:34:53.296607 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c87bc2a-9646-46cb-8e1b-dd895b82fc77 admin admin] PATH_INFO: `/v3/projects` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:34:53.297294 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c87bc2a-9646-46cb-8e1b-dd895b82fc77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:34:53.299182 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c87bc2a-9646-46cb-8e1b-dd895b82fc77 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:34:53.332009 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1229/2443] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:34:53 2022] POST /identity/v3/projects => generated 405 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 20:34:53.336560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de6041a-144a-4a3b-ad34-475012f1c44d None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:34:53.348543 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de6041a-144a-4a3b-ad34-475012f1c44d None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:34:53.406308 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49001860-aba7-49bf-b5f5-862ad746eb72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:34:53.406967 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49001860-aba7-49bf-b5f5-862ad746eb72 admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:34:53.407246 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49001860-aba7-49bf-b5f5-862ad746eb72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:34:53.407555 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49001860-aba7-49bf-b5f5-862ad746eb72 admin admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:34:53.408242 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49001860-aba7-49bf-b5f5-862ad746eb72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:34:53.410157 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49001860-aba7-49bf-b5f5-862ad746eb72 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:34:53.432475 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1215/2444] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:34:53 2022] POST /identity/v3/users => generated 309 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:34:53.436731 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c87bc2a-9646-46cb-8e1b-dd895b82fc77 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:34:53.447459 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c87bc2a-9646-46cb-8e1b-dd895b82fc77 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:34:53.452003 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c90deb-ef48-463c-b48d-62aa897c2b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:34:53.452652 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c90deb-ef48-463c-b48d-62aa897c2b9e admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:34:53.453073 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c90deb-ef48-463c-b48d-62aa897c2b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:34:53.453350 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c90deb-ef48-463c-b48d-62aa897c2b9e admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:34:53.454184 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c90deb-ef48-463c-b48d-62aa897c2b9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:34:53.455813 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c90deb-ef48-463c-b48d-62aa897c2b9e admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:34:53.469642 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1230/2445] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:34:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:34:53.470775 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49001860-aba7-49bf-b5f5-862ad746eb72 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:34:53.481743 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49001860-aba7-49bf-b5f5-862ad746eb72 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:34:53.486573 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d9908c-ade2-4797-bc57-94a0a218e1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:34:53.487504 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d9908c-ade2-4797-bc57-94a0a218e1c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:34:53.487790 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d9908c-ade2-4797-bc57-94a0a218e1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:34:53.488059 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d9908c-ade2-4797-bc57-94a0a218e1c8 admin admin] PATH_INFO: `/v3/projects/af389bac367b49fdae0540b972ce7b6e/users/afd49e72d94d42338f47ee9f9aa19bad/roles/274130b78e304bb88789c1b349263f3c` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:34:53.503678 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d9908c-ade2-4797-bc57-94a0a218e1c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af389bac367b49fdae0540b972ce7b6e, user_id=afd49e72d94d42338f47ee9f9aa19bad, role_id=274130b78e304bb88789c1b349263f3c)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:34:53.506678 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d9908c-ade2-4797-bc57-94a0a218e1c8 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:34:53.520247 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1216/2446] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:34:53 2022] PUT /identity/v3/projects/af389bac367b49fdae0540b972ce7b6e/users/afd49e72d94d42338f47ee9f9aa19bad/roles/274130b78e304bb88789c1b349263f3c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:34:53.524479 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c90deb-ef48-463c-b48d-62aa897c2b9e admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:34:53.534233 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c90deb-ef48-463c-b48d-62aa897c2b9e admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:34:53.588273 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e649a37-cafb-4853-b7db-b42dab17122b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:34:53.588937 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e649a37-cafb-4853-b7db-b42dab17122b admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:34:53.589216 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e649a37-cafb-4853-b7db-b42dab17122b admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:34:53.589490 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e649a37-cafb-4853-b7db-b42dab17122b admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:34:53.590207 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e649a37-cafb-4853-b7db-b42dab17122b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:34:53.591837 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e649a37-cafb-4853-b7db-b42dab17122b admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:34:53.601950 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1231/2447] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:34:53 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:34:53.605970 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d9908c-ade2-4797-bc57-94a0a218e1c8 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:34:53.616868 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d9908c-ade2-4797-bc57-94a0a218e1c8 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:34:53.621414 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c1d75-5d2e-4b7d-b46e-856e45e3f2b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:34:53.622298 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c1d75-5d2e-4b7d-b46e-856e45e3f2b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:34:53.622570 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c1d75-5d2e-4b7d-b46e-856e45e3f2b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:34:53.622838 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c1d75-5d2e-4b7d-b46e-856e45e3f2b7 admin admin] PATH_INFO: `/v3/projects/af389bac367b49fdae0540b972ce7b6e/users/afd49e72d94d42338f47ee9f9aa19bad/roles/274130b78e304bb88789c1b349263f3c` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:34:53.624804 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91c1d75-5d2e-4b7d-b46e-856e45e3f2b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af389bac367b49fdae0540b972ce7b6e, user_id=afd49e72d94d42338f47ee9f9aa19bad, role_id=274130b78e304bb88789c1b349263f3c)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:34:53.627412 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91c1d75-5d2e-4b7d-b46e-856e45e3f2b7 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:34:53.637349 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1217/2448] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:34:53 2022] PUT /identity/v3/projects/af389bac367b49fdae0540b972ce7b6e/users/afd49e72d94d42338f47ee9f9aa19bad/roles/274130b78e304bb88789c1b349263f3c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:34:54.233177 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd97cf-5521-4cd7-9352-2b6b30e1f1af None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:34:54.233465 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd97cf-5521-4cd7-9352-2b6b30e1f1af None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:34:54.233742 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd97cf-5521-4cd7-9352-2b6b30e1f1af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:34:54.263301 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-aedd97cf-5521-4cd7-9352-2b6b30e1f1af None None] MFA Rules not processed for user `afd49e72d94d42338f47ee9f9aa19bad`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:34:54.264543 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-aedd97cf-5521-4cd7-9352-2b6b30e1f1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:34:54.332271 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1232/2449] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:34:54 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:34:55.563124 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c1d75-5d2e-4b7d-b46e-856e45e3f2b7 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:34:55.629596 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c1d75-5d2e-4b7d-b46e-856e45e3f2b7 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:34:55.635012 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ce5d32-f30a-4303-a561-5e1dff727454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:34:55.636160 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce5d32-f30a-4303-a561-5e1dff727454 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:34:55.636440 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce5d32-f30a-4303-a561-5e1dff727454 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:34:55.636711 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce5d32-f30a-4303-a561-5e1dff727454 admin admin] PATH_INFO: `/v3/users/7fd66798ddfd47c8a476c04fa9a223f9` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:34:55.637884 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ce5d32-f30a-4303-a561-5e1dff727454 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fd66798ddfd47c8a476c04fa9a223f9)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:34:55.639878 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ce5d32-f30a-4303-a561-5e1dff727454 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:34:55.684922 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-40ce5d32-f30a-4303-a561-5e1dff727454 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fd66798ddfd47c8a476c04fa9a223f9'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:34:55.691458 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-40ce5d32-f30a-4303-a561-5e1dff727454 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fd66798ddfd47c8a476c04fa9a223f9'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:34:55.698717 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-40ce5d32-f30a-4303-a561-5e1dff727454 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fd66798ddfd47c8a476c04fa9a223f9'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:34:55.699352 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-40ce5d32-f30a-4303-a561-5e1dff727454 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fd66798ddfd47c8a476c04fa9a223f9'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:34:55.699983 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-40ce5d32-f30a-4303-a561-5e1dff727454 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fd66798ddfd47c8a476c04fa9a223f9'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:34:55.716150 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1218/2450] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:34:55 2022] DELETE /identity/v3/users/7fd66798ddfd47c8a476c04fa9a223f9 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:34:55.887459 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedd97cf-5521-4cd7-9352-2b6b30e1f1af None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:34:55.900360 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedd97cf-5521-4cd7-9352-2b6b30e1f1af None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:34:55.956564 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fb217b-b5c2-4d36-823b-7778498aea43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:34:55.957422 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb217b-b5c2-4d36-823b-7778498aea43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:34:55.957701 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb217b-b5c2-4d36-823b-7778498aea43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:34:55.957970 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb217b-b5c2-4d36-823b-7778498aea43 admin admin] PATH_INFO: `/v3/projects/b8ef02ba4ab84f029bca759ce2c3374d` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:34:55.959666 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fb217b-b5c2-4d36-823b-7778498aea43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8ef02ba4ab84f029bca759ce2c3374d)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:34:55.961563 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fb217b-b5c2-4d36-823b-7778498aea43 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:34:56.004575 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-56fb217b-b5c2-4d36-823b-7778498aea43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8ef02ba4ab84f029bca759ce2c3374d', 'request_id': 'req-56fb217b-b5c2-4d36-823b-7778498aea43'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:34:56.010818 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-56fb217b-b5c2-4d36-823b-7778498aea43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8ef02ba4ab84f029bca759ce2c3374d', 'request_id': 'req-56fb217b-b5c2-4d36-823b-7778498aea43'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:34:56.016005 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-56fb217b-b5c2-4d36-823b-7778498aea43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8ef02ba4ab84f029bca759ce2c3374d', 'request_id': 'req-56fb217b-b5c2-4d36-823b-7778498aea43'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:34:56.027993 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-56fb217b-b5c2-4d36-823b-7778498aea43 admin admin] The token cache is being invalidate because project b8ef02ba4ab84f029bca759ce2c3374d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:34:56.028271 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-56fb217b-b5c2-4d36-823b-7778498aea43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:34:56.028876 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-56fb217b-b5c2-4d36-823b-7778498aea43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:34:56.030416 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1233/2451] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:34:55 2022] DELETE /identity/v3/projects/b8ef02ba4ab84f029bca759ce2c3374d => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:34:56.035357 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ce5d32-f30a-4303-a561-5e1dff727454 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:34:56.037359 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-40ce5d32-f30a-4303-a561-5e1dff727454 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:34:56.050457 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ce5d32-f30a-4303-a561-5e1dff727454 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:34:56.104056 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af30c3b-8d91-4def-8234-7d4c9396d5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:34:56.104908 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af30c3b-8d91-4def-8234-7d4c9396d5e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:34:56.105184 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af30c3b-8d91-4def-8234-7d4c9396d5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:34:56.105453 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af30c3b-8d91-4def-8234-7d4c9396d5e2 admin admin] PATH_INFO: `/v3/users/afd49e72d94d42338f47ee9f9aa19bad` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:34:56.106608 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af30c3b-8d91-4def-8234-7d4c9396d5e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afd49e72d94d42338f47ee9f9aa19bad)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:34:56.108555 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af30c3b-8d91-4def-8234-7d4c9396d5e2 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:34:56.150986 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-9af30c3b-8d91-4def-8234-7d4c9396d5e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afd49e72d94d42338f47ee9f9aa19bad'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:34:56.157416 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-9af30c3b-8d91-4def-8234-7d4c9396d5e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afd49e72d94d42338f47ee9f9aa19bad'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:34:56.164923 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-9af30c3b-8d91-4def-8234-7d4c9396d5e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afd49e72d94d42338f47ee9f9aa19bad'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:34:56.165589 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-9af30c3b-8d91-4def-8234-7d4c9396d5e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afd49e72d94d42338f47ee9f9aa19bad'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:34:56.166188 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-9af30c3b-8d91-4def-8234-7d4c9396d5e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afd49e72d94d42338f47ee9f9aa19bad'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:34:56.182564 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1219/2452] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:34:56 2022] DELETE /identity/v3/users/afd49e72d94d42338f47ee9f9aa19bad => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:34:56.352260 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fb217b-b5c2-4d36-823b-7778498aea43 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:34:56.353761 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-56fb217b-b5c2-4d36-823b-7778498aea43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:34:56.369027 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fb217b-b5c2-4d36-823b-7778498aea43 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:34:56.426257 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb321ea1-8f9d-418a-9f59-ced242bcb91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:34:56.427099 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb321ea1-8f9d-418a-9f59-ced242bcb91a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:34:56.427435 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb321ea1-8f9d-418a-9f59-ced242bcb91a admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:34:56.427716 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb321ea1-8f9d-418a-9f59-ced242bcb91a admin admin] PATH_INFO: `/v3/projects/af389bac367b49fdae0540b972ce7b6e` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:34:56.428894 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb321ea1-8f9d-418a-9f59-ced242bcb91a admin admin] RBAC: Authorizing `identity:delete_project(project_id=af389bac367b49fdae0540b972ce7b6e)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:34:56.430785 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb321ea1-8f9d-418a-9f59-ced242bcb91a admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:34:56.474052 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-cb321ea1-8f9d-418a-9f59-ced242bcb91a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af389bac367b49fdae0540b972ce7b6e', 'request_id': 'req-cb321ea1-8f9d-418a-9f59-ced242bcb91a'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:34:56.480672 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-cb321ea1-8f9d-418a-9f59-ced242bcb91a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af389bac367b49fdae0540b972ce7b6e', 'request_id': 'req-cb321ea1-8f9d-418a-9f59-ced242bcb91a'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:34:56.485956 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-cb321ea1-8f9d-418a-9f59-ced242bcb91a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af389bac367b49fdae0540b972ce7b6e', 'request_id': 'req-cb321ea1-8f9d-418a-9f59-ced242bcb91a'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:34:56.497726 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-cb321ea1-8f9d-418a-9f59-ced242bcb91a admin admin] The token cache is being invalidate because project af389bac367b49fdae0540b972ce7b6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:34:56.498008 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-cb321ea1-8f9d-418a-9f59-ced242bcb91a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:34:56.498636 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-cb321ea1-8f9d-418a-9f59-ced242bcb91a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:34:56.500218 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1234/2453] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:34:56 2022] DELETE /identity/v3/projects/af389bac367b49fdae0540b972ce7b6e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:34:56.505604 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b4306-0656-4ffd-a68d-9e0c85e732ef None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:34:56.505921 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b4306-0656-4ffd-a68d-9e0c85e732ef None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:34:56.506224 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b4306-0656-4ffd-a68d-9e0c85e732ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:34:56.524711 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-010b4306-0656-4ffd-a68d-9e0c85e732ef None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:34:56.525903 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-010b4306-0656-4ffd-a68d-9e0c85e732ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:34:56.584201 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1220/2454] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:34:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:34:56.591998 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae6452-c508-4bf3-9fde-229fb49f9df6 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:34:56.592280 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae6452-c508-4bf3-9fde-229fb49f9df6 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:34:56.592548 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae6452-c508-4bf3-9fde-229fb49f9df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:34:56.610889 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-a3ae6452-c508-4bf3-9fde-229fb49f9df6 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:34:56.612388 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-a3ae6452-c508-4bf3-9fde-229fb49f9df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:34:56.621640 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1235/2455] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:34:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:34:56.625784 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b4306-0656-4ffd-a68d-9e0c85e732ef None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:34:56.636206 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b4306-0656-4ffd-a68d-9e0c85e732ef None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:34:56.640675 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f043d0ec-6524-458b-86d7-774de96a433a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:34:56.641319 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043d0ec-6524-458b-86d7-774de96a433a admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:34:56.641597 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043d0ec-6524-458b-86d7-774de96a433a admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:34:56.641869 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043d0ec-6524-458b-86d7-774de96a433a admin admin] PATH_INFO: `/v3/domains` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:34:56.642616 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f043d0ec-6524-458b-86d7-774de96a433a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:34:56.642946 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f043d0ec-6524-458b-86d7-774de96a433a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:34:56.644598 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f043d0ec-6524-458b-86d7-774de96a433a admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:34:56.656255 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1221/2456] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 9 20:34:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:34:56.660409 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ae6452-c508-4bf3-9fde-229fb49f9df6 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:34:56.669363 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ae6452-c508-4bf3-9fde-229fb49f9df6 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:34:56.673993 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc1ffa-bfec-4f1e-83fd-c2728c11e5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:34:56.674627 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc1ffa-bfec-4f1e-83fd-c2728c11e5a2 admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:34:56.674909 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc1ffa-bfec-4f1e-83fd-c2728c11e5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:34:56.675184 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc1ffa-bfec-4f1e-83fd-c2728c11e5a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:34:56.675917 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dc1ffa-bfec-4f1e-83fd-c2728c11e5a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:34:56.678454 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dc1ffa-bfec-4f1e-83fd-c2728c11e5a2 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:34:56.703419 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1236/2457] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:34:56 2022] POST /identity/v3/projects => generated 379 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:34:56.707222 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f043d0ec-6524-458b-86d7-774de96a433a admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:34:56.716966 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f043d0ec-6524-458b-86d7-774de96a433a admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:34:56.770865 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1d79da-b770-431f-9cf7-7004eeee1f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:34:56.771627 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1d79da-b770-431f-9cf7-7004eeee1f4f admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:34:56.771903 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1d79da-b770-431f-9cf7-7004eeee1f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:34:56.772168 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1d79da-b770-431f-9cf7-7004eeee1f4f admin admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:34:56.772869 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1d79da-b770-431f-9cf7-7004eeee1f4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:34:56.774770 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1d79da-b770-431f-9cf7-7004eeee1f4f admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:34:56.793825 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1222/2458] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:34:56 2022] POST /identity/v3/users => generated 290 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:34:56.797947 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc1ffa-bfec-4f1e-83fd-c2728c11e5a2 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:34:56.808833 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc1ffa-bfec-4f1e-83fd-c2728c11e5a2 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:34:56.813364 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbc74d0-8ea5-4aed-8b19-b2f6c30e62ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:34:56.814002 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc74d0-8ea5-4aed-8b19-b2f6c30e62ed admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:34:56.814278 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc74d0-8ea5-4aed-8b19-b2f6c30e62ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:34:56.814548 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc74d0-8ea5-4aed-8b19-b2f6c30e62ed admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:34:56.815254 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbc74d0-8ea5-4aed-8b19-b2f6c30e62ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:34:56.816869 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbc74d0-8ea5-4aed-8b19-b2f6c30e62ed admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:34:56.827720 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1237/2459] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:34:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:34:56.831362 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1d79da-b770-431f-9cf7-7004eeee1f4f admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:34:56.841318 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1d79da-b770-431f-9cf7-7004eeee1f4f admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:34:56.845794 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779d85ff-5ee8-44a4-baec-4393bf6b76f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:34:56.846422 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d85ff-5ee8-44a4-baec-4393bf6b76f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:34:56.846696 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d85ff-5ee8-44a4-baec-4393bf6b76f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:34:56.846959 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d85ff-5ee8-44a4-baec-4393bf6b76f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:34:56.847697 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779d85ff-5ee8-44a4-baec-4393bf6b76f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:34:56.849309 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779d85ff-5ee8-44a4-baec-4393bf6b76f5 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:34:56.858667 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1223/2460] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:34:56 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:34:56.862613 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbc74d0-8ea5-4aed-8b19-b2f6c30e62ed admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:34:56.872733 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbc74d0-8ea5-4aed-8b19-b2f6c30e62ed admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:34:56.877236 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c60333-63fb-4f85-81f1-160797f606d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:34:56.878086 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c60333-63fb-4f85-81f1-160797f606d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:34:56.878360 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c60333-63fb-4f85-81f1-160797f606d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:34:56.878628 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c60333-63fb-4f85-81f1-160797f606d6 admin admin] PATH_INFO: `/v3/projects/3610260ba6cc4716935b6a6149e3ef76/users/f76a74e6b8f1498ab611b77a487cf94d/roles/79f90a0bf6ea43d0b3c434e31556253a` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:34:56.893487 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c60333-63fb-4f85-81f1-160797f606d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3610260ba6cc4716935b6a6149e3ef76, user_id=f76a74e6b8f1498ab611b77a487cf94d, role_id=79f90a0bf6ea43d0b3c434e31556253a)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:34:56.896443 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c60333-63fb-4f85-81f1-160797f606d6 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:34:56.909382 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1238/2461] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:34:56 2022] PUT /identity/v3/projects/3610260ba6cc4716935b6a6149e3ef76/users/f76a74e6b8f1498ab611b77a487cf94d/roles/79f90a0bf6ea43d0b3c434e31556253a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:34:56.919742 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e759557-4bb0-43cb-8cf7-baefdab4dd1e None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:34:56.920055 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e759557-4bb0-43cb-8cf7-baefdab4dd1e None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:34:56.920327 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e759557-4bb0-43cb-8cf7-baefdab4dd1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:34:56.947714 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-4e759557-4bb0-43cb-8cf7-baefdab4dd1e None None] MFA Rules not processed for user `f76a74e6b8f1498ab611b77a487cf94d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:34:56.948976 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-4e759557-4bb0-43cb-8cf7-baefdab4dd1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:34:57.013744 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1224/2462] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:34:56 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:34:57.018155 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c60333-63fb-4f85-81f1-160797f606d6 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:34:57.076349 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c60333-63fb-4f85-81f1-160797f606d6 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:34:57.080863 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47460dee-b7b8-4853-b086-078c0d0fd2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:34:57.081494 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47460dee-b7b8-4853-b086-078c0d0fd2d0 admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:34:57.081772 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47460dee-b7b8-4853-b086-078c0d0fd2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:34:57.082044 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47460dee-b7b8-4853-b086-078c0d0fd2d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:34:57.082708 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47460dee-b7b8-4853-b086-078c0d0fd2d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:34:57.084911 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47460dee-b7b8-4853-b086-078c0d0fd2d0 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:34:57.109056 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1239/2463] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:34:57 2022] POST /identity/v3/projects => generated 381 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:34:57.113220 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e759557-4bb0-43cb-8cf7-baefdab4dd1e None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:34:57.124224 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e759557-4bb0-43cb-8cf7-baefdab4dd1e None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:34:57.178043 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cdaf6b-f451-4657-9a50-b8534d325ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:34:57.178720 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cdaf6b-f451-4657-9a50-b8534d325ead admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:34:57.178992 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cdaf6b-f451-4657-9a50-b8534d325ead admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:34:57.179253 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cdaf6b-f451-4657-9a50-b8534d325ead admin admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:34:57.179953 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cdaf6b-f451-4657-9a50-b8534d325ead admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:34:57.181871 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cdaf6b-f451-4657-9a50-b8534d325ead admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:34:57.200917 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1225/2464] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:34:57 2022] POST /identity/v3/users => generated 297 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:34:57.204864 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47460dee-b7b8-4853-b086-078c0d0fd2d0 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:34:57.215162 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47460dee-b7b8-4853-b086-078c0d0fd2d0 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:34:57.219739 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e4ea9c-f4c4-4cf3-8381-aecb9b0d7055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:34:57.220385 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4ea9c-f4c4-4cf3-8381-aecb9b0d7055 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:34:57.220664 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4ea9c-f4c4-4cf3-8381-aecb9b0d7055 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:34:57.220938 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4ea9c-f4c4-4cf3-8381-aecb9b0d7055 admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:34:57.221652 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e4ea9c-f4c4-4cf3-8381-aecb9b0d7055 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:34:57.223244 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e4ea9c-f4c4-4cf3-8381-aecb9b0d7055 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:34:57.234086 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1240/2465] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:34:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:34:57.238331 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cdaf6b-f451-4657-9a50-b8534d325ead admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:34:57.249260 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cdaf6b-f451-4657-9a50-b8534d325ead admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:34:57.253784 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a9d597-f40f-4732-9447-9a7d01ac4216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:34:57.254637 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9d597-f40f-4732-9447-9a7d01ac4216 admin admin] REQUEST_METHOD: `PUT` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:34:57.254911 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9d597-f40f-4732-9447-9a7d01ac4216 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:34:57.255336 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9d597-f40f-4732-9447-9a7d01ac4216 admin admin] PATH_INFO: `/v3/projects/dfcbd3fbe6da46f6ab3840707f61bda5/users/f5e33d78e57f44b080e62cc1431a17aa/roles/274130b78e304bb88789c1b349263f3c` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:34:57.269802 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a9d597-f40f-4732-9447-9a7d01ac4216 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfcbd3fbe6da46f6ab3840707f61bda5, user_id=f5e33d78e57f44b080e62cc1431a17aa, role_id=274130b78e304bb88789c1b349263f3c)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:34:57.272812 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a9d597-f40f-4732-9447-9a7d01ac4216 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:34:57.285380 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1226/2466] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:34:57 2022] PUT /identity/v3/projects/dfcbd3fbe6da46f6ab3840707f61bda5/users/f5e33d78e57f44b080e62cc1431a17aa/roles/274130b78e304bb88789c1b349263f3c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:34:57.290187 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e4ea9c-f4c4-4cf3-8381-aecb9b0d7055 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:34:57.299818 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e4ea9c-f4c4-4cf3-8381-aecb9b0d7055 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:34:57.353575 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6978abab-8741-4050-a530-8709389d4526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:34:57.354224 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6978abab-8741-4050-a530-8709389d4526 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:34:57.354503 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6978abab-8741-4050-a530-8709389d4526 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:34:57.354775 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6978abab-8741-4050-a530-8709389d4526 admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:34:57.355541 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6978abab-8741-4050-a530-8709389d4526 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:34:57.357382 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6978abab-8741-4050-a530-8709389d4526 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:34:57.367659 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1241/2467] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:34:57 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:34:57.371786 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a9d597-f40f-4732-9447-9a7d01ac4216 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:34:57.381937 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a9d597-f40f-4732-9447-9a7d01ac4216 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:34:57.386729 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987d41a-c117-4af4-ab83-89a3aa66b875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:34:57.387652 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987d41a-c117-4af4-ab83-89a3aa66b875 admin admin] REQUEST_METHOD: `PUT` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:34:57.387931 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987d41a-c117-4af4-ab83-89a3aa66b875 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:34:57.388202 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987d41a-c117-4af4-ab83-89a3aa66b875 admin admin] PATH_INFO: `/v3/projects/dfcbd3fbe6da46f6ab3840707f61bda5/users/f5e33d78e57f44b080e62cc1431a17aa/roles/274130b78e304bb88789c1b349263f3c` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:34:57.390139 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8987d41a-c117-4af4-ab83-89a3aa66b875 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfcbd3fbe6da46f6ab3840707f61bda5, user_id=f5e33d78e57f44b080e62cc1431a17aa, role_id=274130b78e304bb88789c1b349263f3c)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:34:57.392810 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8987d41a-c117-4af4-ab83-89a3aa66b875 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:34:57.403384 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1227/2468] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:34:57 2022] PUT /identity/v3/projects/dfcbd3fbe6da46f6ab3840707f61bda5/users/f5e33d78e57f44b080e62cc1431a17aa/roles/274130b78e304bb88789c1b349263f3c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:34:57.414949 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ef416-cff2-4fa5-92b1-91a2341f659f None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:34:57.415240 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ef416-cff2-4fa5-92b1-91a2341f659f None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:34:57.415567 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ef416-cff2-4fa5-92b1-91a2341f659f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:34:57.441875 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-9f8ef416-cff2-4fa5-92b1-91a2341f659f None None] MFA Rules not processed for user `f5e33d78e57f44b080e62cc1431a17aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:34:57.443222 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-9f8ef416-cff2-4fa5-92b1-91a2341f659f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:34:57.508176 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1242/2469] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:34:57 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:34:57.519550 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987d41a-c117-4af4-ab83-89a3aa66b875 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:34:57.521745 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-8987d41a-c117-4af4-ab83-89a3aa66b875 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:34:57.577777 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987d41a-c117-4af4-ab83-89a3aa66b875 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:34:57.581887 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f2b7a5-bb53-454a-8f76-8e3efc1b6df0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d65e731386d44948dcc1ecd40cbda65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:34:57.582014 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f2b7a5-bb53-454a-8f76-8e3efc1b6df0 service cinder] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:34:57.582252 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f2b7a5-bb53-454a-8f76-8e3efc1b6df0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:34:57.582520 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f2b7a5-bb53-454a-8f76-8e3efc1b6df0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:34:57.592080 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f2b7a5-bb53-454a-8f76-8e3efc1b6df0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:34:57.593495 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f2b7a5-bb53-454a-8f76-8e3efc1b6df0 service cinder] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:34:57.603458 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1228/2470] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:34:57 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:34:57.673055 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8ef416-cff2-4fa5-92b1-91a2341f659f None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:34:57.682347 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8ef416-cff2-4fa5-92b1-91a2341f659f None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:34:57.685963 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe8d23a-e115-4337-9a97-552da0f1bfe7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d65e731386d44948dcc1ecd40cbda65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:34:57.686590 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8d23a-e115-4337-9a97-552da0f1bfe7 service cinder] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:34:57.686872 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8d23a-e115-4337-9a97-552da0f1bfe7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:34:57.687142 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8d23a-e115-4337-9a97-552da0f1bfe7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:34:57.741173 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe8d23a-e115-4337-9a97-552da0f1bfe7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:34:57.742598 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe8d23a-e115-4337-9a97-552da0f1bfe7 service cinder] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:34:57.751365 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1243/2471] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:34:57 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:35:07.464267 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f2b7a5-bb53-454a-8f76-8e3efc1b6df0 service cinder] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:07.525562 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f2b7a5-bb53-454a-8f76-8e3efc1b6df0 service cinder] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:07.530065 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae56b79-575c-4f6c-a89d-6bb4900c1680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:07.530908 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae56b79-575c-4f6c-a89d-6bb4900c1680 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:07.531180 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae56b79-575c-4f6c-a89d-6bb4900c1680 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:07.531479 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae56b79-575c-4f6c-a89d-6bb4900c1680 admin admin] PATH_INFO: `/v3/users/f76a74e6b8f1498ab611b77a487cf94d` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:07.532678 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae56b79-575c-4f6c-a89d-6bb4900c1680 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f76a74e6b8f1498ab611b77a487cf94d)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:07.534587 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae56b79-575c-4f6c-a89d-6bb4900c1680 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:07.578953 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-3ae56b79-575c-4f6c-a89d-6bb4900c1680 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f76a74e6b8f1498ab611b77a487cf94d'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:07.586150 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-3ae56b79-575c-4f6c-a89d-6bb4900c1680 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f76a74e6b8f1498ab611b77a487cf94d'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:07.592368 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-3ae56b79-575c-4f6c-a89d-6bb4900c1680 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f76a74e6b8f1498ab611b77a487cf94d'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:07.593081 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-3ae56b79-575c-4f6c-a89d-6bb4900c1680 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f76a74e6b8f1498ab611b77a487cf94d'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:07.593675 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-3ae56b79-575c-4f6c-a89d-6bb4900c1680 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f76a74e6b8f1498ab611b77a487cf94d'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:07.609895 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1229/2472] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:35:07 2022] DELETE /identity/v3/users/f76a74e6b8f1498ab611b77a487cf94d => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:35:07.614751 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ce67a-b483-4919-9e3f-389ec3fbfe9a None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:07.615344 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ce67a-b483-4919-9e3f-389ec3fbfe9a None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:07.615344 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ce67a-b483-4919-9e3f-389ec3fbfe9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:07.632414 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-309ce67a-b483-4919-9e3f-389ec3fbfe9a None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:35:07.633604 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-309ce67a-b483-4919-9e3f-389ec3fbfe9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:07.691273 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1244/2473] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:35:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:35:07.701845 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae56b79-575c-4f6c-a89d-6bb4900c1680 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:07.703193 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-3ae56b79-575c-4f6c-a89d-6bb4900c1680 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:07.763832 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae56b79-575c-4f6c-a89d-6bb4900c1680 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:07.767597 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9727ac41-f875-4947-ba07-548c1e1e2e9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:07.768245 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9727ac41-f875-4947-ba07-548c1e1e2e9e service neutron] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:07.768524 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9727ac41-f875-4947-ba07-548c1e1e2e9e service neutron] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:07.768794 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9727ac41-f875-4947-ba07-548c1e1e2e9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:07.780197 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9727ac41-f875-4947-ba07-548c1e1e2e9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:07.781638 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9727ac41-f875-4947-ba07-548c1e1e2e9e service neutron] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:07.792872 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1230/2474] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:35:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:35:08.096481 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309ce67a-b483-4919-9e3f-389ec3fbfe9a None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:08.098257 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-309ce67a-b483-4919-9e3f-389ec3fbfe9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:08.112243 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309ce67a-b483-4919-9e3f-389ec3fbfe9a None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:08.117768 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ecee4-5832-4cd1-9643-13802191b5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:08.118618 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ecee4-5832-4cd1-9643-13802191b5ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:08.118893 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ecee4-5832-4cd1-9643-13802191b5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:08.119160 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ecee4-5832-4cd1-9643-13802191b5ff admin admin] PATH_INFO: `/v3/projects/3610260ba6cc4716935b6a6149e3ef76` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:08.120364 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018ecee4-5832-4cd1-9643-13802191b5ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=3610260ba6cc4716935b6a6149e3ef76)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:08.122255 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018ecee4-5832-4cd1-9643-13802191b5ff admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:08.169558 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-018ecee4-5832-4cd1-9643-13802191b5ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3610260ba6cc4716935b6a6149e3ef76', 'request_id': 'req-018ecee4-5832-4cd1-9643-13802191b5ff'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:08.175424 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-018ecee4-5832-4cd1-9643-13802191b5ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3610260ba6cc4716935b6a6149e3ef76', 'request_id': 'req-018ecee4-5832-4cd1-9643-13802191b5ff'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:08.181188 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-018ecee4-5832-4cd1-9643-13802191b5ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3610260ba6cc4716935b6a6149e3ef76', 'request_id': 'req-018ecee4-5832-4cd1-9643-13802191b5ff'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:08.193278 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-018ecee4-5832-4cd1-9643-13802191b5ff admin admin] The token cache is being invalidate because project 3610260ba6cc4716935b6a6149e3ef76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:35:08.193798 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-018ecee4-5832-4cd1-9643-13802191b5ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:08.194509 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-018ecee4-5832-4cd1-9643-13802191b5ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:08.196312 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1245/2475] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:35:08 2022] DELETE /identity/v3/projects/3610260ba6cc4716935b6a6149e3ef76 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:35:08.200520 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9727ac41-f875-4947-ba07-548c1e1e2e9e service neutron] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:08.210062 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9727ac41-f875-4947-ba07-548c1e1e2e9e service neutron] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:08.269867 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1351e83-10bb-4fe6-8cea-abf241d034cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:08.270766 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1351e83-10bb-4fe6-8cea-abf241d034cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:08.271103 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1351e83-10bb-4fe6-8cea-abf241d034cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:08.271476 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1351e83-10bb-4fe6-8cea-abf241d034cc admin admin] PATH_INFO: `/v3/users/f5e33d78e57f44b080e62cc1431a17aa` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:08.272805 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1351e83-10bb-4fe6-8cea-abf241d034cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5e33d78e57f44b080e62cc1431a17aa)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:08.274954 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1351e83-10bb-4fe6-8cea-abf241d034cc admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:08.319689 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-d1351e83-10bb-4fe6-8cea-abf241d034cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5e33d78e57f44b080e62cc1431a17aa'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:08.326533 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-d1351e83-10bb-4fe6-8cea-abf241d034cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5e33d78e57f44b080e62cc1431a17aa'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:08.333521 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-d1351e83-10bb-4fe6-8cea-abf241d034cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5e33d78e57f44b080e62cc1431a17aa'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:08.334117 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-d1351e83-10bb-4fe6-8cea-abf241d034cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5e33d78e57f44b080e62cc1431a17aa'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:08.334705 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-d1351e83-10bb-4fe6-8cea-abf241d034cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5e33d78e57f44b080e62cc1431a17aa'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:08.354320 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1231/2476] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:35:08 2022] DELETE /identity/v3/users/f5e33d78e57f44b080e62cc1431a17aa => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:35:08.617447 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ecee4-5832-4cd1-9643-13802191b5ff admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:08.618916 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-018ecee4-5832-4cd1-9643-13802191b5ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:08.636577 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ecee4-5832-4cd1-9643-13802191b5ff admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:08.691987 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8bcf3b-3987-4e8b-9b24-4d7cf144d02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:08.692869 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8bcf3b-3987-4e8b-9b24-4d7cf144d02a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:08.693140 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8bcf3b-3987-4e8b-9b24-4d7cf144d02a admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:08.693404 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8bcf3b-3987-4e8b-9b24-4d7cf144d02a admin admin] PATH_INFO: `/v3/projects/dfcbd3fbe6da46f6ab3840707f61bda5` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:08.694557 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8bcf3b-3987-4e8b-9b24-4d7cf144d02a admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfcbd3fbe6da46f6ab3840707f61bda5)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:08.696506 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8bcf3b-3987-4e8b-9b24-4d7cf144d02a admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:08.740091 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-4c8bcf3b-3987-4e8b-9b24-4d7cf144d02a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfcbd3fbe6da46f6ab3840707f61bda5', 'request_id': 'req-4c8bcf3b-3987-4e8b-9b24-4d7cf144d02a'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:08.745773 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-4c8bcf3b-3987-4e8b-9b24-4d7cf144d02a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfcbd3fbe6da46f6ab3840707f61bda5', 'request_id': 'req-4c8bcf3b-3987-4e8b-9b24-4d7cf144d02a'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:08.750807 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-4c8bcf3b-3987-4e8b-9b24-4d7cf144d02a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfcbd3fbe6da46f6ab3840707f61bda5', 'request_id': 'req-4c8bcf3b-3987-4e8b-9b24-4d7cf144d02a'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:08.763171 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-4c8bcf3b-3987-4e8b-9b24-4d7cf144d02a admin admin] The token cache is being invalidate because project dfcbd3fbe6da46f6ab3840707f61bda5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:35:08.763483 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-4c8bcf3b-3987-4e8b-9b24-4d7cf144d02a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:08.764095 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-4c8bcf3b-3987-4e8b-9b24-4d7cf144d02a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:08.765591 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1246/2477] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:35:08 2022] DELETE /identity/v3/projects/dfcbd3fbe6da46f6ab3840707f61bda5 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:35:08.771042 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b640c-32d3-4dfa-9c8f-72871ff91d3a None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:08.771526 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b640c-32d3-4dfa-9c8f-72871ff91d3a None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:08.771794 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b640c-32d3-4dfa-9c8f-72871ff91d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:08.789975 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-509b640c-32d3-4dfa-9c8f-72871ff91d3a None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:35:08.791148 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-509b640c-32d3-4dfa-9c8f-72871ff91d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:08.848339 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1232/2478] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:35:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:35:08.857724 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c305b-2768-46da-9e55-0cca131d2815 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:08.858001 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c305b-2768-46da-9e55-0cca131d2815 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:08.858274 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c305b-2768-46da-9e55-0cca131d2815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:08.876363 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-746c305b-2768-46da-9e55-0cca131d2815 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:35:08.877471 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-746c305b-2768-46da-9e55-0cca131d2815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:08.885521 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1247/2479] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:35:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:35:08.889528 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b640c-32d3-4dfa-9c8f-72871ff91d3a None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:08.899636 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b640c-32d3-4dfa-9c8f-72871ff91d3a None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:08.904135 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1fb1a1-9936-4727-a63c-847d835d4a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:08.904770 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1fb1a1-9936-4727-a63c-847d835d4a9a admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:08.905048 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1fb1a1-9936-4727-a63c-847d835d4a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:08.905314 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1fb1a1-9936-4727-a63c-847d835d4a9a admin admin] PATH_INFO: `/v3/domains` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:08.906030 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1fb1a1-9936-4727-a63c-847d835d4a9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:35:08.906330 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1fb1a1-9936-4727-a63c-847d835d4a9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:08.907957 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1fb1a1-9936-4727-a63c-847d835d4a9a admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:08.919072 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1233/2480] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 9 20:35:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:35:08.923353 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746c305b-2768-46da-9e55-0cca131d2815 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:08.933901 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746c305b-2768-46da-9e55-0cca131d2815 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:08.938593 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419e9d45-045f-4ce0-8806-59627941353c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:08.939231 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419e9d45-045f-4ce0-8806-59627941353c admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:08.939558 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419e9d45-045f-4ce0-8806-59627941353c admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:08.939838 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419e9d45-045f-4ce0-8806-59627941353c admin admin] PATH_INFO: `/v3/projects` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:08.940530 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419e9d45-045f-4ce0-8806-59627941353c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:08.943121 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419e9d45-045f-4ce0-8806-59627941353c admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:08.969058 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1248/2481] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:35:08 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:35:08.973083 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1fb1a1-9936-4727-a63c-847d835d4a9a admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:08.983026 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1fb1a1-9936-4727-a63c-847d835d4a9a admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:09.038301 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604379ff-8be8-416c-892c-52120e9176bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:09.038994 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604379ff-8be8-416c-892c-52120e9176bc admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:09.039269 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604379ff-8be8-416c-892c-52120e9176bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:09.039579 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604379ff-8be8-416c-892c-52120e9176bc admin admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:09.040263 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604379ff-8be8-416c-892c-52120e9176bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:09.042186 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604379ff-8be8-416c-892c-52120e9176bc admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:09.061884 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1234/2482] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:35:08 2022] POST /identity/v3/users => generated 292 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:35:09.065731 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419e9d45-045f-4ce0-8806-59627941353c admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:09.076158 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419e9d45-045f-4ce0-8806-59627941353c admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:09.080729 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f38f32c-5ac7-4e26-bb7c-df15ba157f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:09.081374 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f38f32c-5ac7-4e26-bb7c-df15ba157f49 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:09.081653 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f38f32c-5ac7-4e26-bb7c-df15ba157f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:09.081923 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f38f32c-5ac7-4e26-bb7c-df15ba157f49 admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:09.082638 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f38f32c-5ac7-4e26-bb7c-df15ba157f49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:09.084293 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f38f32c-5ac7-4e26-bb7c-df15ba157f49 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:09.094618 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1249/2483] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:35:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:35:09.099150 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604379ff-8be8-416c-892c-52120e9176bc admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:09.108821 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604379ff-8be8-416c-892c-52120e9176bc admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:09.113270 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cf7e1e-fe14-4794-a4da-2ee464c6212a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:09.113899 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf7e1e-fe14-4794-a4da-2ee464c6212a admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:09.115004 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf7e1e-fe14-4794-a4da-2ee464c6212a admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:09.115262 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf7e1e-fe14-4794-a4da-2ee464c6212a admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:09.116005 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cf7e1e-fe14-4794-a4da-2ee464c6212a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:09.117577 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cf7e1e-fe14-4794-a4da-2ee464c6212a admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:09.126994 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1235/2484] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:35:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:35:09.130853 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f38f32c-5ac7-4e26-bb7c-df15ba157f49 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:09.140759 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f38f32c-5ac7-4e26-bb7c-df15ba157f49 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:09.145309 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1a8f69-065e-4f4d-97a4-45fda494feef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:09.146400 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a8f69-065e-4f4d-97a4-45fda494feef admin admin] REQUEST_METHOD: `PUT` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:09.146683 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a8f69-065e-4f4d-97a4-45fda494feef admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:09.146959 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a8f69-065e-4f4d-97a4-45fda494feef admin admin] PATH_INFO: `/v3/projects/6e9c7f0866734ba1bd78991996f5af77/users/771211a4229f4c6fa0bdc67fad8a6ea5/roles/79f90a0bf6ea43d0b3c434e31556253a` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:09.162048 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1a8f69-065e-4f4d-97a4-45fda494feef admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e9c7f0866734ba1bd78991996f5af77, user_id=771211a4229f4c6fa0bdc67fad8a6ea5, role_id=79f90a0bf6ea43d0b3c434e31556253a)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:09.164725 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1a8f69-065e-4f4d-97a4-45fda494feef admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:09.177437 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1250/2485] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:35:09 2022] PUT /identity/v3/projects/6e9c7f0866734ba1bd78991996f5af77/users/771211a4229f4c6fa0bdc67fad8a6ea5/roles/79f90a0bf6ea43d0b3c434e31556253a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:35:09.188672 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230eca2-545f-4334-ba99-92d91c3b891f None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:09.188959 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230eca2-545f-4334-ba99-92d91c3b891f None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:09.189230 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230eca2-545f-4334-ba99-92d91c3b891f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:09.214477 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-2230eca2-545f-4334-ba99-92d91c3b891f None None] MFA Rules not processed for user `771211a4229f4c6fa0bdc67fad8a6ea5`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:35:09.215757 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-2230eca2-545f-4334-ba99-92d91c3b891f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:09.276798 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1236/2486] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:35:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:35:09.281448 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1a8f69-065e-4f4d-97a4-45fda494feef admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:09.340932 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1a8f69-065e-4f4d-97a4-45fda494feef admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:09.345504 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45db587e-a4e9-4aa7-9805-500c54b138e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:09.346147 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db587e-a4e9-4aa7-9805-500c54b138e4 admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:09.346431 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db587e-a4e9-4aa7-9805-500c54b138e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:09.346707 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db587e-a4e9-4aa7-9805-500c54b138e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:09.347412 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45db587e-a4e9-4aa7-9805-500c54b138e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:09.350044 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45db587e-a4e9-4aa7-9805-500c54b138e4 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:09.374741 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1251/2487] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:35:09 2022] POST /identity/v3/projects => generated 385 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:35:09.378794 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2230eca2-545f-4334-ba99-92d91c3b891f None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:09.389558 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2230eca2-545f-4334-ba99-92d91c3b891f None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:09.441769 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b71f6a-03be-42cc-86c0-b06405989549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:09.442433 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b71f6a-03be-42cc-86c0-b06405989549 admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:09.442707 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b71f6a-03be-42cc-86c0-b06405989549 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:09.442973 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b71f6a-03be-42cc-86c0-b06405989549 admin admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:09.443696 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b71f6a-03be-42cc-86c0-b06405989549 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:09.445603 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b71f6a-03be-42cc-86c0-b06405989549 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:09.464912 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1237/2488] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:35:09 2022] POST /identity/v3/users => generated 299 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 20:35:09.468811 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45db587e-a4e9-4aa7-9805-500c54b138e4 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:09.479240 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45db587e-a4e9-4aa7-9805-500c54b138e4 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:09.483729 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed330eb5-ee48-40c9-8fd9-5b5db2a3e088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:09.484368 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed330eb5-ee48-40c9-8fd9-5b5db2a3e088 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:09.484645 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed330eb5-ee48-40c9-8fd9-5b5db2a3e088 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:09.484914 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed330eb5-ee48-40c9-8fd9-5b5db2a3e088 admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:09.485620 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed330eb5-ee48-40c9-8fd9-5b5db2a3e088 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:09.487189 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed330eb5-ee48-40c9-8fd9-5b5db2a3e088 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:09.497339 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1252/2489] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:35:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:35:09.501321 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b71f6a-03be-42cc-86c0-b06405989549 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:09.511360 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b71f6a-03be-42cc-86c0-b06405989549 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:09.516112 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01a1ff0-eda6-4c8c-a4d2-334284d2a4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:09.516972 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a1ff0-eda6-4c8c-a4d2-334284d2a4e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:09.517250 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a1ff0-eda6-4c8c-a4d2-334284d2a4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:09.517522 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a1ff0-eda6-4c8c-a4d2-334284d2a4e9 admin admin] PATH_INFO: `/v3/projects/57b766dacd6040fca7b09b34a895028e/users/11268f04a3684ae1893618a8a1b894d8/roles/274130b78e304bb88789c1b349263f3c` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:09.533335 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01a1ff0-eda6-4c8c-a4d2-334284d2a4e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57b766dacd6040fca7b09b34a895028e, user_id=11268f04a3684ae1893618a8a1b894d8, role_id=274130b78e304bb88789c1b349263f3c)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:09.536680 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01a1ff0-eda6-4c8c-a4d2-334284d2a4e9 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:09.549037 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1238/2490] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:35:09 2022] PUT /identity/v3/projects/57b766dacd6040fca7b09b34a895028e/users/11268f04a3684ae1893618a8a1b894d8/roles/274130b78e304bb88789c1b349263f3c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:35:09.553579 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed330eb5-ee48-40c9-8fd9-5b5db2a3e088 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:09.563678 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed330eb5-ee48-40c9-8fd9-5b5db2a3e088 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:09.623724 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea63d2-8255-406f-9405-4a8a30cb3afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:09.624395 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea63d2-8255-406f-9405-4a8a30cb3afa admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:09.624648 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea63d2-8255-406f-9405-4a8a30cb3afa admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:09.624918 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea63d2-8255-406f-9405-4a8a30cb3afa admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:09.625621 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ea63d2-8255-406f-9405-4a8a30cb3afa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:09.627190 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ea63d2-8255-406f-9405-4a8a30cb3afa admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:09.636903 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1253/2491] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:35:09 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:35:09.641036 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01a1ff0-eda6-4c8c-a4d2-334284d2a4e9 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:09.651616 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01a1ff0-eda6-4c8c-a4d2-334284d2a4e9 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:09.656457 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0fd070-0cf5-49b7-ac0e-2304ca69a3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:09.657320 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0fd070-0cf5-49b7-ac0e-2304ca69a3e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:09.657600 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0fd070-0cf5-49b7-ac0e-2304ca69a3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:09.657877 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0fd070-0cf5-49b7-ac0e-2304ca69a3e8 admin admin] PATH_INFO: `/v3/projects/57b766dacd6040fca7b09b34a895028e/users/11268f04a3684ae1893618a8a1b894d8/roles/274130b78e304bb88789c1b349263f3c` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:09.659893 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0fd070-0cf5-49b7-ac0e-2304ca69a3e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57b766dacd6040fca7b09b34a895028e, user_id=11268f04a3684ae1893618a8a1b894d8, role_id=274130b78e304bb88789c1b349263f3c)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:09.663284 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0fd070-0cf5-49b7-ac0e-2304ca69a3e8 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:09.673494 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1239/2492] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:35:09 2022] PUT /identity/v3/projects/57b766dacd6040fca7b09b34a895028e/users/11268f04a3684ae1893618a8a1b894d8/roles/274130b78e304bb88789c1b349263f3c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:35:09.683689 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e115e112-077e-4bd2-a0d0-06f35524a92e None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:09.683980 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e115e112-077e-4bd2-a0d0-06f35524a92e None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:09.684257 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e115e112-077e-4bd2-a0d0-06f35524a92e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:09.709888 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-e115e112-077e-4bd2-a0d0-06f35524a92e None None] MFA Rules not processed for user `11268f04a3684ae1893618a8a1b894d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:35:09.711076 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-e115e112-077e-4bd2-a0d0-06f35524a92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:09.776989 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1254/2493] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:35:09 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:35:09.787589 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0fd070-0cf5-49b7-ac0e-2304ca69a3e8 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:09.789320 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-4e0fd070-0cf5-49b7-ac0e-2304ca69a3e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:09.842338 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0fd070-0cf5-49b7-ac0e-2304ca69a3e8 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:09.845883 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afe00bf-e72d-4764-a136-668e1aacb24d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d65e731386d44948dcc1ecd40cbda65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:09.846502 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe00bf-e72d-4764-a136-668e1aacb24d service cinder] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:09.846775 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe00bf-e72d-4764-a136-668e1aacb24d service cinder] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:09.847042 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe00bf-e72d-4764-a136-668e1aacb24d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:09.856667 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afe00bf-e72d-4764-a136-668e1aacb24d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:09.858087 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afe00bf-e72d-4764-a136-668e1aacb24d service cinder] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:09.867258 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1240/2494] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:35:09 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 09 20:35:10.417097 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e115e112-077e-4bd2-a0d0-06f35524a92e None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:10.478865 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e115e112-077e-4bd2-a0d0-06f35524a92e None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:10.483535 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fa62d1-fa7e-4ccb-b85b-ff58cf8df7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:10.484390 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa62d1-fa7e-4ccb-b85b-ff58cf8df7ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:10.484664 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa62d1-fa7e-4ccb-b85b-ff58cf8df7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:10.484927 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa62d1-fa7e-4ccb-b85b-ff58cf8df7ee admin admin] PATH_INFO: `/v3/users/771211a4229f4c6fa0bdc67fad8a6ea5` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:10.486096 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fa62d1-fa7e-4ccb-b85b-ff58cf8df7ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=771211a4229f4c6fa0bdc67fad8a6ea5)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:10.488045 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fa62d1-fa7e-4ccb-b85b-ff58cf8df7ee admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:10.533670 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-c6fa62d1-fa7e-4ccb-b85b-ff58cf8df7ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '771211a4229f4c6fa0bdc67fad8a6ea5'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:10.534318 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-c6fa62d1-fa7e-4ccb-b85b-ff58cf8df7ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '771211a4229f4c6fa0bdc67fad8a6ea5'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:10.541572 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-c6fa62d1-fa7e-4ccb-b85b-ff58cf8df7ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '771211a4229f4c6fa0bdc67fad8a6ea5'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:10.542192 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-c6fa62d1-fa7e-4ccb-b85b-ff58cf8df7ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '771211a4229f4c6fa0bdc67fad8a6ea5'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:10.549287 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-c6fa62d1-fa7e-4ccb-b85b-ff58cf8df7ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '771211a4229f4c6fa0bdc67fad8a6ea5'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:10.566491 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1255/2495] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:35:10 2022] DELETE /identity/v3/users/771211a4229f4c6fa0bdc67fad8a6ea5 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:35:10.570986 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fddbf76-1e47-40f7-826e-aac6a1bc7564 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:10.571266 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fddbf76-1e47-40f7-826e-aac6a1bc7564 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:10.571650 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fddbf76-1e47-40f7-826e-aac6a1bc7564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:10.588826 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-8fddbf76-1e47-40f7-826e-aac6a1bc7564 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:35:10.589997 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-8fddbf76-1e47-40f7-826e-aac6a1bc7564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:10.646355 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1241/2496] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:35:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:35:10.656066 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fa62d1-fa7e-4ccb-b85b-ff58cf8df7ee admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:10.657517 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-c6fa62d1-fa7e-4ccb-b85b-ff58cf8df7ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:10.714401 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fa62d1-fa7e-4ccb-b85b-ff58cf8df7ee admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:10.718102 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e2b6b4-7168-48e6-a52c-8b83d073c640 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:10.718748 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2b6b4-7168-48e6-a52c-8b83d073c640 service neutron] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:10.719028 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2b6b4-7168-48e6-a52c-8b83d073c640 service neutron] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:10.719300 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2b6b4-7168-48e6-a52c-8b83d073c640 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:10.729026 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e2b6b4-7168-48e6-a52c-8b83d073c640 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:10.730451 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e2b6b4-7168-48e6-a52c-8b83d073c640 service neutron] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:10.740391 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1256/2497] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:35:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:35:10.995837 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fddbf76-1e47-40f7-826e-aac6a1bc7564 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:10.997329 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-8fddbf76-1e47-40f7-826e-aac6a1bc7564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:11.009355 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fddbf76-1e47-40f7-826e-aac6a1bc7564 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:11.014240 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0872fb22-b22e-41e5-8fe2-93f9e785559b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:11.015068 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0872fb22-b22e-41e5-8fe2-93f9e785559b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:11.015337 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0872fb22-b22e-41e5-8fe2-93f9e785559b admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:11.015633 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0872fb22-b22e-41e5-8fe2-93f9e785559b admin admin] PATH_INFO: `/v3/projects/6e9c7f0866734ba1bd78991996f5af77` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:11.016796 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0872fb22-b22e-41e5-8fe2-93f9e785559b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e9c7f0866734ba1bd78991996f5af77)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:11.018706 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0872fb22-b22e-41e5-8fe2-93f9e785559b admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:11.063790 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-0872fb22-b22e-41e5-8fe2-93f9e785559b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e9c7f0866734ba1bd78991996f5af77', 'request_id': 'req-0872fb22-b22e-41e5-8fe2-93f9e785559b'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:11.069827 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-0872fb22-b22e-41e5-8fe2-93f9e785559b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e9c7f0866734ba1bd78991996f5af77', 'request_id': 'req-0872fb22-b22e-41e5-8fe2-93f9e785559b'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:11.074943 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-0872fb22-b22e-41e5-8fe2-93f9e785559b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e9c7f0866734ba1bd78991996f5af77', 'request_id': 'req-0872fb22-b22e-41e5-8fe2-93f9e785559b'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:11.086918 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-0872fb22-b22e-41e5-8fe2-93f9e785559b admin admin] The token cache is being invalidate because project 6e9c7f0866734ba1bd78991996f5af77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:35:11.087206 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-0872fb22-b22e-41e5-8fe2-93f9e785559b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:11.087831 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-0872fb22-b22e-41e5-8fe2-93f9e785559b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:11.089578 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1242/2498] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:35:10 2022] DELETE /identity/v3/projects/6e9c7f0866734ba1bd78991996f5af77 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:35:11.093433 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e2b6b4-7168-48e6-a52c-8b83d073c640 service neutron] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:11.104290 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e2b6b4-7168-48e6-a52c-8b83d073c640 service neutron] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:11.158296 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d8bb12-6817-4649-870f-3196ed74aeb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:11.159104 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8bb12-6817-4649-870f-3196ed74aeb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:11.159383 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8bb12-6817-4649-870f-3196ed74aeb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:11.159689 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8bb12-6817-4649-870f-3196ed74aeb5 admin admin] PATH_INFO: `/v3/users/11268f04a3684ae1893618a8a1b894d8` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:11.160868 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d8bb12-6817-4649-870f-3196ed74aeb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11268f04a3684ae1893618a8a1b894d8)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:11.163364 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d8bb12-6817-4649-870f-3196ed74aeb5 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:11.206061 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-a1d8bb12-6817-4649-870f-3196ed74aeb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11268f04a3684ae1893618a8a1b894d8'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:11.206695 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-a1d8bb12-6817-4649-870f-3196ed74aeb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11268f04a3684ae1893618a8a1b894d8'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:11.213785 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-a1d8bb12-6817-4649-870f-3196ed74aeb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11268f04a3684ae1893618a8a1b894d8'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:11.214431 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-a1d8bb12-6817-4649-870f-3196ed74aeb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11268f04a3684ae1893618a8a1b894d8'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:11.221435 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-a1d8bb12-6817-4649-870f-3196ed74aeb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11268f04a3684ae1893618a8a1b894d8'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:11.238282 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1257/2499] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:35:11 2022] DELETE /identity/v3/users/11268f04a3684ae1893618a8a1b894d8 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:35:11.498698 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0872fb22-b22e-41e5-8fe2-93f9e785559b admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:11.500223 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-0872fb22-b22e-41e5-8fe2-93f9e785559b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:11.514262 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0872fb22-b22e-41e5-8fe2-93f9e785559b admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:11.568887 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52be8b54-244f-4386-ab10-aa275cce3d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:11.569732 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be8b54-244f-4386-ab10-aa275cce3d7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:11.570003 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be8b54-244f-4386-ab10-aa275cce3d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:11.570283 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be8b54-244f-4386-ab10-aa275cce3d7c admin admin] PATH_INFO: `/v3/projects/57b766dacd6040fca7b09b34a895028e` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:11.571468 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52be8b54-244f-4386-ab10-aa275cce3d7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=57b766dacd6040fca7b09b34a895028e)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:11.573373 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52be8b54-244f-4386-ab10-aa275cce3d7c admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:11.617514 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-52be8b54-244f-4386-ab10-aa275cce3d7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57b766dacd6040fca7b09b34a895028e', 'request_id': 'req-52be8b54-244f-4386-ab10-aa275cce3d7c'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:11.623291 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-52be8b54-244f-4386-ab10-aa275cce3d7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57b766dacd6040fca7b09b34a895028e', 'request_id': 'req-52be8b54-244f-4386-ab10-aa275cce3d7c'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:11.628460 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-52be8b54-244f-4386-ab10-aa275cce3d7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57b766dacd6040fca7b09b34a895028e', 'request_id': 'req-52be8b54-244f-4386-ab10-aa275cce3d7c'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:11.641385 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-52be8b54-244f-4386-ab10-aa275cce3d7c admin admin] The token cache is being invalidate because project 57b766dacd6040fca7b09b34a895028e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:35:11.641666 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-52be8b54-244f-4386-ab10-aa275cce3d7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:11.642266 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-52be8b54-244f-4386-ab10-aa275cce3d7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:11.643818 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1243/2500] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:35:11 2022] DELETE /identity/v3/projects/57b766dacd6040fca7b09b34a895028e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:35:11.648779 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b79e485-a6d0-4064-b293-29e1eb1d8e07 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:11.649068 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b79e485-a6d0-4064-b293-29e1eb1d8e07 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:11.649343 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b79e485-a6d0-4064-b293-29e1eb1d8e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:11.667540 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-7b79e485-a6d0-4064-b293-29e1eb1d8e07 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:35:11.668726 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-7b79e485-a6d0-4064-b293-29e1eb1d8e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:11.724570 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1258/2501] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:35:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:35:11.732252 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f26a21-c743-4159-bd25-45c211320008 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:11.732532 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f26a21-c743-4159-bd25-45c211320008 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:11.732800 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f26a21-c743-4159-bd25-45c211320008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:11.750623 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-89f26a21-c743-4159-bd25-45c211320008 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:35:11.751771 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-89f26a21-c743-4159-bd25-45c211320008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:11.760529 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1244/2502] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:35:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:35:11.764484 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b79e485-a6d0-4064-b293-29e1eb1d8e07 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:11.773869 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b79e485-a6d0-4064-b293-29e1eb1d8e07 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:11.778353 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687337fb-cc05-4896-b735-54308cae99e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:11.778982 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687337fb-cc05-4896-b735-54308cae99e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:11.779261 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687337fb-cc05-4896-b735-54308cae99e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:11.779571 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687337fb-cc05-4896-b735-54308cae99e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:11.780292 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687337fb-cc05-4896-b735-54308cae99e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:35:11.780591 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687337fb-cc05-4896-b735-54308cae99e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:11.782166 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687337fb-cc05-4896-b735-54308cae99e9 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:11.793141 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1259/2503] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 9 20:35:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:35:11.797336 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f26a21-c743-4159-bd25-45c211320008 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:11.806933 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f26a21-c743-4159-bd25-45c211320008 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:11.811482 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac6aade-8869-4cc9-9e64-88f53538ba3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:11.812115 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6aade-8869-4cc9-9e64-88f53538ba3f admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:11.812474 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6aade-8869-4cc9-9e64-88f53538ba3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:11.812748 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6aade-8869-4cc9-9e64-88f53538ba3f admin admin] PATH_INFO: `/v3/projects` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:11.813421 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac6aade-8869-4cc9-9e64-88f53538ba3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:11.815307 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac6aade-8869-4cc9-9e64-88f53538ba3f admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:11.840014 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1245/2504] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:35:11 2022] POST /identity/v3/projects => generated 383 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:35:11.844103 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687337fb-cc05-4896-b735-54308cae99e9 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:11.853592 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687337fb-cc05-4896-b735-54308cae99e9 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:11.906662 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94acbc35-de7e-45a1-ba23-c65022a2adf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:11.907304 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94acbc35-de7e-45a1-ba23-c65022a2adf2 admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:11.907610 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94acbc35-de7e-45a1-ba23-c65022a2adf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:11.907880 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94acbc35-de7e-45a1-ba23-c65022a2adf2 admin admin] PATH_INFO: `/v3/users` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:11.908552 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94acbc35-de7e-45a1-ba23-c65022a2adf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:11.910464 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94acbc35-de7e-45a1-ba23-c65022a2adf2 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:11.931030 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1260/2505] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:35:11 2022] POST /identity/v3/users => generated 292 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:35:11.935123 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac6aade-8869-4cc9-9e64-88f53538ba3f admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:11.948365 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac6aade-8869-4cc9-9e64-88f53538ba3f admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:11.955249 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b3cf06-b781-456d-b176-9d3679221ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:11.956202 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3cf06-b781-456d-b176-9d3679221ebc admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:11.956555 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3cf06-b781-456d-b176-9d3679221ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:11.956925 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3cf06-b781-456d-b176-9d3679221ebc admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:11.958196 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b3cf06-b781-456d-b176-9d3679221ebc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:11.960121 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b3cf06-b781-456d-b176-9d3679221ebc admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:11.970645 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1246/2506] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:35:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:35:11.974710 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94acbc35-de7e-45a1-ba23-c65022a2adf2 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:11.984364 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94acbc35-de7e-45a1-ba23-c65022a2adf2 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:11.988904 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aa99ff-4f95-480b-b331-534781b49c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:11.990286 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa99ff-4f95-480b-b331-534781b49c18 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:11.990567 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa99ff-4f95-480b-b331-534781b49c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:11.990839 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa99ff-4f95-480b-b331-534781b49c18 admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:11.991601 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aa99ff-4f95-480b-b331-534781b49c18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:11.993341 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aa99ff-4f95-480b-b331-534781b49c18 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:12.006138 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1261/2507] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:35:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:35:12.010206 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b3cf06-b781-456d-b176-9d3679221ebc admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:12.020523 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b3cf06-b781-456d-b176-9d3679221ebc admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:12.025146 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d49dc9-2954-410b-8f2f-8c143224f54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:12.026002 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d49dc9-2954-410b-8f2f-8c143224f54d admin admin] REQUEST_METHOD: `PUT` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:12.026272 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d49dc9-2954-410b-8f2f-8c143224f54d admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:12.026536 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d49dc9-2954-410b-8f2f-8c143224f54d admin admin] PATH_INFO: `/v3/projects/a8907c26a473473591fdc805a585edd1/users/598894fe17e242a78e7f9b9a891f1911/roles/79f90a0bf6ea43d0b3c434e31556253a` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:12.041216 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d49dc9-2954-410b-8f2f-8c143224f54d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8907c26a473473591fdc805a585edd1, user_id=598894fe17e242a78e7f9b9a891f1911, role_id=79f90a0bf6ea43d0b3c434e31556253a)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:12.043902 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d49dc9-2954-410b-8f2f-8c143224f54d admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:12.056644 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1247/2508] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:35:12 2022] PUT /identity/v3/projects/a8907c26a473473591fdc805a585edd1/users/598894fe17e242a78e7f9b9a891f1911/roles/79f90a0bf6ea43d0b3c434e31556253a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:35:12.068017 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef270baa-9894-4267-b004-27246e1250be None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:12.068305 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef270baa-9894-4267-b004-27246e1250be None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:12.068579 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef270baa-9894-4267-b004-27246e1250be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:12.095220 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-ef270baa-9894-4267-b004-27246e1250be None None] MFA Rules not processed for user `598894fe17e242a78e7f9b9a891f1911`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:35:12.096502 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-ef270baa-9894-4267-b004-27246e1250be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:12.158386 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1262/2509] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:35:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:35:12.163562 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d49dc9-2954-410b-8f2f-8c143224f54d admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:12.221931 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d49dc9-2954-410b-8f2f-8c143224f54d admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:12.227072 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51834187-b919-48e4-9bdf-3bc38437c353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:12.227741 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51834187-b919-48e4-9bdf-3bc38437c353 admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:12.228018 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51834187-b919-48e4-9bdf-3bc38437c353 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:12.228285 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51834187-b919-48e4-9bdf-3bc38437c353 admin admin] PATH_INFO: `/v3/projects` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:12.228955 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51834187-b919-48e4-9bdf-3bc38437c353 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:12.230844 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51834187-b919-48e4-9bdf-3bc38437c353 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:12.254500 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1248/2510] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:35:12 2022] POST /identity/v3/projects => generated 383 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:35:12.258703 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef270baa-9894-4267-b004-27246e1250be None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:12.269517 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef270baa-9894-4267-b004-27246e1250be None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:12.323221 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51011bb-b05e-44b6-81da-1e2457bc2d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:12.323886 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51011bb-b05e-44b6-81da-1e2457bc2d18 admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:12.324165 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51011bb-b05e-44b6-81da-1e2457bc2d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:12.324435 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51011bb-b05e-44b6-81da-1e2457bc2d18 admin admin] PATH_INFO: `/v3/users` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:12.325114 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51011bb-b05e-44b6-81da-1e2457bc2d18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:12.327006 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51011bb-b05e-44b6-81da-1e2457bc2d18 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:12.345895 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1263/2511] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:35:12 2022] POST /identity/v3/users => generated 298 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 20:35:12.350508 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51834187-b919-48e4-9bdf-3bc38437c353 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:12.360593 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51834187-b919-48e4-9bdf-3bc38437c353 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:12.365945 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2656f336-a5bb-471d-8c9a-97dc671845d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:12.366589 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656f336-a5bb-471d-8c9a-97dc671845d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:12.366964 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656f336-a5bb-471d-8c9a-97dc671845d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:12.367236 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656f336-a5bb-471d-8c9a-97dc671845d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:12.367989 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2656f336-a5bb-471d-8c9a-97dc671845d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:12.369594 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2656f336-a5bb-471d-8c9a-97dc671845d9 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:12.380001 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1249/2512] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:35:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:35:12.384431 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51011bb-b05e-44b6-81da-1e2457bc2d18 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:12.394208 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51011bb-b05e-44b6-81da-1e2457bc2d18 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:12.399210 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db91df8-a5cf-47d8-9909-0a65a4eda3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:12.400101 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db91df8-a5cf-47d8-9909-0a65a4eda3d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:12.400375 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db91df8-a5cf-47d8-9909-0a65a4eda3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:12.400642 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db91df8-a5cf-47d8-9909-0a65a4eda3d2 admin admin] PATH_INFO: `/v3/projects/11fab8d1e3664bf5a36486b4e210d0e8/users/1ada2265e4bd41418c6c639ed50527ce/roles/274130b78e304bb88789c1b349263f3c` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:12.415212 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db91df8-a5cf-47d8-9909-0a65a4eda3d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11fab8d1e3664bf5a36486b4e210d0e8, user_id=1ada2265e4bd41418c6c639ed50527ce, role_id=274130b78e304bb88789c1b349263f3c)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:12.417868 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db91df8-a5cf-47d8-9909-0a65a4eda3d2 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:12.430305 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1264/2513] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:35:12 2022] PUT /identity/v3/projects/11fab8d1e3664bf5a36486b4e210d0e8/users/1ada2265e4bd41418c6c639ed50527ce/roles/274130b78e304bb88789c1b349263f3c => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:35:12.434173 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2656f336-a5bb-471d-8c9a-97dc671845d9 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:12.443941 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2656f336-a5bb-471d-8c9a-97dc671845d9 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:12.498490 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f69d2bd-d165-46db-9168-b3d2a811bb17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:12.499142 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f69d2bd-d165-46db-9168-b3d2a811bb17 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:12.499442 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f69d2bd-d165-46db-9168-b3d2a811bb17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:12.499715 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f69d2bd-d165-46db-9168-b3d2a811bb17 admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:12.500424 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f69d2bd-d165-46db-9168-b3d2a811bb17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:12.502015 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f69d2bd-d165-46db-9168-b3d2a811bb17 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:12.511839 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1250/2514] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:35:12 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:35:12.515878 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db91df8-a5cf-47d8-9909-0a65a4eda3d2 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:12.526336 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db91df8-a5cf-47d8-9909-0a65a4eda3d2 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:12.530788 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc5a663-2a4a-43f5-a22c-d0b9f88e90be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:12.531684 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5a663-2a4a-43f5-a22c-d0b9f88e90be admin admin] REQUEST_METHOD: `PUT` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:12.531962 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5a663-2a4a-43f5-a22c-d0b9f88e90be admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:12.532232 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5a663-2a4a-43f5-a22c-d0b9f88e90be admin admin] PATH_INFO: `/v3/projects/11fab8d1e3664bf5a36486b4e210d0e8/users/1ada2265e4bd41418c6c639ed50527ce/roles/274130b78e304bb88789c1b349263f3c` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:12.534131 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc5a663-2a4a-43f5-a22c-d0b9f88e90be admin admin] RBAC: Authorizing `identity:create_grant(project_id=11fab8d1e3664bf5a36486b4e210d0e8, user_id=1ada2265e4bd41418c6c639ed50527ce, role_id=274130b78e304bb88789c1b349263f3c)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:12.537730 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc5a663-2a4a-43f5-a22c-d0b9f88e90be admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:12.547358 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1265/2515] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:35:12 2022] PUT /identity/v3/projects/11fab8d1e3664bf5a36486b4e210d0e8/users/1ada2265e4bd41418c6c639ed50527ce/roles/274130b78e304bb88789c1b349263f3c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:35:12.557347 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a200a7b-b52b-401c-86b0-81f0c7152cf6 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:12.557634 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a200a7b-b52b-401c-86b0-81f0c7152cf6 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:12.557937 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a200a7b-b52b-401c-86b0-81f0c7152cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:12.584971 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-3a200a7b-b52b-401c-86b0-81f0c7152cf6 None None] MFA Rules not processed for user `1ada2265e4bd41418c6c639ed50527ce`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:35:12.586172 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-3a200a7b-b52b-401c-86b0-81f0c7152cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:12.650886 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1251/2516] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:35:12 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:35:12.662172 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc5a663-2a4a-43f5-a22c-d0b9f88e90be admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:12.663902 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-6bc5a663-2a4a-43f5-a22c-d0b9f88e90be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:12.718188 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc5a663-2a4a-43f5-a22c-d0b9f88e90be admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:12.721843 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14355f2-b2c0-4757-ba8e-c23d5a1a8018 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d65e731386d44948dcc1ecd40cbda65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:12.722471 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14355f2-b2c0-4757-ba8e-c23d5a1a8018 service cinder] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:12.722753 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14355f2-b2c0-4757-ba8e-c23d5a1a8018 service cinder] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:12.723032 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14355f2-b2c0-4757-ba8e-c23d5a1a8018 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:12.777104 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14355f2-b2c0-4757-ba8e-c23d5a1a8018 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:12.778459 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14355f2-b2c0-4757-ba8e-c23d5a1a8018 service cinder] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:12.787439 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1266/2517] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:35:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:35:16.927300 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a200a7b-b52b-401c-86b0-81f0c7152cf6 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:16.937477 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a200a7b-b52b-401c-86b0-81f0c7152cf6 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:16.941166 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe3bc4f-8a0c-4d23-bdb3-7929642543e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d65e731386d44948dcc1ecd40cbda65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:16.941804 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe3bc4f-8a0c-4d23-bdb3-7929642543e8 service cinder] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:16.942077 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe3bc4f-8a0c-4d23-bdb3-7929642543e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:16.942343 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe3bc4f-8a0c-4d23-bdb3-7929642543e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:16.962964 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe3bc4f-8a0c-4d23-bdb3-7929642543e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:16.964685 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe3bc4f-8a0c-4d23-bdb3-7929642543e8 service cinder] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:16.975473 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1252/2518] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:35:16 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:35:20.954385 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14355f2-b2c0-4757-ba8e-c23d5a1a8018 service cinder] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:20.957168 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-a14355f2-b2c0-4757-ba8e-c23d5a1a8018 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:21.104221 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14355f2-b2c0-4757-ba8e-c23d5a1a8018 service cinder] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:21.111851 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c46a3f1-91f0-4c69-b0df-b663b4060941 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb59440b21074d9da15679dc2d745f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:21.112677 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c46a3f1-91f0-4c69-b0df-b663b4060941 service nova] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:21.113087 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c46a3f1-91f0-4c69-b0df-b663b4060941 service nova] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:21.113471 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c46a3f1-91f0-4c69-b0df-b663b4060941 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:21.115527 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-7c46a3f1-91f0-4c69-b0df-b663b4060941 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:21.129395 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c46a3f1-91f0-4c69-b0df-b663b4060941 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:21.131167 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c46a3f1-91f0-4c69-b0df-b663b4060941 service nova] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:21.144072 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1267/2519] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:35:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:35:21.836883 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe3bc4f-8a0c-4d23-bdb3-7929642543e8 service cinder] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:21.928292 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe3bc4f-8a0c-4d23-bdb3-7929642543e8 service cinder] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:21.933213 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145caaab-b61f-46d2-af2f-65be961f5b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:21.934092 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145caaab-b61f-46d2-af2f-65be961f5b2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:21.934371 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145caaab-b61f-46d2-af2f-65be961f5b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:21.935454 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145caaab-b61f-46d2-af2f-65be961f5b2d admin admin] PATH_INFO: `/v3/users/598894fe17e242a78e7f9b9a891f1911` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:21.936656 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145caaab-b61f-46d2-af2f-65be961f5b2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=598894fe17e242a78e7f9b9a891f1911)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:21.938585 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145caaab-b61f-46d2-af2f-65be961f5b2d admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:22.019690 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-145caaab-b61f-46d2-af2f-65be961f5b2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '598894fe17e242a78e7f9b9a891f1911'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:22.031184 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-145caaab-b61f-46d2-af2f-65be961f5b2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '598894fe17e242a78e7f9b9a891f1911'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:22.044983 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-145caaab-b61f-46d2-af2f-65be961f5b2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '598894fe17e242a78e7f9b9a891f1911'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:22.045963 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-145caaab-b61f-46d2-af2f-65be961f5b2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '598894fe17e242a78e7f9b9a891f1911'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:22.060392 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-145caaab-b61f-46d2-af2f-65be961f5b2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '598894fe17e242a78e7f9b9a891f1911'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:22.085872 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1253/2520] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:35:21 2022] DELETE /identity/v3/users/598894fe17e242a78e7f9b9a891f1911 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:35:22.090255 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adef984-0182-4397-b8f6-b8508d8fa83e None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:22.091220 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adef984-0182-4397-b8f6-b8508d8fa83e None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:22.091728 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adef984-0182-4397-b8f6-b8508d8fa83e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:22.118699 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-1adef984-0182-4397-b8f6-b8508d8fa83e None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:35:22.120462 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-1adef984-0182-4397-b8f6-b8508d8fa83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:22.230075 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1268/2521] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:35:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:35:22.244727 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145caaab-b61f-46d2-af2f-65be961f5b2d admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:22.247349 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-145caaab-b61f-46d2-af2f-65be961f5b2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:22.327259 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145caaab-b61f-46d2-af2f-65be961f5b2d admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:22.331229 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da96cbf2-18bd-4f8c-a02c-3ae480e010bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:22.331902 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da96cbf2-18bd-4f8c-a02c-3ae480e010bb service neutron] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:22.332177 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da96cbf2-18bd-4f8c-a02c-3ae480e010bb service neutron] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:22.332561 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da96cbf2-18bd-4f8c-a02c-3ae480e010bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:22.342526 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da96cbf2-18bd-4f8c-a02c-3ae480e010bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:22.344676 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da96cbf2-18bd-4f8c-a02c-3ae480e010bb service neutron] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:22.355899 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1254/2522] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:35:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:35:22.681697 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adef984-0182-4397-b8f6-b8508d8fa83e None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:22.683214 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-1adef984-0182-4397-b8f6-b8508d8fa83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:22.697914 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adef984-0182-4397-b8f6-b8508d8fa83e None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:22.705554 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81eac31-afa9-489d-bcd0-e686374bfa9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:22.706452 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81eac31-afa9-489d-bcd0-e686374bfa9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:22.706452 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81eac31-afa9-489d-bcd0-e686374bfa9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:22.706681 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81eac31-afa9-489d-bcd0-e686374bfa9a admin admin] PATH_INFO: `/v3/projects/a8907c26a473473591fdc805a585edd1` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:22.707903 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81eac31-afa9-489d-bcd0-e686374bfa9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8907c26a473473591fdc805a585edd1)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:22.709879 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81eac31-afa9-489d-bcd0-e686374bfa9a admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:22.763895 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-c81eac31-afa9-489d-bcd0-e686374bfa9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8907c26a473473591fdc805a585edd1', 'request_id': 'req-c81eac31-afa9-489d-bcd0-e686374bfa9a'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:22.770267 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-c81eac31-afa9-489d-bcd0-e686374bfa9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8907c26a473473591fdc805a585edd1', 'request_id': 'req-c81eac31-afa9-489d-bcd0-e686374bfa9a'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:22.779562 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-c81eac31-afa9-489d-bcd0-e686374bfa9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8907c26a473473591fdc805a585edd1', 'request_id': 'req-c81eac31-afa9-489d-bcd0-e686374bfa9a'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:22.797758 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-c81eac31-afa9-489d-bcd0-e686374bfa9a admin admin] The token cache is being invalidate because project a8907c26a473473591fdc805a585edd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:35:22.798215 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-c81eac31-afa9-489d-bcd0-e686374bfa9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:22.799239 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-c81eac31-afa9-489d-bcd0-e686374bfa9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:22.807251 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1269/2523] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:35:22 2022] DELETE /identity/v3/projects/a8907c26a473473591fdc805a585edd1 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:35:22.812016 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da96cbf2-18bd-4f8c-a02c-3ae480e010bb service neutron] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:22.825678 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da96cbf2-18bd-4f8c-a02c-3ae480e010bb service neutron] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:22.915180 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26af1a86-5ed8-4349-8fcf-32a54223e845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:22.917225 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af1a86-5ed8-4349-8fcf-32a54223e845 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:22.917679 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af1a86-5ed8-4349-8fcf-32a54223e845 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:22.917961 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af1a86-5ed8-4349-8fcf-32a54223e845 admin admin] PATH_INFO: `/v3/users/1ada2265e4bd41418c6c639ed50527ce` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:22.919463 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26af1a86-5ed8-4349-8fcf-32a54223e845 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ada2265e4bd41418c6c639ed50527ce)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:22.921715 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26af1a86-5ed8-4349-8fcf-32a54223e845 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:22.981393 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-26af1a86-5ed8-4349-8fcf-32a54223e845 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ada2265e4bd41418c6c639ed50527ce'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:22.988289 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-26af1a86-5ed8-4349-8fcf-32a54223e845 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ada2265e4bd41418c6c639ed50527ce'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:22.995965 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-26af1a86-5ed8-4349-8fcf-32a54223e845 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ada2265e4bd41418c6c639ed50527ce'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:22.996638 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-26af1a86-5ed8-4349-8fcf-32a54223e845 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ada2265e4bd41418c6c639ed50527ce'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:22.997283 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-26af1a86-5ed8-4349-8fcf-32a54223e845 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ada2265e4bd41418c6c639ed50527ce'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:23.015799 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1255/2524] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:35:22 2022] DELETE /identity/v3/users/1ada2265e4bd41418c6c639ed50527ce => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:35:23.312251 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81eac31-afa9-489d-bcd0-e686374bfa9a admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:23.313885 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-c81eac31-afa9-489d-bcd0-e686374bfa9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:23.332737 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81eac31-afa9-489d-bcd0-e686374bfa9a admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:23.394690 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c01cc6-f907-42ac-b27e-bdadb324eac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:23.396137 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c01cc6-f907-42ac-b27e-bdadb324eac2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:23.396421 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c01cc6-f907-42ac-b27e-bdadb324eac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:23.396688 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c01cc6-f907-42ac-b27e-bdadb324eac2 admin admin] PATH_INFO: `/v3/projects/11fab8d1e3664bf5a36486b4e210d0e8` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:23.398554 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c01cc6-f907-42ac-b27e-bdadb324eac2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11fab8d1e3664bf5a36486b4e210d0e8)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:23.400500 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c01cc6-f907-42ac-b27e-bdadb324eac2 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:23.445665 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-b2c01cc6-f907-42ac-b27e-bdadb324eac2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11fab8d1e3664bf5a36486b4e210d0e8', 'request_id': 'req-b2c01cc6-f907-42ac-b27e-bdadb324eac2'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:23.451745 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-b2c01cc6-f907-42ac-b27e-bdadb324eac2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11fab8d1e3664bf5a36486b4e210d0e8', 'request_id': 'req-b2c01cc6-f907-42ac-b27e-bdadb324eac2'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:23.459039 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-b2c01cc6-f907-42ac-b27e-bdadb324eac2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11fab8d1e3664bf5a36486b4e210d0e8', 'request_id': 'req-b2c01cc6-f907-42ac-b27e-bdadb324eac2'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:23.473526 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-b2c01cc6-f907-42ac-b27e-bdadb324eac2 admin admin] The token cache is being invalidate because project 11fab8d1e3664bf5a36486b4e210d0e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:35:23.473813 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-b2c01cc6-f907-42ac-b27e-bdadb324eac2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:23.474454 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-b2c01cc6-f907-42ac-b27e-bdadb324eac2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:23.476195 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1270/2525] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:35:23 2022] DELETE /identity/v3/projects/11fab8d1e3664bf5a36486b4e210d0e8 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:35:23.483698 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4611419-e132-4eed-9d97-de93c4e94bd5 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:23.484189 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4611419-e132-4eed-9d97-de93c4e94bd5 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:23.484533 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4611419-e132-4eed-9d97-de93c4e94bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:23.502292 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-f4611419-e132-4eed-9d97-de93c4e94bd5 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:35:23.503624 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-f4611419-e132-4eed-9d97-de93c4e94bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:23.575080 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1256/2526] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:35:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:35:23.585425 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79153c21-2994-4a58-afd3-1f3a136a4560 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:23.586477 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79153c21-2994-4a58-afd3-1f3a136a4560 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:23.586961 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79153c21-2994-4a58-afd3-1f3a136a4560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:23.625563 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-79153c21-2994-4a58-afd3-1f3a136a4560 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:35:23.626785 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-79153c21-2994-4a58-afd3-1f3a136a4560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:23.641435 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1271/2527] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:35:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:35:23.648761 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4611419-e132-4eed-9d97-de93c4e94bd5 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:23.656808 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4611419-e132-4eed-9d97-de93c4e94bd5 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:23.661733 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ad39e2-b426-4ac5-9378-0d150e6334a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:23.662383 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad39e2-b426-4ac5-9378-0d150e6334a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:23.663321 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad39e2-b426-4ac5-9378-0d150e6334a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:23.663803 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad39e2-b426-4ac5-9378-0d150e6334a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:23.664406 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ad39e2-b426-4ac5-9378-0d150e6334a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:35:23.664909 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ad39e2-b426-4ac5-9378-0d150e6334a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:23.669027 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ad39e2-b426-4ac5-9378-0d150e6334a2 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:23.683695 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1257/2528] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 9 20:35:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:35:23.687014 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79153c21-2994-4a58-afd3-1f3a136a4560 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:23.697206 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79153c21-2994-4a58-afd3-1f3a136a4560 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:23.701845 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df03bd0-c59a-4ded-b492-b356c5bb4462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:23.702484 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df03bd0-c59a-4ded-b492-b356c5bb4462 admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:23.702761 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df03bd0-c59a-4ded-b492-b356c5bb4462 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:23.703064 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df03bd0-c59a-4ded-b492-b356c5bb4462 admin admin] PATH_INFO: `/v3/projects` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:23.703827 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df03bd0-c59a-4ded-b492-b356c5bb4462 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:23.705825 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df03bd0-c59a-4ded-b492-b356c5bb4462 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:23.731108 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1272/2529] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:35:23 2022] POST /identity/v3/projects => generated 393 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:35:23.735762 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ad39e2-b426-4ac5-9378-0d150e6334a2 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:23.747837 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ad39e2-b426-4ac5-9378-0d150e6334a2 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:23.806677 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39228ea4-a34f-4f2f-ae3b-537a6136c37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:23.807337 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39228ea4-a34f-4f2f-ae3b-537a6136c37e admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:23.807642 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39228ea4-a34f-4f2f-ae3b-537a6136c37e admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:23.808012 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39228ea4-a34f-4f2f-ae3b-537a6136c37e admin admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:23.808787 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39228ea4-a34f-4f2f-ae3b-537a6136c37e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:23.810937 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39228ea4-a34f-4f2f-ae3b-537a6136c37e admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:23.830571 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1258/2530] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:35:23 2022] POST /identity/v3/users => generated 297 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:35:23.835786 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df03bd0-c59a-4ded-b492-b356c5bb4462 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:23.849537 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df03bd0-c59a-4ded-b492-b356c5bb4462 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:23.854814 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b8a2e5-acd8-4d15-b48e-14f0104f64ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:23.855510 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b8a2e5-acd8-4d15-b48e-14f0104f64ae admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:23.855841 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b8a2e5-acd8-4d15-b48e-14f0104f64ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:23.856118 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b8a2e5-acd8-4d15-b48e-14f0104f64ae admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:23.856874 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b8a2e5-acd8-4d15-b48e-14f0104f64ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:23.858481 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b8a2e5-acd8-4d15-b48e-14f0104f64ae admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:23.870464 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1273/2531] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:35:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:35:23.874504 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39228ea4-a34f-4f2f-ae3b-537a6136c37e admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:23.884975 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39228ea4-a34f-4f2f-ae3b-537a6136c37e admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:23.889829 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9205f9b2-b77f-4733-8ca7-115b070f1627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:23.890498 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9205f9b2-b77f-4733-8ca7-115b070f1627 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:23.890774 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9205f9b2-b77f-4733-8ca7-115b070f1627 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:23.891043 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9205f9b2-b77f-4733-8ca7-115b070f1627 admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:23.891780 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9205f9b2-b77f-4733-8ca7-115b070f1627 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:23.893363 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9205f9b2-b77f-4733-8ca7-115b070f1627 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:23.903626 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1259/2532] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:35:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:35:23.907654 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b8a2e5-acd8-4d15-b48e-14f0104f64ae admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:23.917305 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b8a2e5-acd8-4d15-b48e-14f0104f64ae admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:23.921833 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cfd383-f82c-42d6-9249-a4032dd96a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:23.922693 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cfd383-f82c-42d6-9249-a4032dd96a3e admin admin] REQUEST_METHOD: `PUT` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:23.922973 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cfd383-f82c-42d6-9249-a4032dd96a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:23.923247 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cfd383-f82c-42d6-9249-a4032dd96a3e admin admin] PATH_INFO: `/v3/projects/4bce43b732404a58a09e22721d42c2c1/users/f0463966030a42e3bd50fc40346749f4/roles/79f90a0bf6ea43d0b3c434e31556253a` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:23.938414 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cfd383-f82c-42d6-9249-a4032dd96a3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bce43b732404a58a09e22721d42c2c1, user_id=f0463966030a42e3bd50fc40346749f4, role_id=79f90a0bf6ea43d0b3c434e31556253a)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:23.941211 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cfd383-f82c-42d6-9249-a4032dd96a3e admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:23.955462 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1274/2533] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:35:23 2022] PUT /identity/v3/projects/4bce43b732404a58a09e22721d42c2c1/users/f0463966030a42e3bd50fc40346749f4/roles/79f90a0bf6ea43d0b3c434e31556253a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:35:23.967483 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f713c860-49c0-4bc0-9a55-4f8684096e67 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:23.967977 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f713c860-49c0-4bc0-9a55-4f8684096e67 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:23.968073 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f713c860-49c0-4bc0-9a55-4f8684096e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:23.996797 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-f713c860-49c0-4bc0-9a55-4f8684096e67 None None] MFA Rules not processed for user `f0463966030a42e3bd50fc40346749f4`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:35:23.998108 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-f713c860-49c0-4bc0-9a55-4f8684096e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:24.065936 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1260/2534] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:35:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:35:24.077684 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cfd383-f82c-42d6-9249-a4032dd96a3e admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:24.079357 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-48cfd383-f82c-42d6-9249-a4032dd96a3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:24.136352 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cfd383-f82c-42d6-9249-a4032dd96a3e admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:24.139903 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3afb5e-fbd5-4a6f-bfb6-df7bfda08384 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d65e731386d44948dcc1ecd40cbda65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:24.140517 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3afb5e-fbd5-4a6f-bfb6-df7bfda08384 service cinder] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:24.140793 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3afb5e-fbd5-4a6f-bfb6-df7bfda08384 service cinder] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:24.141063 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3afb5e-fbd5-4a6f-bfb6-df7bfda08384 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:24.149142 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3afb5e-fbd5-4a6f-bfb6-df7bfda08384 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:24.150635 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3afb5e-fbd5-4a6f-bfb6-df7bfda08384 service cinder] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:24.159302 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1275/2535] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:35:24 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:35:25.968173 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f713c860-49c0-4bc0-9a55-4f8684096e67 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:25.969580 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-f713c860-49c0-4bc0-9a55-4f8684096e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:26.023951 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f713c860-49c0-4bc0-9a55-4f8684096e67 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:26.027659 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bde4c5-199b-45e0-9e8b-605e58bd79f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:26.028300 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bde4c5-199b-45e0-9e8b-605e58bd79f0 service neutron] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:26.028583 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bde4c5-199b-45e0-9e8b-605e58bd79f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:26.028856 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bde4c5-199b-45e0-9e8b-605e58bd79f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:26.030643 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-36bde4c5-199b-45e0-9e8b-605e58bd79f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:26.089826 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bde4c5-199b-45e0-9e8b-605e58bd79f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:26.091261 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bde4c5-199b-45e0-9e8b-605e58bd79f0 service neutron] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:26.101075 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1261/2536] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:35:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:35:26.170979 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3afb5e-fbd5-4a6f-bfb6-df7bfda08384 service cinder] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:26.172421 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-2e3afb5e-fbd5-4a6f-bfb6-df7bfda08384 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:26.184867 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3afb5e-fbd5-4a6f-bfb6-df7bfda08384 service cinder] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:26.188405 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c57f9-fadf-4e9b-9fdc-496b43c008ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:26.189034 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c57f9-fadf-4e9b-9fdc-496b43c008ca service neutron] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:26.189345 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c57f9-fadf-4e9b-9fdc-496b43c008ca service neutron] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:26.189618 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c57f9-fadf-4e9b-9fdc-496b43c008ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:26.191316 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-fd7c57f9-fadf-4e9b-9fdc-496b43c008ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:26.204762 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7c57f9-fadf-4e9b-9fdc-496b43c008ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:26.206232 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7c57f9-fadf-4e9b-9fdc-496b43c008ca service neutron] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:26.216050 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1276/2537] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:35:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:35:29.642929 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bde4c5-199b-45e0-9e8b-605e58bd79f0 service neutron] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:29.644497 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-36bde4c5-199b-45e0-9e8b-605e58bd79f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:29.661326 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bde4c5-199b-45e0-9e8b-605e58bd79f0 service neutron] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:29.668134 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19376cc0-5c0b-423b-ae3b-07dda78c87f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:29.668971 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19376cc0-5c0b-423b-ae3b-07dda78c87f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:29.669328 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19376cc0-5c0b-423b-ae3b-07dda78c87f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:29.670018 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19376cc0-5c0b-423b-ae3b-07dda78c87f1 admin admin] PATH_INFO: `/v3/users/38716aefb55246079de2658159fd5ca4` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:29.706177 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19376cc0-5c0b-423b-ae3b-07dda78c87f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38716aefb55246079de2658159fd5ca4)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:29.708269 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19376cc0-5c0b-423b-ae3b-07dda78c87f1 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:29.780312 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-19376cc0-5c0b-423b-ae3b-07dda78c87f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38716aefb55246079de2658159fd5ca4'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:29.794687 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-19376cc0-5c0b-423b-ae3b-07dda78c87f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38716aefb55246079de2658159fd5ca4'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:29.806293 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-19376cc0-5c0b-423b-ae3b-07dda78c87f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38716aefb55246079de2658159fd5ca4'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:29.806997 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-19376cc0-5c0b-423b-ae3b-07dda78c87f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38716aefb55246079de2658159fd5ca4'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:29.807669 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-19376cc0-5c0b-423b-ae3b-07dda78c87f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38716aefb55246079de2658159fd5ca4'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:29.828924 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1262/2538] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:35:29 2022] DELETE /identity/v3/users/38716aefb55246079de2658159fd5ca4 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:35:30.035609 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c57f9-fadf-4e9b-9fdc-496b43c008ca service neutron] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:30.037226 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-fd7c57f9-fadf-4e9b-9fdc-496b43c008ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:30.060168 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c57f9-fadf-4e9b-9fdc-496b43c008ca service neutron] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:30.126601 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb67f6d-5ee9-4f12-adcd-88bb26f66581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:30.127959 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb67f6d-5ee9-4f12-adcd-88bb26f66581 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:30.128068 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb67f6d-5ee9-4f12-adcd-88bb26f66581 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:30.128342 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb67f6d-5ee9-4f12-adcd-88bb26f66581 admin admin] PATH_INFO: `/v3/users/dee809a4a41f4d2c91edb83c1f4d224c` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:30.138872 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19376cc0-5c0b-423b-ae3b-07dda78c87f1 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:30.140565 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-19376cc0-5c0b-423b-ae3b-07dda78c87f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:30.148233 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb67f6d-5ee9-4f12-adcd-88bb26f66581 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dee809a4a41f4d2c91edb83c1f4d224c)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:30.150960 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb67f6d-5ee9-4f12-adcd-88bb26f66581 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:30.161864 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19376cc0-5c0b-423b-ae3b-07dda78c87f1 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:30.172446 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bdaa33-6778-44eb-8bf3-9ba39a85f16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:30.173454 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bdaa33-6778-44eb-8bf3-9ba39a85f16a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:30.174115 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bdaa33-6778-44eb-8bf3-9ba39a85f16a admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:30.174559 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bdaa33-6778-44eb-8bf3-9ba39a85f16a admin admin] PATH_INFO: `/v3/projects/f579878e20bc40d282c9c38200581b98` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:30.194495 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bdaa33-6778-44eb-8bf3-9ba39a85f16a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f579878e20bc40d282c9c38200581b98)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:30.197044 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bdaa33-6778-44eb-8bf3-9ba39a85f16a admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:30.222261 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-ddb67f6d-5ee9-4f12-adcd-88bb26f66581 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dee809a4a41f4d2c91edb83c1f4d224c'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:30.222995 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-ddb67f6d-5ee9-4f12-adcd-88bb26f66581 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dee809a4a41f4d2c91edb83c1f4d224c'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:30.231912 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-ddb67f6d-5ee9-4f12-adcd-88bb26f66581 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dee809a4a41f4d2c91edb83c1f4d224c'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:30.232632 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-ddb67f6d-5ee9-4f12-adcd-88bb26f66581 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dee809a4a41f4d2c91edb83c1f4d224c'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:30.242057 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-ddb67f6d-5ee9-4f12-adcd-88bb26f66581 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dee809a4a41f4d2c91edb83c1f4d224c'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:30.256230 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-05bdaa33-6778-44eb-8bf3-9ba39a85f16a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f579878e20bc40d282c9c38200581b98', 'request_id': 'req-05bdaa33-6778-44eb-8bf3-9ba39a85f16a'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:30.263464 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1277/2539] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:35:30 2022] DELETE /identity/v3/users/dee809a4a41f4d2c91edb83c1f4d224c => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:35:30.265685 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-05bdaa33-6778-44eb-8bf3-9ba39a85f16a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f579878e20bc40d282c9c38200581b98', 'request_id': 'req-05bdaa33-6778-44eb-8bf3-9ba39a85f16a'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:30.272333 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-05bdaa33-6778-44eb-8bf3-9ba39a85f16a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f579878e20bc40d282c9c38200581b98', 'request_id': 'req-05bdaa33-6778-44eb-8bf3-9ba39a85f16a'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:30.288087 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-05bdaa33-6778-44eb-8bf3-9ba39a85f16a admin admin] The token cache is being invalidate because project f579878e20bc40d282c9c38200581b98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:35:30.288719 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-05bdaa33-6778-44eb-8bf3-9ba39a85f16a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:30.289516 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-05bdaa33-6778-44eb-8bf3-9ba39a85f16a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:30.291986 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1263/2540] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:35:30 2022] DELETE /identity/v3/projects/f579878e20bc40d282c9c38200581b98 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:35:30.297178 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ba8a9-a84b-47c2-8ed5-2fb6b29cf4b1 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:30.297178 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ba8a9-a84b-47c2-8ed5-2fb6b29cf4b1 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:30.297508 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ba8a9-a84b-47c2-8ed5-2fb6b29cf4b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:30.324343 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-a54ba8a9-a84b-47c2-8ed5-2fb6b29cf4b1 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:35:30.325773 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-a54ba8a9-a84b-47c2-8ed5-2fb6b29cf4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:30.400739 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1278/2541] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:35:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:35:30.408685 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa03891f-ec38-4bf0-8994-c64f6c5fe276 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:30.409163 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa03891f-ec38-4bf0-8994-c64f6c5fe276 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:30.409255 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa03891f-ec38-4bf0-8994-c64f6c5fe276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:30.429033 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-aa03891f-ec38-4bf0-8994-c64f6c5fe276 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:35:30.430143 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-aa03891f-ec38-4bf0-8994-c64f6c5fe276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:30.443560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1264/2542] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:35:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:35:30.444804 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54ba8a9-a84b-47c2-8ed5-2fb6b29cf4b1 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:30.456487 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54ba8a9-a84b-47c2-8ed5-2fb6b29cf4b1 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:30.462362 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b11f9b-3e0e-4d4d-ad86-f0877146ec0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:30.463154 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b11f9b-3e0e-4d4d-ad86-f0877146ec0b admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:30.463540 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b11f9b-3e0e-4d4d-ad86-f0877146ec0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:30.463858 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b11f9b-3e0e-4d4d-ad86-f0877146ec0b admin admin] PATH_INFO: `/v3/domains` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:30.466178 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b11f9b-3e0e-4d4d-ad86-f0877146ec0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:35:30.467603 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b11f9b-3e0e-4d4d-ad86-f0877146ec0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:30.469547 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b11f9b-3e0e-4d4d-ad86-f0877146ec0b admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:30.485086 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa03891f-ec38-4bf0-8994-c64f6c5fe276 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:30.486267 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1279/2543] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 9 20:35:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:35:30.486474 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-aa03891f-ec38-4bf0-8994-c64f6c5fe276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:30.490385 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b11f9b-3e0e-4d4d-ad86-f0877146ec0b admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:30.500774 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b11f9b-3e0e-4d4d-ad86-f0877146ec0b admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:30.505281 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa03891f-ec38-4bf0-8994-c64f6c5fe276 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:30.506528 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca36e8a7-9a14-4ae6-b1d0-22f2b62ecef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:30.507568 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca36e8a7-9a14-4ae6-b1d0-22f2b62ecef4 admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:30.508144 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca36e8a7-9a14-4ae6-b1d0-22f2b62ecef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:30.508699 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca36e8a7-9a14-4ae6-b1d0-22f2b62ecef4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:30.509499 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca36e8a7-9a14-4ae6-b1d0-22f2b62ecef4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:30.511696 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a98088-9689-4feb-b170-6bc9d2b88f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:30.511817 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca36e8a7-9a14-4ae6-b1d0-22f2b62ecef4 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:30.512458 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a98088-9689-4feb-b170-6bc9d2b88f8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:30.512732 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a98088-9689-4feb-b170-6bc9d2b88f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:30.513412 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a98088-9689-4feb-b170-6bc9d2b88f8b admin admin] PATH_INFO: `/v3/projects/5fe87375072b4dbbaac833caf2f705aa` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:30.526714 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a98088-9689-4feb-b170-6bc9d2b88f8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fe87375072b4dbbaac833caf2f705aa)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:30.528674 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a98088-9689-4feb-b170-6bc9d2b88f8b admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:30.539464 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1280/2544] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:35:30 2022] POST /identity/v3/projects => generated 367 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 20:35:30.543818 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca36e8a7-9a14-4ae6-b1d0-22f2b62ecef4 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:30.577934 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-90a98088-9689-4feb-b170-6bc9d2b88f8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fe87375072b4dbbaac833caf2f705aa', 'request_id': 'req-90a98088-9689-4feb-b170-6bc9d2b88f8b'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:30.585083 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-90a98088-9689-4feb-b170-6bc9d2b88f8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fe87375072b4dbbaac833caf2f705aa', 'request_id': 'req-90a98088-9689-4feb-b170-6bc9d2b88f8b'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:30.590575 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-90a98088-9689-4feb-b170-6bc9d2b88f8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fe87375072b4dbbaac833caf2f705aa', 'request_id': 'req-90a98088-9689-4feb-b170-6bc9d2b88f8b'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:30.603972 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-90a98088-9689-4feb-b170-6bc9d2b88f8b admin admin] The token cache is being invalidate because project 5fe87375072b4dbbaac833caf2f705aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:35:30.604286 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-90a98088-9689-4feb-b170-6bc9d2b88f8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:30.604904 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-90a98088-9689-4feb-b170-6bc9d2b88f8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:30.606659 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1265/2545] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:35:30 2022] DELETE /identity/v3/projects/5fe87375072b4dbbaac833caf2f705aa => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:35:30.607681 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca36e8a7-9a14-4ae6-b1d0-22f2b62ecef4 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:30.611240 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e21cf0-0af5-4b81-92c4-e54ddfeee5a3 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:30.611547 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e21cf0-0af5-4b81-92c4-e54ddfeee5a3 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:30.611817 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e21cf0-0af5-4b81-92c4-e54ddfeee5a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:30.628979 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-90e21cf0-0af5-4b81-92c4-e54ddfeee5a3 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:35:30.630164 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-90e21cf0-0af5-4b81-92c4-e54ddfeee5a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:30.663276 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a361975a-5e67-449e-bdc8-18c8040aaf4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:30.663977 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a361975a-5e67-449e-bdc8-18c8040aaf4c admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:30.664262 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a361975a-5e67-449e-bdc8-18c8040aaf4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:30.664653 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a361975a-5e67-449e-bdc8-18c8040aaf4c admin admin] PATH_INFO: `/v3/users` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:30.665342 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a361975a-5e67-449e-bdc8-18c8040aaf4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:30.667301 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a361975a-5e67-449e-bdc8-18c8040aaf4c admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:30.687290 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1281/2546] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:35:30 2022] POST /identity/v3/users => generated 284 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:35:30.691282 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a361975a-5e67-449e-bdc8-18c8040aaf4c admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:30.691681 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1266/2547] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:35:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:35:30.693089 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-a361975a-5e67-449e-bdc8-18c8040aaf4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:30.700484 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3af225-e954-4a68-b8a2-5f4ec395b9cb None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:30.700767 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3af225-e954-4a68-b8a2-5f4ec395b9cb None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:30.701033 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3af225-e954-4a68-b8a2-5f4ec395b9cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:30.705533 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a361975a-5e67-449e-bdc8-18c8040aaf4c admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:30.710852 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f8b21d-7b9d-4841-8c31-48aa67ad1639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:30.711463 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8b21d-7b9d-4841-8c31-48aa67ad1639 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:30.711746 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8b21d-7b9d-4841-8c31-48aa67ad1639 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:30.712017 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8b21d-7b9d-4841-8c31-48aa67ad1639 admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:30.712732 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f8b21d-7b9d-4841-8c31-48aa67ad1639 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:30.714386 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f8b21d-7b9d-4841-8c31-48aa67ad1639 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:30.721861 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-5a3af225-e954-4a68-b8a2-5f4ec395b9cb None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:35:30.723077 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-5a3af225-e954-4a68-b8a2-5f4ec395b9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:30.730713 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1282/2548] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:35:30 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 09 20:35:30.731853 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1267/2549] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:35:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:35:30.732045 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f8b21d-7b9d-4841-8c31-48aa67ad1639 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:30.735796 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3af225-e954-4a68-b8a2-5f4ec395b9cb None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:30.741627 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f8b21d-7b9d-4841-8c31-48aa67ad1639 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:30.745159 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3af225-e954-4a68-b8a2-5f4ec395b9cb None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:30.746567 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e639fef7-3cef-476e-8f99-b91420f2b061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:30.747204 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639fef7-3cef-476e-8f99-b91420f2b061 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:30.747519 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639fef7-3cef-476e-8f99-b91420f2b061 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:30.747818 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639fef7-3cef-476e-8f99-b91420f2b061 admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:30.748526 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e639fef7-3cef-476e-8f99-b91420f2b061 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:30.749923 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6118fa4c-ad4d-45b6-90d6-c15222c0b496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:30.750111 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e639fef7-3cef-476e-8f99-b91420f2b061 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:30.750552 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118fa4c-ad4d-45b6-90d6-c15222c0b496 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:30.750832 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118fa4c-ad4d-45b6-90d6-c15222c0b496 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:30.751104 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118fa4c-ad4d-45b6-90d6-c15222c0b496 admin admin] PATH_INFO: `/v3/domains` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:30.751858 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6118fa4c-ad4d-45b6-90d6-c15222c0b496 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:35:30.752166 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6118fa4c-ad4d-45b6-90d6-c15222c0b496 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:30.753750 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6118fa4c-ad4d-45b6-90d6-c15222c0b496 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:30.761335 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1283/2550] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:35:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 09 20:35:30.765428 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e639fef7-3cef-476e-8f99-b91420f2b061 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:30.769169 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1268/2551] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 9 20:35:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:35:30.770127 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6118fa4c-ad4d-45b6-90d6-c15222c0b496 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:30.775807 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e639fef7-3cef-476e-8f99-b91420f2b061 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:30.780578 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6e166c-477e-4e0b-a06c-932f134bae81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:30.780741 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6118fa4c-ad4d-45b6-90d6-c15222c0b496 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:30.781441 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e166c-477e-4e0b-a06c-932f134bae81 admin admin] REQUEST_METHOD: `PUT` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:30.781722 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e166c-477e-4e0b-a06c-932f134bae81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:30.782026 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e166c-477e-4e0b-a06c-932f134bae81 admin admin] PATH_INFO: `/v3/projects/a2bd60b3779a4df1937c083c57c5a9bb/users/342ca2ee13bd4c82a68caf8d5186e03f/roles/79f90a0bf6ea43d0b3c434e31556253a` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:30.785684 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2119868c-d3a0-4a69-a200-3ae7f873741f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:30.786307 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2119868c-d3a0-4a69-a200-3ae7f873741f admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:30.786579 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2119868c-d3a0-4a69-a200-3ae7f873741f admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:30.786841 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2119868c-d3a0-4a69-a200-3ae7f873741f admin admin] PATH_INFO: `/v3/projects` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:30.787610 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2119868c-d3a0-4a69-a200-3ae7f873741f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:30.789479 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2119868c-d3a0-4a69-a200-3ae7f873741f admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:30.796722 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6e166c-477e-4e0b-a06c-932f134bae81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2bd60b3779a4df1937c083c57c5a9bb, user_id=342ca2ee13bd4c82a68caf8d5186e03f, role_id=79f90a0bf6ea43d0b3c434e31556253a)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:30.799350 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6e166c-477e-4e0b-a06c-932f134bae81 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:30.813574 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1284/2552] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:35:30 2022] PUT /identity/v3/projects/a2bd60b3779a4df1937c083c57c5a9bb/users/342ca2ee13bd4c82a68caf8d5186e03f/roles/79f90a0bf6ea43d0b3c434e31556253a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:35:30.822871 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1269/2553] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:35:30 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 20:35:30.823005 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6e166c-477e-4e0b-a06c-932f134bae81 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:30.824782 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65be2f-c87f-4f78-b69a-09a84c78f96f None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:30.825072 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65be2f-c87f-4f78-b69a-09a84c78f96f None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:30.825343 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65be2f-c87f-4f78-b69a-09a84c78f96f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:30.851990 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-0a65be2f-c87f-4f78-b69a-09a84c78f96f None None] MFA Rules not processed for user `342ca2ee13bd4c82a68caf8d5186e03f`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:35:30.853198 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-0a65be2f-c87f-4f78-b69a-09a84c78f96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:30.879235 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6e166c-477e-4e0b-a06c-932f134bae81 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:30.916335 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1270/2554] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:35:30 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:35:30.920700 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a65be2f-c87f-4f78-b69a-09a84c78f96f None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:30.934338 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb06b94c-ce0b-4991-a7c6-38f098d776f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:30.935008 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06b94c-ce0b-4991-a7c6-38f098d776f3 admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:30.935292 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06b94c-ce0b-4991-a7c6-38f098d776f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:30.935599 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06b94c-ce0b-4991-a7c6-38f098d776f3 admin admin] PATH_INFO: `/v3/users` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:30.936285 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb06b94c-ce0b-4991-a7c6-38f098d776f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:30.938270 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb06b94c-ce0b-4991-a7c6-38f098d776f3 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:30.967567 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1285/2555] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:35:30 2022] POST /identity/v3/users => generated 283 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 20:35:30.971848 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb06b94c-ce0b-4991-a7c6-38f098d776f3 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:30.981433 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb06b94c-ce0b-4991-a7c6-38f098d776f3 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:30.985934 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c46fff-36eb-469b-ad73-e4d138f0b842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:30.986368 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a65be2f-c87f-4f78-b69a-09a84c78f96f None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:30.986606 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c46fff-36eb-469b-ad73-e4d138f0b842 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:30.986885 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c46fff-36eb-469b-ad73-e4d138f0b842 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:30.987158 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c46fff-36eb-469b-ad73-e4d138f0b842 admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:30.987913 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c46fff-36eb-469b-ad73-e4d138f0b842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:30.989499 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c46fff-36eb-469b-ad73-e4d138f0b842 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:30.991313 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbc959a-8df3-492d-8903-1bc7414498a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:30.991986 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc959a-8df3-492d-8903-1bc7414498a5 admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:30.992266 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc959a-8df3-492d-8903-1bc7414498a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:30.992540 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc959a-8df3-492d-8903-1bc7414498a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:30.993248 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbc959a-8df3-492d-8903-1bc7414498a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:30.995192 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbc959a-8df3-492d-8903-1bc7414498a5 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:30.999989 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1286/2556] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:35:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 09 20:35:31.003828 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c46fff-36eb-469b-ad73-e4d138f0b842 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:31.015366 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c46fff-36eb-469b-ad73-e4d138f0b842 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:31.020186 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a951ad-0efa-4f38-90f5-403681d04de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:31.020823 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a951ad-0efa-4f38-90f5-403681d04de0 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:31.021106 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a951ad-0efa-4f38-90f5-403681d04de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:31.021388 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a951ad-0efa-4f38-90f5-403681d04de0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:31.025884 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a951ad-0efa-4f38-90f5-403681d04de0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:31.026044 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1271/2557] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:35:30 2022] POST /identity/v3/projects => generated 369 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 20:35:31.026158 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a951ad-0efa-4f38-90f5-403681d04de0 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:31.026834 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbc959a-8df3-492d-8903-1bc7414498a5 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:31.038720 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1287/2558] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:35:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 09 20:35:31.039703 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a951ad-0efa-4f38-90f5-403681d04de0 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:31.048992 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a951ad-0efa-4f38-90f5-403681d04de0 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:31.088015 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbc959a-8df3-492d-8903-1bc7414498a5 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:31.093611 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05725e9-1e2f-4267-950d-afb3a6866857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:31.094400 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05725e9-1e2f-4267-950d-afb3a6866857 admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:31.094746 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05725e9-1e2f-4267-950d-afb3a6866857 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:31.095083 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05725e9-1e2f-4267-950d-afb3a6866857 admin admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:31.095932 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05725e9-1e2f-4267-950d-afb3a6866857 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:31.097924 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05725e9-1e2f-4267-950d-afb3a6866857 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:31.108156 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106cbcd1-f620-4d79-bd50-de85c63b17bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:31.109162 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106cbcd1-f620-4d79-bd50-de85c63b17bd admin admin] REQUEST_METHOD: `PUT` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:31.110145 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106cbcd1-f620-4d79-bd50-de85c63b17bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:31.110430 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106cbcd1-f620-4d79-bd50-de85c63b17bd admin admin] PATH_INFO: `/v3/projects/bf39ece9140846acbe87f01b39fe17a7/users/794af5cfb51f41fe866b31af7da09d19/roles/79f90a0bf6ea43d0b3c434e31556253a` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:31.123111 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1272/2559] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:35:31 2022] POST /identity/v3/users => generated 291 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 20:35:31.124362 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05725e9-1e2f-4267-950d-afb3a6866857 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:31.129441 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106cbcd1-f620-4d79-bd50-de85c63b17bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf39ece9140846acbe87f01b39fe17a7, user_id=794af5cfb51f41fe866b31af7da09d19, role_id=79f90a0bf6ea43d0b3c434e31556253a)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:31.132957 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106cbcd1-f620-4d79-bd50-de85c63b17bd admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:31.137013 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05725e9-1e2f-4267-950d-afb3a6866857 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:31.147479 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c5275f-7dd1-44a8-a0e2-e27fd13413e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:31.148214 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c5275f-7dd1-44a8-a0e2-e27fd13413e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:31.148504 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c5275f-7dd1-44a8-a0e2-e27fd13413e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:31.148786 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c5275f-7dd1-44a8-a0e2-e27fd13413e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:31.149521 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c5275f-7dd1-44a8-a0e2-e27fd13413e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:31.151133 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c5275f-7dd1-44a8-a0e2-e27fd13413e1 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:31.151846 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1288/2560] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:35:31 2022] PUT /identity/v3/projects/bf39ece9140846acbe87f01b39fe17a7/users/794af5cfb51f41fe866b31af7da09d19/roles/79f90a0bf6ea43d0b3c434e31556253a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:35:31.161887 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1273/2561] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:35:31 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:35:31.162170 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da62674-6a09-4fd3-801b-cf0cf235298f None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:31.162469 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da62674-6a09-4fd3-801b-cf0cf235298f None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:31.162750 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da62674-6a09-4fd3-801b-cf0cf235298f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:31.165734 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c5275f-7dd1-44a8-a0e2-e27fd13413e1 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:31.177057 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c5275f-7dd1-44a8-a0e2-e27fd13413e1 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:31.193501 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-9da62674-6a09-4fd3-801b-cf0cf235298f None None] MFA Rules not processed for user `794af5cfb51f41fe866b31af7da09d19`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:35:31.195266 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-9da62674-6a09-4fd3-801b-cf0cf235298f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:31.233385 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e55e8d1-9893-4adb-8ca9-d3790148f350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:31.234265 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e55e8d1-9893-4adb-8ca9-d3790148f350 admin admin] REQUEST_METHOD: `PUT` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:31.234537 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e55e8d1-9893-4adb-8ca9-d3790148f350 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:31.234816 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e55e8d1-9893-4adb-8ca9-d3790148f350 admin admin] PATH_INFO: `/v3/projects/c8d974fe1c6e44fe95b9a72c4583eb94/users/db040a364b034d6eb02a46b396de1902/roles/274130b78e304bb88789c1b349263f3c` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:31.249441 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e55e8d1-9893-4adb-8ca9-d3790148f350 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8d974fe1c6e44fe95b9a72c4583eb94, user_id=db040a364b034d6eb02a46b396de1902, role_id=274130b78e304bb88789c1b349263f3c)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:31.252670 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e55e8d1-9893-4adb-8ca9-d3790148f350 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:31.259556 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1289/2562] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:35:31 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:35:31.264427 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da62674-6a09-4fd3-801b-cf0cf235298f None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:31.268502 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1274/2563] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:35:31 2022] PUT /identity/v3/projects/c8d974fe1c6e44fe95b9a72c4583eb94/users/db040a364b034d6eb02a46b396de1902/roles/274130b78e304bb88789c1b349263f3c => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:35:31.272413 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e55e8d1-9893-4adb-8ca9-d3790148f350 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:31.275656 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da62674-6a09-4fd3-801b-cf0cf235298f None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:31.333506 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60225f55-da5c-472d-adbc-e03f5dbe3b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:31.334324 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60225f55-da5c-472d-adbc-e03f5dbe3b61 admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:31.334621 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60225f55-da5c-472d-adbc-e03f5dbe3b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:31.334897 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60225f55-da5c-472d-adbc-e03f5dbe3b61 admin admin] PATH_INFO: `/v3/projects` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:31.335683 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60225f55-da5c-472d-adbc-e03f5dbe3b61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:31.337730 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60225f55-da5c-472d-adbc-e03f5dbe3b61 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:31.338176 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e55e8d1-9893-4adb-8ca9-d3790148f350 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:31.343163 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8fd3d5-f97a-41d9-845e-f975a5c85d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:31.343854 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8fd3d5-f97a-41d9-845e-f975a5c85d02 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:31.344170 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8fd3d5-f97a-41d9-845e-f975a5c85d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:31.344443 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8fd3d5-f97a-41d9-845e-f975a5c85d02 admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:31.345153 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8fd3d5-f97a-41d9-845e-f975a5c85d02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:31.346742 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8fd3d5-f97a-41d9-845e-f975a5c85d02 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:31.356867 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1275/2564] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:35:31 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 09 20:35:31.360821 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8fd3d5-f97a-41d9-845e-f975a5c85d02 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:31.366617 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1290/2565] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:35:31 2022] POST /identity/v3/projects => generated 365 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 20:35:31.367578 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60225f55-da5c-472d-adbc-e03f5dbe3b61 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:31.371148 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8fd3d5-f97a-41d9-845e-f975a5c85d02 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:31.426136 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d7860-9fca-4fda-aa85-16b9b81d6b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:31.427016 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d7860-9fca-4fda-aa85-16b9b81d6b29 admin admin] REQUEST_METHOD: `PUT` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:31.427298 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d7860-9fca-4fda-aa85-16b9b81d6b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:31.427501 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60225f55-da5c-472d-adbc-e03f5dbe3b61 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:31.427619 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d7860-9fca-4fda-aa85-16b9b81d6b29 admin admin] PATH_INFO: `/v3/projects/c8d974fe1c6e44fe95b9a72c4583eb94/users/db040a364b034d6eb02a46b396de1902/roles/274130b78e304bb88789c1b349263f3c` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:31.430065 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5d7860-9fca-4fda-aa85-16b9b81d6b29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8d974fe1c6e44fe95b9a72c4583eb94, user_id=db040a364b034d6eb02a46b396de1902, role_id=274130b78e304bb88789c1b349263f3c)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:31.432710 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c432fda-e0a7-43e0-8c69-9880a5b48713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:31.432851 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5d7860-9fca-4fda-aa85-16b9b81d6b29 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:31.433362 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c432fda-e0a7-43e0-8c69-9880a5b48713 admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:31.433644 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c432fda-e0a7-43e0-8c69-9880a5b48713 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:31.433919 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c432fda-e0a7-43e0-8c69-9880a5b48713 admin admin] PATH_INFO: `/v3/users` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:31.434595 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c432fda-e0a7-43e0-8c69-9880a5b48713 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:31.436520 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c432fda-e0a7-43e0-8c69-9880a5b48713 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:31.442615 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1276/2566] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:35:31 2022] PUT /identity/v3/projects/c8d974fe1c6e44fe95b9a72c4583eb94/users/db040a364b034d6eb02a46b396de1902/roles/274130b78e304bb88789c1b349263f3c => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:35:31.453268 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b9b26-2ebc-4272-b864-215344f674c9 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:31.453766 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b9b26-2ebc-4272-b864-215344f674c9 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:31.454116 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b9b26-2ebc-4272-b864-215344f674c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:31.457882 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1291/2567] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:35:31 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 20:35:31.461593 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c432fda-e0a7-43e0-8c69-9880a5b48713 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:31.470956 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c432fda-e0a7-43e0-8c69-9880a5b48713 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:31.480822 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-d91b9b26-2ebc-4272-b864-215344f674c9 None None] MFA Rules not processed for user `db040a364b034d6eb02a46b396de1902`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:35:31.482108 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-d91b9b26-2ebc-4272-b864-215344f674c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:31.526193 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2a7e36-7e47-4fe0-a464-475db0a5db7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:31.526851 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a7e36-7e47-4fe0-a464-475db0a5db7b admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:31.527128 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a7e36-7e47-4fe0-a464-475db0a5db7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:31.527408 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a7e36-7e47-4fe0-a464-475db0a5db7b admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:31.528134 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2a7e36-7e47-4fe0-a464-475db0a5db7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:31.529715 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2a7e36-7e47-4fe0-a464-475db0a5db7b admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:31.539714 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1292/2568] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:35:31 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 09 20:35:31.543889 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2a7e36-7e47-4fe0-a464-475db0a5db7b admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:31.551334 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1277/2569] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:35:31 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:35:31.554039 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2a7e36-7e47-4fe0-a464-475db0a5db7b admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:31.558978 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85593b06-89a1-4e03-816b-8e7612878563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:31.559888 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85593b06-89a1-4e03-816b-8e7612878563 admin admin] REQUEST_METHOD: `PUT` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:31.560174 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85593b06-89a1-4e03-816b-8e7612878563 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:31.560448 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85593b06-89a1-4e03-816b-8e7612878563 admin admin] PATH_INFO: `/v3/projects/aa09b4f1a47c490c9b52a2443154d08c/users/a3d774093d1d494093cfe39b87294f66/roles/274130b78e304bb88789c1b349263f3c` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:31.562584 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91b9b26-2ebc-4272-b864-215344f674c9 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:31.564463 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-d91b9b26-2ebc-4272-b864-215344f674c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:31.575973 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85593b06-89a1-4e03-816b-8e7612878563 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa09b4f1a47c490c9b52a2443154d08c, user_id=a3d774093d1d494093cfe39b87294f66, role_id=274130b78e304bb88789c1b349263f3c)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:31.578644 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85593b06-89a1-4e03-816b-8e7612878563 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:31.592474 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1293/2570] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:35:31 2022] PUT /identity/v3/projects/aa09b4f1a47c490c9b52a2443154d08c/users/a3d774093d1d494093cfe39b87294f66/roles/274130b78e304bb88789c1b349263f3c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:35:31.596373 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85593b06-89a1-4e03-816b-8e7612878563 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:31.625535 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91b9b26-2ebc-4272-b864-215344f674c9 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:31.656547 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85593b06-89a1-4e03-816b-8e7612878563 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:31.661971 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a24c68-4d20-4401-a92d-37bf1f89d9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:31.662891 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a24c68-4d20-4401-a92d-37bf1f89d9f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:31.663180 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a24c68-4d20-4401-a92d-37bf1f89d9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:31.663478 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a24c68-4d20-4401-a92d-37bf1f89d9f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:31.664190 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a24c68-4d20-4401-a92d-37bf1f89d9f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:31.665789 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a24c68-4d20-4401-a92d-37bf1f89d9f3 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:31.672393 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03d0722-fc03-4917-a139-7dd994496421 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d65e731386d44948dcc1ecd40cbda65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:31.673030 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d0722-fc03-4917-a139-7dd994496421 service cinder] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:31.673303 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d0722-fc03-4917-a139-7dd994496421 service cinder] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:31.673573 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d0722-fc03-4917-a139-7dd994496421 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:31.675423 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1294/2571] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:35:31 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:35:31.679738 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a24c68-4d20-4401-a92d-37bf1f89d9f3 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:31.688834 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a24c68-4d20-4401-a92d-37bf1f89d9f3 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:31.693367 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe1731-c3bf-44e1-87bc-29eadac61148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:31.695058 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe1731-c3bf-44e1-87bc-29eadac61148 admin admin] REQUEST_METHOD: `PUT` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:31.695341 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe1731-c3bf-44e1-87bc-29eadac61148 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:31.695743 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe1731-c3bf-44e1-87bc-29eadac61148 admin admin] PATH_INFO: `/v3/projects/aa09b4f1a47c490c9b52a2443154d08c/users/a3d774093d1d494093cfe39b87294f66/roles/274130b78e304bb88789c1b349263f3c` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:31.697710 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afe1731-c3bf-44e1-87bc-29eadac61148 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa09b4f1a47c490c9b52a2443154d08c, user_id=a3d774093d1d494093cfe39b87294f66, role_id=274130b78e304bb88789c1b349263f3c)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:31.700356 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afe1731-c3bf-44e1-87bc-29eadac61148 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:31.710937 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1295/2572] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:35:31 2022] PUT /identity/v3/projects/aa09b4f1a47c490c9b52a2443154d08c/users/a3d774093d1d494093cfe39b87294f66/roles/274130b78e304bb88789c1b349263f3c => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:35:31.721935 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33ef04-5c25-4aaa-9ddf-11a7e2206e28 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:31.722222 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33ef04-5c25-4aaa-9ddf-11a7e2206e28 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:31.722493 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33ef04-5c25-4aaa-9ddf-11a7e2206e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:31.737649 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03d0722-fc03-4917-a139-7dd994496421 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:31.739084 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03d0722-fc03-4917-a139-7dd994496421 service cinder] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:31.748730 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1278/2573] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:35:31 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 09 20:35:31.749852 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-9d33ef04-5c25-4aaa-9ddf-11a7e2206e28 None None] MFA Rules not processed for user `a3d774093d1d494093cfe39b87294f66`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:35:31.751063 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-9d33ef04-5c25-4aaa-9ddf-11a7e2206e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:31.822678 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1296/2574] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:35:31 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:35:31.834060 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03d0722-fc03-4917-a139-7dd994496421 service cinder] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:31.836550 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-c03d0722-fc03-4917-a139-7dd994496421 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:31.847093 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03d0722-fc03-4917-a139-7dd994496421 service cinder] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:31.896029 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00a61e0-84f6-43ff-8bd2-20310d7f5874 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d65e731386d44948dcc1ecd40cbda65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:31.896677 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a61e0-84f6-43ff-8bd2-20310d7f5874 service cinder] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:31.897024 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a61e0-84f6-43ff-8bd2-20310d7f5874 service cinder] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:31.897637 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a61e0-84f6-43ff-8bd2-20310d7f5874 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:31.906711 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00a61e0-84f6-43ff-8bd2-20310d7f5874 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:31.908284 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00a61e0-84f6-43ff-8bd2-20310d7f5874 service cinder] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:31.917598 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1279/2575] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:35:31 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:35:32.218957 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d33ef04-5c25-4aaa-9ddf-11a7e2206e28 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:32.220584 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-9d33ef04-5c25-4aaa-9ddf-11a7e2206e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:32.294888 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d33ef04-5c25-4aaa-9ddf-11a7e2206e28 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:32.301228 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62c496e-f9b1-4fb7-b17b-a242e2f2f7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:32.307761 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c496e-f9b1-4fb7-b17b-a242e2f2f7e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:32.307761 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c496e-f9b1-4fb7-b17b-a242e2f2f7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:32.307761 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c496e-f9b1-4fb7-b17b-a242e2f2f7e4 admin admin] PATH_INFO: `/v3/users/f0463966030a42e3bd50fc40346749f4` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:32.307761 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62c496e-f9b1-4fb7-b17b-a242e2f2f7e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0463966030a42e3bd50fc40346749f4)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:32.314026 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62c496e-f9b1-4fb7-b17b-a242e2f2f7e4 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:32.348594 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00a61e0-84f6-43ff-8bd2-20310d7f5874 service cinder] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:32.363252 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00a61e0-84f6-43ff-8bd2-20310d7f5874 service cinder] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:32.369298 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3b7557-d3c6-49d0-be43-1ddf508400a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:32.370236 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b7557-d3c6-49d0-be43-1ddf508400a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:32.370605 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b7557-d3c6-49d0-be43-1ddf508400a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:32.370944 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b7557-d3c6-49d0-be43-1ddf508400a9 admin admin] PATH_INFO: `/v3/users/794af5cfb51f41fe866b31af7da09d19` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:32.372208 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3b7557-d3c6-49d0-be43-1ddf508400a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=794af5cfb51f41fe866b31af7da09d19)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:32.374105 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3b7557-d3c6-49d0-be43-1ddf508400a9 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:32.375850 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-a62c496e-f9b1-4fb7-b17b-a242e2f2f7e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0463966030a42e3bd50fc40346749f4'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:32.376575 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-a62c496e-f9b1-4fb7-b17b-a242e2f2f7e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0463966030a42e3bd50fc40346749f4'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:32.384691 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-a62c496e-f9b1-4fb7-b17b-a242e2f2f7e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0463966030a42e3bd50fc40346749f4'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:32.385877 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-a62c496e-f9b1-4fb7-b17b-a242e2f2f7e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0463966030a42e3bd50fc40346749f4'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:32.397007 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-a62c496e-f9b1-4fb7-b17b-a242e2f2f7e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0463966030a42e3bd50fc40346749f4'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:32.417765 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1297/2576] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:35:32 2022] DELETE /identity/v3/users/f0463966030a42e3bd50fc40346749f4 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:35:32.422163 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38773e0f-ee69-4d8a-bb37-bf46093122c3 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:32.422438 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38773e0f-ee69-4d8a-bb37-bf46093122c3 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:32.422710 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38773e0f-ee69-4d8a-bb37-bf46093122c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:32.431958 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-7b3b7557-d3c6-49d0-be43-1ddf508400a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '794af5cfb51f41fe866b31af7da09d19'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:32.439840 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-7b3b7557-d3c6-49d0-be43-1ddf508400a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '794af5cfb51f41fe866b31af7da09d19'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:32.441027 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-38773e0f-ee69-4d8a-bb37-bf46093122c3 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:35:32.442225 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-38773e0f-ee69-4d8a-bb37-bf46093122c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:32.449683 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-7b3b7557-d3c6-49d0-be43-1ddf508400a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '794af5cfb51f41fe866b31af7da09d19'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:32.450346 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-7b3b7557-d3c6-49d0-be43-1ddf508400a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '794af5cfb51f41fe866b31af7da09d19'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:32.451021 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-7b3b7557-d3c6-49d0-be43-1ddf508400a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '794af5cfb51f41fe866b31af7da09d19'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:32.470885 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1280/2577] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:35:32 2022] DELETE /identity/v3/users/794af5cfb51f41fe866b31af7da09d19 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:35:32.475368 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ee9618-da70-4a8e-9d50-c2fe34bcd6b9 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:32.475697 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ee9618-da70-4a8e-9d50-c2fe34bcd6b9 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:32.475971 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ee9618-da70-4a8e-9d50-c2fe34bcd6b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:32.494061 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-61ee9618-da70-4a8e-9d50-c2fe34bcd6b9 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:35:32.495244 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-61ee9618-da70-4a8e-9d50-c2fe34bcd6b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:32.507621 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1298/2578] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:35:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:35:32.517851 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38773e0f-ee69-4d8a-bb37-bf46093122c3 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:32.519201 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-38773e0f-ee69-4d8a-bb37-bf46093122c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:32.560239 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1281/2579] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:35:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:35:32.572354 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ee9618-da70-4a8e-9d50-c2fe34bcd6b9 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:32.574076 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-61ee9618-da70-4a8e-9d50-c2fe34bcd6b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:32.592617 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38773e0f-ee69-4d8a-bb37-bf46093122c3 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:32.640140 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ee9618-da70-4a8e-9d50-c2fe34bcd6b9 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:32.642724 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d646dc8e-3ec6-48fa-b6f4-62a0074c893e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:32.643488 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646dc8e-3ec6-48fa-b6f4-62a0074c893e service neutron] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:32.643778 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646dc8e-3ec6-48fa-b6f4-62a0074c893e service neutron] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:32.644052 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646dc8e-3ec6-48fa-b6f4-62a0074c893e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:32.655014 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d646dc8e-3ec6-48fa-b6f4-62a0074c893e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:32.656582 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d646dc8e-3ec6-48fa-b6f4-62a0074c893e service neutron] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:32.662739 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc4550e-61ad-4563-8318-b74fec6b7f96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:32.663506 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc4550e-61ad-4563-8318-b74fec6b7f96 service neutron] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:32.663707 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc4550e-61ad-4563-8318-b74fec6b7f96 service neutron] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:32.663955 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc4550e-61ad-4563-8318-b74fec6b7f96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:32.667612 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1282/2580] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:35:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:35:32.673901 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc4550e-61ad-4563-8318-b74fec6b7f96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:32.675344 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc4550e-61ad-4563-8318-b74fec6b7f96 service neutron] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:32.686964 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1299/2581] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:35:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 09 20:35:33.052309 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d646dc8e-3ec6-48fa-b6f4-62a0074c893e service neutron] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:33.054375 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-d646dc8e-3ec6-48fa-b6f4-62a0074c893e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:33.068425 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d646dc8e-3ec6-48fa-b6f4-62a0074c893e service neutron] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:33.079756 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3a6a78-aeea-4b8b-a8d9-cc01998b30fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:33.080863 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a6a78-aeea-4b8b-a8d9-cc01998b30fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:33.081289 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a6a78-aeea-4b8b-a8d9-cc01998b30fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:33.081567 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a6a78-aeea-4b8b-a8d9-cc01998b30fb admin admin] PATH_INFO: `/v3/projects/bf39ece9140846acbe87f01b39fe17a7` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:33.082775 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3a6a78-aeea-4b8b-a8d9-cc01998b30fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf39ece9140846acbe87f01b39fe17a7)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:33.084817 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc4550e-61ad-4563-8318-b74fec6b7f96 service neutron] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:33.084969 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3a6a78-aeea-4b8b-a8d9-cc01998b30fb admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:33.087610 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-bbc4550e-61ad-4563-8318-b74fec6b7f96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:33.108319 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc4550e-61ad-4563-8318-b74fec6b7f96 service neutron] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:33.114114 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5514991f-2aca-4659-b83f-1a404fb52817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:33.115994 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5514991f-2aca-4659-b83f-1a404fb52817 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:33.116531 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5514991f-2aca-4659-b83f-1a404fb52817 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:33.117004 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5514991f-2aca-4659-b83f-1a404fb52817 admin admin] PATH_INFO: `/v3/projects/4bce43b732404a58a09e22721d42c2c1` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:33.118487 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5514991f-2aca-4659-b83f-1a404fb52817 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bce43b732404a58a09e22721d42c2c1)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:33.120755 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5514991f-2aca-4659-b83f-1a404fb52817 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:33.160167 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-9e3a6a78-aeea-4b8b-a8d9-cc01998b30fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf39ece9140846acbe87f01b39fe17a7', 'request_id': 'req-9e3a6a78-aeea-4b8b-a8d9-cc01998b30fb'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:33.170126 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-9e3a6a78-aeea-4b8b-a8d9-cc01998b30fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf39ece9140846acbe87f01b39fe17a7', 'request_id': 'req-9e3a6a78-aeea-4b8b-a8d9-cc01998b30fb'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:33.175931 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-9e3a6a78-aeea-4b8b-a8d9-cc01998b30fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf39ece9140846acbe87f01b39fe17a7', 'request_id': 'req-9e3a6a78-aeea-4b8b-a8d9-cc01998b30fb'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:33.179786 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-5514991f-2aca-4659-b83f-1a404fb52817 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bce43b732404a58a09e22721d42c2c1', 'request_id': 'req-5514991f-2aca-4659-b83f-1a404fb52817'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:33.186272 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-5514991f-2aca-4659-b83f-1a404fb52817 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bce43b732404a58a09e22721d42c2c1', 'request_id': 'req-5514991f-2aca-4659-b83f-1a404fb52817'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:33.189129 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-9e3a6a78-aeea-4b8b-a8d9-cc01998b30fb admin admin] The token cache is being invalidate because project bf39ece9140846acbe87f01b39fe17a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:35:33.189409 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-9e3a6a78-aeea-4b8b-a8d9-cc01998b30fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:33.190044 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-9e3a6a78-aeea-4b8b-a8d9-cc01998b30fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:33.191618 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-5514991f-2aca-4659-b83f-1a404fb52817 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bce43b732404a58a09e22721d42c2c1', 'request_id': 'req-5514991f-2aca-4659-b83f-1a404fb52817'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:33.191739 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1283/2582] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:35:33 2022] DELETE /identity/v3/projects/bf39ece9140846acbe87f01b39fe17a7 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:35:33.192557 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3a6a78-aeea-4b8b-a8d9-cc01998b30fb admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:33.193855 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-9e3a6a78-aeea-4b8b-a8d9-cc01998b30fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:33.207783 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-5514991f-2aca-4659-b83f-1a404fb52817 admin admin] The token cache is being invalidate because project 4bce43b732404a58a09e22721d42c2c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:35:33.208123 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-5514991f-2aca-4659-b83f-1a404fb52817 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:33.208756 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-5514991f-2aca-4659-b83f-1a404fb52817 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:33.210533 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1300/2583] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:35:33 2022] DELETE /identity/v3/projects/4bce43b732404a58a09e22721d42c2c1 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:35:33.211073 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5514991f-2aca-4659-b83f-1a404fb52817 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:33.212333 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-5514991f-2aca-4659-b83f-1a404fb52817 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:33.274923 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3a6a78-aeea-4b8b-a8d9-cc01998b30fb admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:33.281925 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8aa7b6-bf63-49e8-b3f8-841f3a80a2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:33.283249 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8aa7b6-bf63-49e8-b3f8-841f3a80a2c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:33.283371 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5514991f-2aca-4659-b83f-1a404fb52817 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:33.284251 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8aa7b6-bf63-49e8-b3f8-841f3a80a2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:33.284740 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8aa7b6-bf63-49e8-b3f8-841f3a80a2c8 admin admin] PATH_INFO: `/v3/users/342ca2ee13bd4c82a68caf8d5186e03f` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:33.286224 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8aa7b6-bf63-49e8-b3f8-841f3a80a2c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=342ca2ee13bd4c82a68caf8d5186e03f)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:33.289388 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6863e4-e3be-431b-a02d-48e64740d599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:33.289721 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8aa7b6-bf63-49e8-b3f8-841f3a80a2c8 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:33.290429 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6863e4-e3be-431b-a02d-48e64740d599 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:33.290772 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6863e4-e3be-431b-a02d-48e64740d599 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:33.291108 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6863e4-e3be-431b-a02d-48e64740d599 admin admin] PATH_INFO: `/v3/users/a3d774093d1d494093cfe39b87294f66` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:33.292987 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6863e4-e3be-431b-a02d-48e64740d599 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3d774093d1d494093cfe39b87294f66)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:33.294667 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6863e4-e3be-431b-a02d-48e64740d599 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:33.344122 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-4f8aa7b6-bf63-49e8-b3f8-841f3a80a2c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '342ca2ee13bd4c82a68caf8d5186e03f'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:33.345094 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-0f6863e4-e3be-431b-a02d-48e64740d599 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3d774093d1d494093cfe39b87294f66'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:33.345912 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-0f6863e4-e3be-431b-a02d-48e64740d599 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3d774093d1d494093cfe39b87294f66'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:33.352507 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-4f8aa7b6-bf63-49e8-b3f8-841f3a80a2c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '342ca2ee13bd4c82a68caf8d5186e03f'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:33.354322 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-0f6863e4-e3be-431b-a02d-48e64740d599 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3d774093d1d494093cfe39b87294f66'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:33.355096 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-0f6863e4-e3be-431b-a02d-48e64740d599 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3d774093d1d494093cfe39b87294f66'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:33.361993 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-4f8aa7b6-bf63-49e8-b3f8-841f3a80a2c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '342ca2ee13bd4c82a68caf8d5186e03f'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:33.362694 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-4f8aa7b6-bf63-49e8-b3f8-841f3a80a2c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '342ca2ee13bd4c82a68caf8d5186e03f'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:33.363472 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-4f8aa7b6-bf63-49e8-b3f8-841f3a80a2c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '342ca2ee13bd4c82a68caf8d5186e03f'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:33.365545 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-0f6863e4-e3be-431b-a02d-48e64740d599 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3d774093d1d494093cfe39b87294f66'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:33.383460 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1284/2584] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:35:33 2022] DELETE /identity/v3/users/342ca2ee13bd4c82a68caf8d5186e03f => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:35:33.385008 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1301/2585] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:35:33 2022] DELETE /identity/v3/users/a3d774093d1d494093cfe39b87294f66 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:35:33.393319 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee686c6-efd5-4cb7-b4cc-e3a21e037434 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:33.393662 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee686c6-efd5-4cb7-b4cc-e3a21e037434 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:33.393946 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee686c6-efd5-4cb7-b4cc-e3a21e037434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:33.414795 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-cee686c6-efd5-4cb7-b4cc-e3a21e037434 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:35:33.416053 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-cee686c6-efd5-4cb7-b4cc-e3a21e037434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:33.481230 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1285/2586] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:35:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:35:33.492144 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6863e4-e3be-431b-a02d-48e64740d599 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:33.493777 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-0f6863e4-e3be-431b-a02d-48e64740d599 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:33.550809 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6863e4-e3be-431b-a02d-48e64740d599 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:33.555033 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81d6398-8545-4596-b757-185ae110c5a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:33.555708 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81d6398-8545-4596-b757-185ae110c5a7 service neutron] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:33.555987 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81d6398-8545-4596-b757-185ae110c5a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:33.556259 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81d6398-8545-4596-b757-185ae110c5a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:33.565199 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81d6398-8545-4596-b757-185ae110c5a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:33.566636 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81d6398-8545-4596-b757-185ae110c5a7 service neutron] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:33.577511 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1302/2587] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:35:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:35:33.728743 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee686c6-efd5-4cb7-b4cc-e3a21e037434 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:33.730173 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-cee686c6-efd5-4cb7-b4cc-e3a21e037434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:33.742384 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee686c6-efd5-4cb7-b4cc-e3a21e037434 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:33.746997 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d8e18-ca1b-4c2f-875a-ff59121ee6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:33.747962 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d8e18-ca1b-4c2f-875a-ff59121ee6fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:33.748134 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d8e18-ca1b-4c2f-875a-ff59121ee6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:33.748423 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d8e18-ca1b-4c2f-875a-ff59121ee6fa admin admin] PATH_INFO: `/v3/projects/aa09b4f1a47c490c9b52a2443154d08c` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:33.749587 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663d8e18-ca1b-4c2f-875a-ff59121ee6fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa09b4f1a47c490c9b52a2443154d08c)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:33.751698 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663d8e18-ca1b-4c2f-875a-ff59121ee6fa admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:33.805163 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-663d8e18-ca1b-4c2f-875a-ff59121ee6fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa09b4f1a47c490c9b52a2443154d08c', 'request_id': 'req-663d8e18-ca1b-4c2f-875a-ff59121ee6fa'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:33.811102 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-663d8e18-ca1b-4c2f-875a-ff59121ee6fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa09b4f1a47c490c9b52a2443154d08c', 'request_id': 'req-663d8e18-ca1b-4c2f-875a-ff59121ee6fa'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:33.816593 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-663d8e18-ca1b-4c2f-875a-ff59121ee6fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa09b4f1a47c490c9b52a2443154d08c', 'request_id': 'req-663d8e18-ca1b-4c2f-875a-ff59121ee6fa'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:33.828689 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-663d8e18-ca1b-4c2f-875a-ff59121ee6fa admin admin] The token cache is being invalidate because project aa09b4f1a47c490c9b52a2443154d08c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:35:33.828978 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-663d8e18-ca1b-4c2f-875a-ff59121ee6fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:33.829601 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-663d8e18-ca1b-4c2f-875a-ff59121ee6fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:33.831140 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1286/2588] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:35:33 2022] DELETE /identity/v3/projects/aa09b4f1a47c490c9b52a2443154d08c => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:35:33.836290 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e262b-ab7a-438a-b332-3e450084e1c9 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:33.836648 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e262b-ab7a-438a-b332-3e450084e1c9 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:33.836990 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e262b-ab7a-438a-b332-3e450084e1c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:33.854954 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-0b2e262b-ab7a-438a-b332-3e450084e1c9 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:35:33.856278 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-0b2e262b-ab7a-438a-b332-3e450084e1c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:33.914543 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d8e18-ca1b-4c2f-875a-ff59121ee6fa admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:33.916036 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-663d8e18-ca1b-4c2f-875a-ff59121ee6fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:33.923986 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1303/2589] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:35:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:35:33.926147 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9cda04-ca22-4e3a-bb3e-3abe28a21ebe None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:33.926576 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9cda04-ca22-4e3a-bb3e-3abe28a21ebe None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:33.926976 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9cda04-ca22-4e3a-bb3e-3abe28a21ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:33.930945 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d8e18-ca1b-4c2f-875a-ff59121ee6fa admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:33.935811 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9f8031-bdf1-4bf4-bb63-dbf5080ed527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:33.936667 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f8031-bdf1-4bf4-bb63-dbf5080ed527 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:33.936945 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f8031-bdf1-4bf4-bb63-dbf5080ed527 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:33.937216 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f8031-bdf1-4bf4-bb63-dbf5080ed527 admin admin] PATH_INFO: `/v3/projects/a2bd60b3779a4df1937c083c57c5a9bb` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:33.938415 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9f8031-bdf1-4bf4-bb63-dbf5080ed527 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2bd60b3779a4df1937c083c57c5a9bb)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:33.940401 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9f8031-bdf1-4bf4-bb63-dbf5080ed527 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:33.948272 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-fa9cda04-ca22-4e3a-bb3e-3abe28a21ebe None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:35:33.949480 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-fa9cda04-ca22-4e3a-bb3e-3abe28a21ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:33.958174 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1304/2590] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:35:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:35:33.962661 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9cda04-ca22-4e3a-bb3e-3abe28a21ebe None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:33.971942 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9cda04-ca22-4e3a-bb3e-3abe28a21ebe None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:33.978003 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308f5106-b2a3-4730-af5d-048c9fb6ffc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:33.978643 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f5106-b2a3-4730-af5d-048c9fb6ffc3 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:33.978926 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f5106-b2a3-4730-af5d-048c9fb6ffc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:33.979192 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f5106-b2a3-4730-af5d-048c9fb6ffc3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:33.979943 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308f5106-b2a3-4730-af5d-048c9fb6ffc3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:35:33.980244 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308f5106-b2a3-4730-af5d-048c9fb6ffc3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:33.981826 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308f5106-b2a3-4730-af5d-048c9fb6ffc3 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:33.988492 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-fb9f8031-bdf1-4bf4-bb63-dbf5080ed527 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2bd60b3779a4df1937c083c57c5a9bb', 'request_id': 'req-fb9f8031-bdf1-4bf4-bb63-dbf5080ed527'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:33.997631 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1305/2591] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 9 20:35:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:35:33.997781 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-fb9f8031-bdf1-4bf4-bb63-dbf5080ed527 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2bd60b3779a4df1937c083c57c5a9bb', 'request_id': 'req-fb9f8031-bdf1-4bf4-bb63-dbf5080ed527'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:33.998568 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308f5106-b2a3-4730-af5d-048c9fb6ffc3 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:34.001792 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-fb9f8031-bdf1-4bf4-bb63-dbf5080ed527 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2bd60b3779a4df1937c083c57c5a9bb', 'request_id': 'req-fb9f8031-bdf1-4bf4-bb63-dbf5080ed527'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:34.009770 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308f5106-b2a3-4730-af5d-048c9fb6ffc3 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:34.014641 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-fb9f8031-bdf1-4bf4-bb63-dbf5080ed527 admin admin] The token cache is being invalidate because project a2bd60b3779a4df1937c083c57c5a9bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:35:34.014925 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-fb9f8031-bdf1-4bf4-bb63-dbf5080ed527 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:34.015598 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-fb9f8031-bdf1-4bf4-bb63-dbf5080ed527 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:34.017147 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1287/2592] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:35:33 2022] DELETE /identity/v3/projects/a2bd60b3779a4df1937c083c57c5a9bb => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:35:34.020901 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9f8031-bdf1-4bf4-bb63-dbf5080ed527 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:34.022385 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-fb9f8031-bdf1-4bf4-bb63-dbf5080ed527 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:34.064628 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3580ecb2-8247-4fd4-9c58-632a885bfec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:34.065198 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580ecb2-8247-4fd4-9c58-632a885bfec1 admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:34.065476 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580ecb2-8247-4fd4-9c58-632a885bfec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:34.065746 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580ecb2-8247-4fd4-9c58-632a885bfec1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:34.066415 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3580ecb2-8247-4fd4-9c58-632a885bfec1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:34.068448 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3580ecb2-8247-4fd4-9c58-632a885bfec1 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:34.084692 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9f8031-bdf1-4bf4-bb63-dbf5080ed527 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:34.089752 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6971176-ce4f-4c27-9d86-1f5a318afab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:34.090600 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6971176-ce4f-4c27-9d86-1f5a318afab7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:34.090879 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6971176-ce4f-4c27-9d86-1f5a318afab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:34.091149 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6971176-ce4f-4c27-9d86-1f5a318afab7 admin admin] PATH_INFO: `/v3/users/db040a364b034d6eb02a46b396de1902` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:34.092374 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6971176-ce4f-4c27-9d86-1f5a318afab7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db040a364b034d6eb02a46b396de1902)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:34.097341 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1306/2593] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:35:33 2022] POST /identity/v3/projects => generated 381 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 20:35:34.097485 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6971176-ce4f-4c27-9d86-1f5a318afab7 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:34.098358 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3580ecb2-8247-4fd4-9c58-632a885bfec1 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:34.100759 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-3580ecb2-8247-4fd4-9c58-632a885bfec1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:34.141031 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-b6971176-ce4f-4c27-9d86-1f5a318afab7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db040a364b034d6eb02a46b396de1902'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:34.148101 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-b6971176-ce4f-4c27-9d86-1f5a318afab7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db040a364b034d6eb02a46b396de1902'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:34.156701 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-b6971176-ce4f-4c27-9d86-1f5a318afab7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db040a364b034d6eb02a46b396de1902'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:34.157512 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-b6971176-ce4f-4c27-9d86-1f5a318afab7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db040a364b034d6eb02a46b396de1902'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:34.158234 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-b6971176-ce4f-4c27-9d86-1f5a318afab7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db040a364b034d6eb02a46b396de1902'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:34.165379 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3580ecb2-8247-4fd4-9c58-632a885bfec1 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:34.170335 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e89674-a609-4a78-9f8d-986b84e5e5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:34.171023 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e89674-a609-4a78-9f8d-986b84e5e5e8 admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:34.171302 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e89674-a609-4a78-9f8d-986b84e5e5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:34.171627 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e89674-a609-4a78-9f8d-986b84e5e5e8 admin admin] PATH_INFO: `/v3/users` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:34.172318 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e89674-a609-4a78-9f8d-986b84e5e5e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:34.174324 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e89674-a609-4a78-9f8d-986b84e5e5e8 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:34.176524 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1288/2594] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:35:34 2022] DELETE /identity/v3/users/db040a364b034d6eb02a46b396de1902 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:35:34.199781 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1307/2595] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:35:34 2022] POST /identity/v3/users => generated 291 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 20:35:34.201276 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6971176-ce4f-4c27-9d86-1f5a318afab7 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:34.202841 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-b6971176-ce4f-4c27-9d86-1f5a318afab7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:34.271102 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6971176-ce4f-4c27-9d86-1f5a318afab7 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:34.278809 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0819d712-cae0-435a-9e20-57dd6f0671aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:34.279508 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0819d712-cae0-435a-9e20-57dd6f0671aa admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:34.279786 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0819d712-cae0-435a-9e20-57dd6f0671aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:34.280054 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0819d712-cae0-435a-9e20-57dd6f0671aa admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:34.280767 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0819d712-cae0-435a-9e20-57dd6f0671aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:34.282357 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0819d712-cae0-435a-9e20-57dd6f0671aa admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:34.293500 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1289/2596] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:35:34 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 09 20:35:34.297529 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e89674-a609-4a78-9f8d-986b84e5e5e8 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:34.307708 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e89674-a609-4a78-9f8d-986b84e5e5e8 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:34.312273 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5dc640-a5d7-4fd6-a4a6-080d48fd0a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:34.312918 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5dc640-a5d7-4fd6-a4a6-080d48fd0a98 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:34.313197 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5dc640-a5d7-4fd6-a4a6-080d48fd0a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:34.313462 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5dc640-a5d7-4fd6-a4a6-080d48fd0a98 admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:34.314168 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5dc640-a5d7-4fd6-a4a6-080d48fd0a98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:34.315876 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5dc640-a5d7-4fd6-a4a6-080d48fd0a98 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:34.326154 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1308/2597] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:35:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 09 20:35:34.330017 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0819d712-cae0-435a-9e20-57dd6f0671aa admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:34.343767 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0819d712-cae0-435a-9e20-57dd6f0671aa admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:34.348893 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d937a0c-595a-4491-b0e1-1c8748cd9a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:34.350592 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d937a0c-595a-4491-b0e1-1c8748cd9a11 admin admin] REQUEST_METHOD: `PUT` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:34.351527 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d937a0c-595a-4491-b0e1-1c8748cd9a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:34.351527 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d937a0c-595a-4491-b0e1-1c8748cd9a11 admin admin] PATH_INFO: `/v3/projects/f151a86bd77f48238e8b4e9dea9e1a1c/users/9ecfcf0e1d02449e8e8c6f25a36c4015/roles/79f90a0bf6ea43d0b3c434e31556253a` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:34.366433 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d937a0c-595a-4491-b0e1-1c8748cd9a11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f151a86bd77f48238e8b4e9dea9e1a1c, user_id=9ecfcf0e1d02449e8e8c6f25a36c4015, role_id=79f90a0bf6ea43d0b3c434e31556253a)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:34.369131 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d937a0c-595a-4491-b0e1-1c8748cd9a11 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:34.382642 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1290/2598] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:35:34 2022] PUT /identity/v3/projects/f151a86bd77f48238e8b4e9dea9e1a1c/users/9ecfcf0e1d02449e8e8c6f25a36c4015/roles/79f90a0bf6ea43d0b3c434e31556253a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:35:34.393103 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214c7897-cb3a-40b6-b2ab-2b1c71745377 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:34.393509 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214c7897-cb3a-40b6-b2ab-2b1c71745377 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:34.393867 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214c7897-cb3a-40b6-b2ab-2b1c71745377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:34.421901 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-214c7897-cb3a-40b6-b2ab-2b1c71745377 None None] MFA Rules not processed for user `9ecfcf0e1d02449e8e8c6f25a36c4015`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:35:34.423108 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-214c7897-cb3a-40b6-b2ab-2b1c71745377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:34.470122 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d937a0c-595a-4491-b0e1-1c8748cd9a11 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:34.471886 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-6d937a0c-595a-4491-b0e1-1c8748cd9a11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:34.502271 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1309/2599] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:35:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:35:34.508095 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214c7897-cb3a-40b6-b2ab-2b1c71745377 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:34.539307 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d937a0c-595a-4491-b0e1-1c8748cd9a11 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:34.543905 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f40a6a6-f2ce-4018-83f7-89f4531678c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:34.544749 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f40a6a6-f2ce-4018-83f7-89f4531678c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:34.545024 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f40a6a6-f2ce-4018-83f7-89f4531678c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:34.545290 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f40a6a6-f2ce-4018-83f7-89f4531678c6 admin admin] PATH_INFO: `/v3/projects/c8d974fe1c6e44fe95b9a72c4583eb94` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:34.546455 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f40a6a6-f2ce-4018-83f7-89f4531678c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8d974fe1c6e44fe95b9a72c4583eb94)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:34.548379 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f40a6a6-f2ce-4018-83f7-89f4531678c6 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:34.574701 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214c7897-cb3a-40b6-b2ab-2b1c71745377 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:34.581566 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcdd47f-1be1-4e93-a845-f808820e1fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:34.582619 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcdd47f-1be1-4e93-a845-f808820e1fd4 admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:34.582953 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcdd47f-1be1-4e93-a845-f808820e1fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:34.583374 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcdd47f-1be1-4e93-a845-f808820e1fd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:34.585351 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcdd47f-1be1-4e93-a845-f808820e1fd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:34.588368 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcdd47f-1be1-4e93-a845-f808820e1fd4 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:34.601992 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-0f40a6a6-f2ce-4018-83f7-89f4531678c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8d974fe1c6e44fe95b9a72c4583eb94', 'request_id': 'req-0f40a6a6-f2ce-4018-83f7-89f4531678c6'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:34.611435 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-0f40a6a6-f2ce-4018-83f7-89f4531678c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8d974fe1c6e44fe95b9a72c4583eb94', 'request_id': 'req-0f40a6a6-f2ce-4018-83f7-89f4531678c6'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:34.617838 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-0f40a6a6-f2ce-4018-83f7-89f4531678c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8d974fe1c6e44fe95b9a72c4583eb94', 'request_id': 'req-0f40a6a6-f2ce-4018-83f7-89f4531678c6'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:34.621975 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1310/2600] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:35:34 2022] POST /identity/v3/projects => generated 379 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:35:34.626738 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcdd47f-1be1-4e93-a845-f808820e1fd4 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:34.630830 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-0f40a6a6-f2ce-4018-83f7-89f4531678c6 admin admin] The token cache is being invalidate because project c8d974fe1c6e44fe95b9a72c4583eb94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:35:34.631948 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-0f40a6a6-f2ce-4018-83f7-89f4531678c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:34.632294 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-0f40a6a6-f2ce-4018-83f7-89f4531678c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:34.634095 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1291/2601] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:35:34 2022] DELETE /identity/v3/projects/c8d974fe1c6e44fe95b9a72c4583eb94 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:35:34.638638 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c373558-42e2-42d5-9263-227ef9286356 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:34.638921 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c373558-42e2-42d5-9263-227ef9286356 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:34.639195 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c373558-42e2-42d5-9263-227ef9286356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:34.656871 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-5c373558-42e2-42d5-9263-227ef9286356 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:35:34.658068 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-5c373558-42e2-42d5-9263-227ef9286356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:34.687120 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcdd47f-1be1-4e93-a845-f808820e1fd4 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:34.692363 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9dd0e2-f0b1-4358-9f62-ae6fd5716b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:34.693028 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9dd0e2-f0b1-4358-9f62-ae6fd5716b5c admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:34.693308 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9dd0e2-f0b1-4358-9f62-ae6fd5716b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:34.693745 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9dd0e2-f0b1-4358-9f62-ae6fd5716b5c admin admin] PATH_INFO: `/v3/users` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:34.694436 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9dd0e2-f0b1-4358-9f62-ae6fd5716b5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:34.696379 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9dd0e2-f0b1-4358-9f62-ae6fd5716b5c admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:34.714816 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1292/2602] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:35:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:35:34.722309 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1311/2603] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:35:34 2022] POST /identity/v3/users => generated 296 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 20:35:34.722444 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c373558-42e2-42d5-9263-227ef9286356 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:34.722444 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-5c373558-42e2-42d5-9263-227ef9286356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:34.723730 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7443d1-a2dc-426a-b33c-8e2cddbd25e5 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:34.724016 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7443d1-a2dc-426a-b33c-8e2cddbd25e5 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:34.724291 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7443d1-a2dc-426a-b33c-8e2cddbd25e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:34.732991 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c373558-42e2-42d5-9263-227ef9286356 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:34.737571 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc79526a-89f3-4132-9de3-f78198b65865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:34.738217 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc79526a-89f3-4132-9de3-f78198b65865 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:34.738495 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc79526a-89f3-4132-9de3-f78198b65865 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:34.738763 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc79526a-89f3-4132-9de3-f78198b65865 admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:34.739509 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc79526a-89f3-4132-9de3-f78198b65865 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:34.741362 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc79526a-89f3-4132-9de3-f78198b65865 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:34.742681 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-5c7443d1-a2dc-426a-b33c-8e2cddbd25e5 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:35:34.743882 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-5c7443d1-a2dc-426a-b33c-8e2cddbd25e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:34.751834 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1293/2604] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:35:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 09 20:35:34.751991 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1312/2605] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:35:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:35:34.755709 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc79526a-89f3-4132-9de3-f78198b65865 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:34.755835 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7443d1-a2dc-426a-b33c-8e2cddbd25e5 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:34.766233 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7443d1-a2dc-426a-b33c-8e2cddbd25e5 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:34.768737 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc79526a-89f3-4132-9de3-f78198b65865 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:34.770990 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18195e63-fbdc-422f-9355-65d90f3e9134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:34.772569 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18195e63-fbdc-422f-9355-65d90f3e9134 admin admin] REQUEST_METHOD: `PUT` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:34.772847 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18195e63-fbdc-422f-9355-65d90f3e9134 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:34.773116 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18195e63-fbdc-422f-9355-65d90f3e9134 admin admin] PATH_INFO: `/v3/projects/5e58afcc05a242d08ddc0fba7735f904/users/9592e1c6d2b14efa83359199111d5085/roles/274130b78e304bb88789c1b349263f3c` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:34.775987 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef335603-d16f-4f02-a9c3-6a7112a3269a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:34.776630 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef335603-d16f-4f02-a9c3-6a7112a3269a admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:34.776909 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef335603-d16f-4f02-a9c3-6a7112a3269a admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:34.777180 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef335603-d16f-4f02-a9c3-6a7112a3269a admin admin] PATH_INFO: `/v3/domains` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:34.777889 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef335603-d16f-4f02-a9c3-6a7112a3269a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:35:34.778191 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef335603-d16f-4f02-a9c3-6a7112a3269a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:34.779816 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef335603-d16f-4f02-a9c3-6a7112a3269a admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:34.788744 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18195e63-fbdc-422f-9355-65d90f3e9134 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e58afcc05a242d08ddc0fba7735f904, user_id=9592e1c6d2b14efa83359199111d5085, role_id=274130b78e304bb88789c1b349263f3c)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:34.791359 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18195e63-fbdc-422f-9355-65d90f3e9134 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:34.792053 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1294/2606] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 9 20:35:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:35:34.796058 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef335603-d16f-4f02-a9c3-6a7112a3269a admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:34.806105 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef335603-d16f-4f02-a9c3-6a7112a3269a admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:34.808864 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1313/2607] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:35:34 2022] PUT /identity/v3/projects/5e58afcc05a242d08ddc0fba7735f904/users/9592e1c6d2b14efa83359199111d5085/roles/274130b78e304bb88789c1b349263f3c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:35:34.812722 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18195e63-fbdc-422f-9355-65d90f3e9134 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:34.861337 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d7a3e-37e8-44b6-8021-ff4048709bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:34.862054 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d7a3e-37e8-44b6-8021-ff4048709bd2 admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:34.862442 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d7a3e-37e8-44b6-8021-ff4048709bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:34.862786 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d7a3e-37e8-44b6-8021-ff4048709bd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:34.863603 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821d7a3e-37e8-44b6-8021-ff4048709bd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:34.866401 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821d7a3e-37e8-44b6-8021-ff4048709bd2 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:34.873216 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18195e63-fbdc-422f-9355-65d90f3e9134 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:34.877909 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0818393-32d8-4461-8059-2fc775314d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:34.878582 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0818393-32d8-4461-8059-2fc775314d3b admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:34.878874 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0818393-32d8-4461-8059-2fc775314d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:34.879140 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0818393-32d8-4461-8059-2fc775314d3b admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:34.879916 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0818393-32d8-4461-8059-2fc775314d3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:34.882079 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0818393-32d8-4461-8059-2fc775314d3b admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:34.893600 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1314/2608] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:35:34 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 09 20:35:34.897723 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0818393-32d8-4461-8059-2fc775314d3b admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:34.903783 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1295/2609] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:35:34 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 20:35:34.904913 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d7a3e-37e8-44b6-8021-ff4048709bd2 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:34.908029 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0818393-32d8-4461-8059-2fc775314d3b admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:34.969787 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3159ca0-6846-404e-b382-cbd86e14026f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:34.970697 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3159ca0-6846-404e-b382-cbd86e14026f admin admin] REQUEST_METHOD: `PUT` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:34.970944 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d7a3e-37e8-44b6-8021-ff4048709bd2 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:34.971067 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3159ca0-6846-404e-b382-cbd86e14026f admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:34.971239 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3159ca0-6846-404e-b382-cbd86e14026f admin admin] PATH_INFO: `/v3/projects/5e58afcc05a242d08ddc0fba7735f904/users/9592e1c6d2b14efa83359199111d5085/roles/274130b78e304bb88789c1b349263f3c` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:34.973270 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3159ca0-6846-404e-b382-cbd86e14026f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e58afcc05a242d08ddc0fba7735f904, user_id=9592e1c6d2b14efa83359199111d5085, role_id=274130b78e304bb88789c1b349263f3c)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:34.975590 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1189ab-d3ba-4331-84f8-d98a922d0272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:34.976238 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1189ab-d3ba-4331-84f8-d98a922d0272 admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:34.976440 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3159ca0-6846-404e-b382-cbd86e14026f admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:34.976549 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1189ab-d3ba-4331-84f8-d98a922d0272 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:34.976769 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1189ab-d3ba-4331-84f8-d98a922d0272 admin admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:34.977436 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1189ab-d3ba-4331-84f8-d98a922d0272 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:34.979323 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1189ab-d3ba-4331-84f8-d98a922d0272 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:34.986460 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1315/2610] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:35:34 2022] PUT /identity/v3/projects/5e58afcc05a242d08ddc0fba7735f904/users/9592e1c6d2b14efa83359199111d5085/roles/274130b78e304bb88789c1b349263f3c => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:35:34.998944 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c483cf9e-5d98-426e-b19e-cd0ea0799800 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:34.999229 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c483cf9e-5d98-426e-b19e-cd0ea0799800 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:34.999524 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1296/2611] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:35:34 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:35:34.999815 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c483cf9e-5d98-426e-b19e-cd0ea0799800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:35.003489 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1189ab-d3ba-4331-84f8-d98a922d0272 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:35.014976 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1189ab-d3ba-4331-84f8-d98a922d0272 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:35.029516 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-c483cf9e-5d98-426e-b19e-cd0ea0799800 None None] MFA Rules not processed for user `9592e1c6d2b14efa83359199111d5085`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:35:35.030994 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-c483cf9e-5d98-426e-b19e-cd0ea0799800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:35.074555 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd03a44a-a807-4618-be9e-2b8cabef15f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:35.075213 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd03a44a-a807-4618-be9e-2b8cabef15f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:35.075522 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd03a44a-a807-4618-be9e-2b8cabef15f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:35.075794 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd03a44a-a807-4618-be9e-2b8cabef15f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:35.076504 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd03a44a-a807-4618-be9e-2b8cabef15f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:35.078101 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd03a44a-a807-4618-be9e-2b8cabef15f9 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:35.087785 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1297/2612] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:35:35 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 09 20:35:35.091610 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd03a44a-a807-4618-be9e-2b8cabef15f9 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:35.097756 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1316/2613] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:35:34 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:35:35.101150 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd03a44a-a807-4618-be9e-2b8cabef15f9 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:35.105824 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c386adec-e99a-4204-b127-f08ca11a39b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:35.106468 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386adec-e99a-4204-b127-f08ca11a39b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:35.106745 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386adec-e99a-4204-b127-f08ca11a39b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:35.107015 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386adec-e99a-4204-b127-f08ca11a39b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:35.107753 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c386adec-e99a-4204-b127-f08ca11a39b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:35.109396 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c386adec-e99a-4204-b127-f08ca11a39b8 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:35.109684 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c483cf9e-5d98-426e-b19e-cd0ea0799800 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:35.111054 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-c483cf9e-5d98-426e-b19e-cd0ea0799800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:35.119912 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1298/2614] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:35:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 09 20:35:35.123836 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c386adec-e99a-4204-b127-f08ca11a39b8 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:35.134085 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c386adec-e99a-4204-b127-f08ca11a39b8 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:35.138953 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8251faed-b02a-454c-a771-88dc7b8a7474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:35.139834 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8251faed-b02a-454c-a771-88dc7b8a7474 admin admin] REQUEST_METHOD: `PUT` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:35.140112 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8251faed-b02a-454c-a771-88dc7b8a7474 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:35.140380 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8251faed-b02a-454c-a771-88dc7b8a7474 admin admin] PATH_INFO: `/v3/projects/f15585ae8e2a44b28ee1536a66cba3c6/users/3597d56021f548789cbeb021fda5b266/roles/79f90a0bf6ea43d0b3c434e31556253a` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:35.155448 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8251faed-b02a-454c-a771-88dc7b8a7474 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f15585ae8e2a44b28ee1536a66cba3c6, user_id=3597d56021f548789cbeb021fda5b266, role_id=79f90a0bf6ea43d0b3c434e31556253a)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:35.158091 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8251faed-b02a-454c-a771-88dc7b8a7474 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:35.169652 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c483cf9e-5d98-426e-b19e-cd0ea0799800 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:35.171454 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1299/2615] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:35:35 2022] PUT /identity/v3/projects/f15585ae8e2a44b28ee1536a66cba3c6/users/3597d56021f548789cbeb021fda5b266/roles/79f90a0bf6ea43d0b3c434e31556253a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:35:35.183251 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0800d1b-8859-4c5c-b3de-36447428f223 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:35.183576 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0800d1b-8859-4c5c-b3de-36447428f223 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:35.183847 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0800d1b-8859-4c5c-b3de-36447428f223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:35.209236 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-c0800d1b-8859-4c5c-b3de-36447428f223 None None] MFA Rules not processed for user `3597d56021f548789cbeb021fda5b266`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:35:35.210700 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-c0800d1b-8859-4c5c-b3de-36447428f223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:35.219101 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ae1f47-2a4c-41f4-9055-ff1462456b1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d65e731386d44948dcc1ecd40cbda65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:35.219801 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae1f47-2a4c-41f4-9055-ff1462456b1f service cinder] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:35.220087 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae1f47-2a4c-41f4-9055-ff1462456b1f service cinder] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:35.220477 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae1f47-2a4c-41f4-9055-ff1462456b1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:35.274531 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1300/2616] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:35:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:35:35.279053 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0800d1b-8859-4c5c-b3de-36447428f223 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:35.279234 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ae1f47-2a4c-41f4-9055-ff1462456b1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:35.280731 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ae1f47-2a4c-41f4-9055-ff1462456b1f service cinder] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:35.290938 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1317/2617] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:35:35 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 09 20:35:35.345504 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0800d1b-8859-4c5c-b3de-36447428f223 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:35.350884 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462de189-fd26-4d15-a651-bd63239917c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:35.351562 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462de189-fd26-4d15-a651-bd63239917c7 admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:35.351840 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462de189-fd26-4d15-a651-bd63239917c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:35.352108 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462de189-fd26-4d15-a651-bd63239917c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:35.352790 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462de189-fd26-4d15-a651-bd63239917c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:35.354673 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462de189-fd26-4d15-a651-bd63239917c7 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:35.382894 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1301/2618] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:35:35 2022] POST /identity/v3/projects => generated 387 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 20:35:35.387114 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ae1f47-2a4c-41f4-9055-ff1462456b1f service cinder] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:35.406070 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ae1f47-2a4c-41f4-9055-ff1462456b1f service cinder] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:35.479058 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb068c2f-44bb-4fc7-b95f-5cd582609abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:35.479781 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb068c2f-44bb-4fc7-b95f-5cd582609abf admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:35.480318 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb068c2f-44bb-4fc7-b95f-5cd582609abf admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:35.480615 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb068c2f-44bb-4fc7-b95f-5cd582609abf admin admin] PATH_INFO: `/v3/users` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:35.481420 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb068c2f-44bb-4fc7-b95f-5cd582609abf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:35.483757 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb068c2f-44bb-4fc7-b95f-5cd582609abf admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:35.507745 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1318/2619] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:35:35 2022] POST /identity/v3/users => generated 300 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:35:35.508984 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462de189-fd26-4d15-a651-bd63239917c7 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:35.520714 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462de189-fd26-4d15-a651-bd63239917c7 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:35.527206 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea6ea74-285c-4a79-9839-62e8496173ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:35.527906 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6ea74-285c-4a79-9839-62e8496173ad admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:35.528191 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6ea74-285c-4a79-9839-62e8496173ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:35.528470 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6ea74-285c-4a79-9839-62e8496173ad admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:35.529213 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea6ea74-285c-4a79-9839-62e8496173ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:35.530797 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea6ea74-285c-4a79-9839-62e8496173ad admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:35.542646 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1302/2620] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:35:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 09 20:35:35.546955 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb068c2f-44bb-4fc7-b95f-5cd582609abf admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:35.557709 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb068c2f-44bb-4fc7-b95f-5cd582609abf admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:35.562337 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83953e0-482e-4c93-a9d7-29f2bd465a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:35.563222 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83953e0-482e-4c93-a9d7-29f2bd465a27 admin admin] REQUEST_METHOD: `PUT` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:35.563535 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83953e0-482e-4c93-a9d7-29f2bd465a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:35.563816 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83953e0-482e-4c93-a9d7-29f2bd465a27 admin admin] PATH_INFO: `/v3/projects/0176b251c9d04c5ba3be400156beab1b/users/ca81b3a58c734a77b64609e1b82838ca/roles/274130b78e304bb88789c1b349263f3c` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:35.579754 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83953e0-482e-4c93-a9d7-29f2bd465a27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0176b251c9d04c5ba3be400156beab1b, user_id=ca81b3a58c734a77b64609e1b82838ca, role_id=274130b78e304bb88789c1b349263f3c)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:35.582422 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83953e0-482e-4c93-a9d7-29f2bd465a27 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:35.597245 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1319/2621] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:35:35 2022] PUT /identity/v3/projects/0176b251c9d04c5ba3be400156beab1b/users/ca81b3a58c734a77b64609e1b82838ca/roles/274130b78e304bb88789c1b349263f3c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:35:35.601966 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea6ea74-285c-4a79-9839-62e8496173ad admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:35.611733 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea6ea74-285c-4a79-9839-62e8496173ad admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:35.623243 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83953e0-482e-4c93-a9d7-29f2bd465a27 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:35.669487 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ff606-6a24-4df2-a256-07890d511081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:35.670188 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ff606-6a24-4df2-a256-07890d511081 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:35.670743 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ff606-6a24-4df2-a256-07890d511081 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:35.670743 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ff606-6a24-4df2-a256-07890d511081 admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:35.671473 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88ff606-6a24-4df2-a256-07890d511081 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:35.673068 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88ff606-6a24-4df2-a256-07890d511081 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:35.683672 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1303/2622] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:35:35 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:35:35.687640 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ff606-6a24-4df2-a256-07890d511081 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:35.690094 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83953e0-482e-4c93-a9d7-29f2bd465a27 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:35.694900 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc5f9f2-09a2-44ea-834f-200ebd0e633c tempest-VolumeQuotaClassesTest-952132151 tempest-VolumeQuotaClassesTest-952132151-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9592e1c6d2b14efa83359199111d5085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e58afcc05a242d08ddc0fba7735f904', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:35.695574 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc5f9f2-09a2-44ea-834f-200ebd0e633c tempest-VolumeQuotaClassesTest-952132151 tempest-VolumeQuotaClassesTest-952132151-project-admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:35.695856 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc5f9f2-09a2-44ea-834f-200ebd0e633c tempest-VolumeQuotaClassesTest-952132151 tempest-VolumeQuotaClassesTest-952132151-project-admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:35.696131 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc5f9f2-09a2-44ea-834f-200ebd0e633c tempest-VolumeQuotaClassesTest-952132151 tempest-VolumeQuotaClassesTest-952132151-project-admin] PATH_INFO: `/v3/domains` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:35.696854 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc5f9f2-09a2-44ea-834f-200ebd0e633c tempest-VolumeQuotaClassesTest-952132151 tempest-VolumeQuotaClassesTest-952132151-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:35:35.697159 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc5f9f2-09a2-44ea-834f-200ebd0e633c tempest-VolumeQuotaClassesTest-952132151 tempest-VolumeQuotaClassesTest-952132151-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:35.697389 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ff606-6a24-4df2-a256-07890d511081 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:35.698806 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc5f9f2-09a2-44ea-834f-200ebd0e633c tempest-VolumeQuotaClassesTest-952132151 tempest-VolumeQuotaClassesTest-952132151-project-admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:35.702097 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb1ed9a-703d-4755-9b5d-3056e59d3f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:35.702941 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb1ed9a-703d-4755-9b5d-3056e59d3f58 admin admin] REQUEST_METHOD: `PUT` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:35.703216 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb1ed9a-703d-4755-9b5d-3056e59d3f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:35.703519 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb1ed9a-703d-4755-9b5d-3056e59d3f58 admin admin] PATH_INFO: `/v3/projects/0176b251c9d04c5ba3be400156beab1b/users/ca81b3a58c734a77b64609e1b82838ca/roles/274130b78e304bb88789c1b349263f3c` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:35.705450 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb1ed9a-703d-4755-9b5d-3056e59d3f58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0176b251c9d04c5ba3be400156beab1b, user_id=ca81b3a58c734a77b64609e1b82838ca, role_id=274130b78e304bb88789c1b349263f3c)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:35.708138 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb1ed9a-703d-4755-9b5d-3056e59d3f58 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:35.714126 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1320/2623] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 9 20:35:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:35:35.715143 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc5f9f2-09a2-44ea-834f-200ebd0e633c tempest-VolumeQuotaClassesTest-952132151 tempest-VolumeQuotaClassesTest-952132151-project-admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:35.719300 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1304/2624] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:35:35 2022] PUT /identity/v3/projects/0176b251c9d04c5ba3be400156beab1b/users/ca81b3a58c734a77b64609e1b82838ca/roles/274130b78e304bb88789c1b349263f3c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:35:35.729039 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc5f9f2-09a2-44ea-834f-200ebd0e633c tempest-VolumeQuotaClassesTest-952132151 tempest-VolumeQuotaClassesTest-952132151-project-admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:35.731297 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f6810a-f588-437f-8baf-5f090ba38e1c None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:35.731621 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f6810a-f588-437f-8baf-5f090ba38e1c None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:35.731933 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f6810a-f588-437f-8baf-5f090ba38e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:35.757668 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-c3f6810a-f588-437f-8baf-5f090ba38e1c None None] MFA Rules not processed for user `ca81b3a58c734a77b64609e1b82838ca`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:35:35.758950 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-c3f6810a-f588-437f-8baf-5f090ba38e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:35.784663 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f00f8d0-35a1-4a21-8b44-2daaff58cbc9 tempest-VolumeQuotaClassesTest-952132151 tempest-VolumeQuotaClassesTest-952132151-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9592e1c6d2b14efa83359199111d5085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e58afcc05a242d08ddc0fba7735f904', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:35.785318 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00f8d0-35a1-4a21-8b44-2daaff58cbc9 tempest-VolumeQuotaClassesTest-952132151 tempest-VolumeQuotaClassesTest-952132151-project-admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:35.785609 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00f8d0-35a1-4a21-8b44-2daaff58cbc9 tempest-VolumeQuotaClassesTest-952132151 tempest-VolumeQuotaClassesTest-952132151-project-admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:35.785888 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00f8d0-35a1-4a21-8b44-2daaff58cbc9 tempest-VolumeQuotaClassesTest-952132151 tempest-VolumeQuotaClassesTest-952132151-project-admin] PATH_INFO: `/v3/projects` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:35.786569 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f00f8d0-35a1-4a21-8b44-2daaff58cbc9 tempest-VolumeQuotaClassesTest-952132151 tempest-VolumeQuotaClassesTest-952132151-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:35.789643 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f00f8d0-35a1-4a21-8b44-2daaff58cbc9 tempest-VolumeQuotaClassesTest-952132151 tempest-VolumeQuotaClassesTest-952132151-project-admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:35.819680 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1321/2625] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:35:35 2022] POST /identity/v3/projects => generated 353 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 20:35:35.820814 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f00f8d0-35a1-4a21-8b44-2daaff58cbc9 tempest-VolumeQuotaClassesTest-952132151 tempest-VolumeQuotaClassesTest-952132151-project-admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:35.828532 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1305/2626] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:35:35 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:35:35.839616 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f6810a-f588-437f-8baf-5f090ba38e1c None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:35.841030 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-c3f6810a-f588-437f-8baf-5f090ba38e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:35.882256 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f00f8d0-35a1-4a21-8b44-2daaff58cbc9 tempest-VolumeQuotaClassesTest-952132151 tempest-VolumeQuotaClassesTest-952132151-project-admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:35.886994 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df419c4-185d-4c63-b8bd-08deb059809d tempest-VolumeQuotaClassesTest-952132151 tempest-VolumeQuotaClassesTest-952132151-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9592e1c6d2b14efa83359199111d5085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e58afcc05a242d08ddc0fba7735f904', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:35.887672 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df419c4-185d-4c63-b8bd-08deb059809d tempest-VolumeQuotaClassesTest-952132151 tempest-VolumeQuotaClassesTest-952132151-project-admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:35.887962 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df419c4-185d-4c63-b8bd-08deb059809d tempest-VolumeQuotaClassesTest-952132151 tempest-VolumeQuotaClassesTest-952132151-project-admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:35.888230 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df419c4-185d-4c63-b8bd-08deb059809d tempest-VolumeQuotaClassesTest-952132151 tempest-VolumeQuotaClassesTest-952132151-project-admin] PATH_INFO: `/v3/domains` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:35.888948 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df419c4-185d-4c63-b8bd-08deb059809d tempest-VolumeQuotaClassesTest-952132151 tempest-VolumeQuotaClassesTest-952132151-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:35:35.889253 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df419c4-185d-4c63-b8bd-08deb059809d tempest-VolumeQuotaClassesTest-952132151 tempest-VolumeQuotaClassesTest-952132151-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:35.890852 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df419c4-185d-4c63-b8bd-08deb059809d tempest-VolumeQuotaClassesTest-952132151 tempest-VolumeQuotaClassesTest-952132151-project-admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:35.895462 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f6810a-f588-437f-8baf-5f090ba38e1c None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:35.903135 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1322/2627] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 9 20:35:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:35:35.943131 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df419c4-185d-4c63-b8bd-08deb059809d tempest-VolumeQuotaClassesTest-952132151 tempest-VolumeQuotaClassesTest-952132151-project-admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:35.943540 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d23e5-d542-433c-a1b0-d56c1624ad77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d65e731386d44948dcc1ecd40cbda65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:35.944692 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d23e5-d542-433c-a1b0-d56c1624ad77 service cinder] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:35.945018 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d23e5-d542-433c-a1b0-d56c1624ad77 service cinder] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:35.945314 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d23e5-d542-433c-a1b0-d56c1624ad77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:35.954606 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df419c4-185d-4c63-b8bd-08deb059809d tempest-VolumeQuotaClassesTest-952132151 tempest-VolumeQuotaClassesTest-952132151-project-admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:35.959705 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e05653-5637-4158-94fe-e042f5e40bea tempest-VolumeQuotaClassesTest-952132151 tempest-VolumeQuotaClassesTest-952132151-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9592e1c6d2b14efa83359199111d5085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e58afcc05a242d08ddc0fba7735f904', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:35.960557 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e05653-5637-4158-94fe-e042f5e40bea tempest-VolumeQuotaClassesTest-952132151 tempest-VolumeQuotaClassesTest-952132151-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:35.960872 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e05653-5637-4158-94fe-e042f5e40bea tempest-VolumeQuotaClassesTest-952132151 tempest-VolumeQuotaClassesTest-952132151-project-admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:35.961154 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e05653-5637-4158-94fe-e042f5e40bea tempest-VolumeQuotaClassesTest-952132151 tempest-VolumeQuotaClassesTest-952132151-project-admin] PATH_INFO: `/v3/projects/b8164fdcce3543b0ba0d0c81141239ac` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:35.962349 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e05653-5637-4158-94fe-e042f5e40bea tempest-VolumeQuotaClassesTest-952132151 tempest-VolumeQuotaClassesTest-952132151-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b8164fdcce3543b0ba0d0c81141239ac)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:35.964325 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e05653-5637-4158-94fe-e042f5e40bea tempest-VolumeQuotaClassesTest-952132151 tempest-VolumeQuotaClassesTest-952132151-project-admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:36.005952 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24d23e5-d542-433c-a1b0-d56c1624ad77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:36.007769 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24d23e5-d542-433c-a1b0-d56c1624ad77 service cinder] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:36.013421 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-30e05653-5637-4158-94fe-e042f5e40bea tempest-VolumeQuotaClassesTest-952132151 tempest-VolumeQuotaClassesTest-952132151-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8164fdcce3543b0ba0d0c81141239ac', 'request_id': 'req-30e05653-5637-4158-94fe-e042f5e40bea'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:36.017134 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1306/2628] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:35:35 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 09 20:35:36.019870 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-30e05653-5637-4158-94fe-e042f5e40bea tempest-VolumeQuotaClassesTest-952132151 tempest-VolumeQuotaClassesTest-952132151-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8164fdcce3543b0ba0d0c81141239ac', 'request_id': 'req-30e05653-5637-4158-94fe-e042f5e40bea'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:36.025772 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-30e05653-5637-4158-94fe-e042f5e40bea tempest-VolumeQuotaClassesTest-952132151 tempest-VolumeQuotaClassesTest-952132151-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8164fdcce3543b0ba0d0c81141239ac', 'request_id': 'req-30e05653-5637-4158-94fe-e042f5e40bea'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:36.044313 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-30e05653-5637-4158-94fe-e042f5e40bea tempest-VolumeQuotaClassesTest-952132151 tempest-VolumeQuotaClassesTest-952132151-project-admin] The token cache is being invalidate because project b8164fdcce3543b0ba0d0c81141239ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:35:36.044313 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-30e05653-5637-4158-94fe-e042f5e40bea tempest-VolumeQuotaClassesTest-952132151 tempest-VolumeQuotaClassesTest-952132151-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:36.044313 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-30e05653-5637-4158-94fe-e042f5e40bea tempest-VolumeQuotaClassesTest-952132151 tempest-VolumeQuotaClassesTest-952132151-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:36.044313 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1323/2629] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:35:35 2022] DELETE /identity/v3/projects/b8164fdcce3543b0ba0d0c81141239ac => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:35:36.046572 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d23e5-d542-433c-a1b0-d56c1624ad77 service cinder] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:36.106997 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d23e5-d542-433c-a1b0-d56c1624ad77 service cinder] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:36.168487 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cad2f66-5298-43fb-93a4-29febc401ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:36.169451 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad2f66-5298-43fb-93a4-29febc401ee4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:36.169821 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad2f66-5298-43fb-93a4-29febc401ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:36.170114 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad2f66-5298-43fb-93a4-29febc401ee4 admin admin] PATH_INFO: `/v3/users/3597d56021f548789cbeb021fda5b266` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:36.171346 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cad2f66-5298-43fb-93a4-29febc401ee4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3597d56021f548789cbeb021fda5b266)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:36.173326 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cad2f66-5298-43fb-93a4-29febc401ee4 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:36.223607 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-1cad2f66-5298-43fb-93a4-29febc401ee4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3597d56021f548789cbeb021fda5b266'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:36.228902 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e05653-5637-4158-94fe-e042f5e40bea tempest-VolumeQuotaClassesTest-952132151 tempest-VolumeQuotaClassesTest-952132151-project-admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:36.230381 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-30e05653-5637-4158-94fe-e042f5e40bea tempest-VolumeQuotaClassesTest-952132151 tempest-VolumeQuotaClassesTest-952132151-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:36.231164 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-1cad2f66-5298-43fb-93a4-29febc401ee4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3597d56021f548789cbeb021fda5b266'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:36.238626 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-1cad2f66-5298-43fb-93a4-29febc401ee4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3597d56021f548789cbeb021fda5b266'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:36.239172 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-1cad2f66-5298-43fb-93a4-29febc401ee4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3597d56021f548789cbeb021fda5b266'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:36.239840 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-1cad2f66-5298-43fb-93a4-29febc401ee4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3597d56021f548789cbeb021fda5b266'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:36.245188 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e05653-5637-4158-94fe-e042f5e40bea tempest-VolumeQuotaClassesTest-952132151 tempest-VolumeQuotaClassesTest-952132151-project-admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:36.249783 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016885de-e530-4bd1-b466-323bdb8293da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:36.250702 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016885de-e530-4bd1-b466-323bdb8293da admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:36.251043 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016885de-e530-4bd1-b466-323bdb8293da admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:36.251378 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016885de-e530-4bd1-b466-323bdb8293da admin admin] PATH_INFO: `/v3/users/9ecfcf0e1d02449e8e8c6f25a36c4015` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:36.252637 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016885de-e530-4bd1-b466-323bdb8293da admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ecfcf0e1d02449e8e8c6f25a36c4015)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:36.254607 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016885de-e530-4bd1-b466-323bdb8293da admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:36.257274 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1307/2630] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:35:36 2022] DELETE /identity/v3/users/3597d56021f548789cbeb021fda5b266 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:35:36.262523 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded600e5-7835-4c40-ae6d-9893a28abf39 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:36.262807 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded600e5-7835-4c40-ae6d-9893a28abf39 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:36.263077 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded600e5-7835-4c40-ae6d-9893a28abf39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:36.280371 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-ded600e5-7835-4c40-ae6d-9893a28abf39 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:35:36.281697 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-ded600e5-7835-4c40-ae6d-9893a28abf39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:36.300481 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-016885de-e530-4bd1-b466-323bdb8293da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ecfcf0e1d02449e8e8c6f25a36c4015'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:36.301339 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-016885de-e530-4bd1-b466-323bdb8293da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ecfcf0e1d02449e8e8c6f25a36c4015'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:36.308759 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-016885de-e530-4bd1-b466-323bdb8293da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ecfcf0e1d02449e8e8c6f25a36c4015'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:36.309591 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-016885de-e530-4bd1-b466-323bdb8293da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ecfcf0e1d02449e8e8c6f25a36c4015'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:36.316611 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-016885de-e530-4bd1-b466-323bdb8293da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ecfcf0e1d02449e8e8c6f25a36c4015'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:36.334666 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1324/2631] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:35:36 2022] DELETE /identity/v3/users/9ecfcf0e1d02449e8e8c6f25a36c4015 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:35:36.339075 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9735fdd-cd0b-4604-a4d5-41b25963ddfe None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:36.339360 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9735fdd-cd0b-4604-a4d5-41b25963ddfe None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:36.339782 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9735fdd-cd0b-4604-a4d5-41b25963ddfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:36.344392 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1308/2632] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:35:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:35:36.356287 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded600e5-7835-4c40-ae6d-9893a28abf39 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:36.357552 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-e9735fdd-cd0b-4604-a4d5-41b25963ddfe None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:35:36.357695 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-ded600e5-7835-4c40-ae6d-9893a28abf39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:36.358708 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-e9735fdd-cd0b-4604-a4d5-41b25963ddfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:36.412920 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded600e5-7835-4c40-ae6d-9893a28abf39 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:36.416831 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1325/2633] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:35:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:35:36.426508 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9735fdd-cd0b-4604-a4d5-41b25963ddfe None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:36.427898 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-e9735fdd-cd0b-4604-a4d5-41b25963ddfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:36.459740 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f729c17-6f72-4781-a0c8-ea120b41aa16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:36.460478 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f729c17-6f72-4781-a0c8-ea120b41aa16 service neutron] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:36.460779 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f729c17-6f72-4781-a0c8-ea120b41aa16 service neutron] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:36.461713 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f729c17-6f72-4781-a0c8-ea120b41aa16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:36.470016 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f729c17-6f72-4781-a0c8-ea120b41aa16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:36.471476 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f729c17-6f72-4781-a0c8-ea120b41aa16 service neutron] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:36.482362 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1309/2634] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:35:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 09 20:35:36.483150 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9735fdd-cd0b-4604-a4d5-41b25963ddfe None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:36.487673 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82776b6-df9a-4f46-ae7d-853ff30b0cb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:36.488419 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82776b6-df9a-4f46-ae7d-853ff30b0cb2 service neutron] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:36.488877 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82776b6-df9a-4f46-ae7d-853ff30b0cb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:36.489183 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82776b6-df9a-4f46-ae7d-853ff30b0cb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:36.498572 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82776b6-df9a-4f46-ae7d-853ff30b0cb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:36.500107 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82776b6-df9a-4f46-ae7d-853ff30b0cb2 service neutron] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:36.510665 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1326/2635] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:35:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 09 20:35:36.822144 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f729c17-6f72-4781-a0c8-ea120b41aa16 service neutron] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:36.824105 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-5f729c17-6f72-4781-a0c8-ea120b41aa16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:36.852972 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82776b6-df9a-4f46-ae7d-853ff30b0cb2 service neutron] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:36.853895 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f729c17-6f72-4781-a0c8-ea120b41aa16 service neutron] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:36.855756 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-b82776b6-df9a-4f46-ae7d-853ff30b0cb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:36.860154 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867fe893-4580-442d-b4e0-cbdd7f8d5c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:36.861154 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867fe893-4580-442d-b4e0-cbdd7f8d5c74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:36.861501 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867fe893-4580-442d-b4e0-cbdd7f8d5c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:36.861840 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867fe893-4580-442d-b4e0-cbdd7f8d5c74 admin admin] PATH_INFO: `/v3/projects/f15585ae8e2a44b28ee1536a66cba3c6` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:36.863216 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867fe893-4580-442d-b4e0-cbdd7f8d5c74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f15585ae8e2a44b28ee1536a66cba3c6)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:36.866803 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867fe893-4580-442d-b4e0-cbdd7f8d5c74 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:36.869412 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82776b6-df9a-4f46-ae7d-853ff30b0cb2 service neutron] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:36.873887 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55063708-dba5-4690-9962-df0220f74ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:36.874798 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55063708-dba5-4690-9962-df0220f74ca6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:36.875091 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55063708-dba5-4690-9962-df0220f74ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:36.875367 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55063708-dba5-4690-9962-df0220f74ca6 admin admin] PATH_INFO: `/v3/projects/f151a86bd77f48238e8b4e9dea9e1a1c` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:36.876616 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55063708-dba5-4690-9962-df0220f74ca6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f151a86bd77f48238e8b4e9dea9e1a1c)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:36.878510 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55063708-dba5-4690-9962-df0220f74ca6 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:36.918031 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-867fe893-4580-442d-b4e0-cbdd7f8d5c74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f15585ae8e2a44b28ee1536a66cba3c6', 'request_id': 'req-867fe893-4580-442d-b4e0-cbdd7f8d5c74'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:36.923926 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-867fe893-4580-442d-b4e0-cbdd7f8d5c74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f15585ae8e2a44b28ee1536a66cba3c6', 'request_id': 'req-867fe893-4580-442d-b4e0-cbdd7f8d5c74'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:36.925271 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-55063708-dba5-4690-9962-df0220f74ca6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f151a86bd77f48238e8b4e9dea9e1a1c', 'request_id': 'req-55063708-dba5-4690-9962-df0220f74ca6'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:36.929871 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-867fe893-4580-442d-b4e0-cbdd7f8d5c74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f15585ae8e2a44b28ee1536a66cba3c6', 'request_id': 'req-867fe893-4580-442d-b4e0-cbdd7f8d5c74'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:36.931300 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-55063708-dba5-4690-9962-df0220f74ca6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f151a86bd77f48238e8b4e9dea9e1a1c', 'request_id': 'req-55063708-dba5-4690-9962-df0220f74ca6'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:36.937283 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-55063708-dba5-4690-9962-df0220f74ca6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f151a86bd77f48238e8b4e9dea9e1a1c', 'request_id': 'req-55063708-dba5-4690-9962-df0220f74ca6'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:36.942790 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-867fe893-4580-442d-b4e0-cbdd7f8d5c74 admin admin] The token cache is being invalidate because project f15585ae8e2a44b28ee1536a66cba3c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:35:36.943086 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-867fe893-4580-442d-b4e0-cbdd7f8d5c74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:36.944452 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-867fe893-4580-442d-b4e0-cbdd7f8d5c74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:36.945978 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1310/2636] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:35:36 2022] DELETE /identity/v3/projects/f15585ae8e2a44b28ee1536a66cba3c6 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:35:36.950621 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-55063708-dba5-4690-9962-df0220f74ca6 admin admin] The token cache is being invalidate because project f151a86bd77f48238e8b4e9dea9e1a1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:35:36.950835 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867fe893-4580-442d-b4e0-cbdd7f8d5c74 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:36.950953 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-55063708-dba5-4690-9962-df0220f74ca6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:36.951580 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-55063708-dba5-4690-9962-df0220f74ca6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:36.952511 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-867fe893-4580-442d-b4e0-cbdd7f8d5c74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:36.953431 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1327/2637] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:35:36 2022] DELETE /identity/v3/projects/f151a86bd77f48238e8b4e9dea9e1a1c => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:35:36.957376 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55063708-dba5-4690-9962-df0220f74ca6 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:36.958833 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-55063708-dba5-4690-9962-df0220f74ca6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:37.015626 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867fe893-4580-442d-b4e0-cbdd7f8d5c74 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:37.021142 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e568d-b1aa-4501-8d09-6ad9495dcd0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:37.022661 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e568d-b1aa-4501-8d09-6ad9495dcd0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:37.022783 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55063708-dba5-4690-9962-df0220f74ca6 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:37.022932 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e568d-b1aa-4501-8d09-6ad9495dcd0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:37.023198 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e568d-b1aa-4501-8d09-6ad9495dcd0e admin admin] PATH_INFO: `/v3/users/ca81b3a58c734a77b64609e1b82838ca` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:37.024458 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1e568d-b1aa-4501-8d09-6ad9495dcd0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca81b3a58c734a77b64609e1b82838ca)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:37.026368 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1e568d-b1aa-4501-8d09-6ad9495dcd0e admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:37.027864 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb3d2f0-7580-4242-8a24-1bd746d6ddd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:37.028833 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb3d2f0-7580-4242-8a24-1bd746d6ddd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:37.029171 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb3d2f0-7580-4242-8a24-1bd746d6ddd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:37.029525 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb3d2f0-7580-4242-8a24-1bd746d6ddd5 admin admin] PATH_INFO: `/v3/users/9592e1c6d2b14efa83359199111d5085` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:37.030731 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb3d2f0-7580-4242-8a24-1bd746d6ddd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9592e1c6d2b14efa83359199111d5085)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:37.032656 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb3d2f0-7580-4242-8a24-1bd746d6ddd5 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:37.073270 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-dd1e568d-b1aa-4501-8d09-6ad9495dcd0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca81b3a58c734a77b64609e1b82838ca'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:37.080262 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-5eb3d2f0-7580-4242-8a24-1bd746d6ddd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9592e1c6d2b14efa83359199111d5085'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:37.080507 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-dd1e568d-b1aa-4501-8d09-6ad9495dcd0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca81b3a58c734a77b64609e1b82838ca'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:37.080950 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-5eb3d2f0-7580-4242-8a24-1bd746d6ddd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9592e1c6d2b14efa83359199111d5085'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:37.088419 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-dd1e568d-b1aa-4501-8d09-6ad9495dcd0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca81b3a58c734a77b64609e1b82838ca'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:37.089060 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-dd1e568d-b1aa-4501-8d09-6ad9495dcd0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca81b3a58c734a77b64609e1b82838ca'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:37.089700 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-dd1e568d-b1aa-4501-8d09-6ad9495dcd0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca81b3a58c734a77b64609e1b82838ca'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:37.090682 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-5eb3d2f0-7580-4242-8a24-1bd746d6ddd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9592e1c6d2b14efa83359199111d5085'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:37.091546 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-5eb3d2f0-7580-4242-8a24-1bd746d6ddd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9592e1c6d2b14efa83359199111d5085'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:37.098903 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-5eb3d2f0-7580-4242-8a24-1bd746d6ddd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9592e1c6d2b14efa83359199111d5085'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:37.108501 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1311/2638] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:35:36 2022] DELETE /identity/v3/users/ca81b3a58c734a77b64609e1b82838ca => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:35:37.117079 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1328/2639] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:35:36 2022] DELETE /identity/v3/users/9592e1c6d2b14efa83359199111d5085 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:35:37.487313 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e568d-b1aa-4501-8d09-6ad9495dcd0e admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:37.488751 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-dd1e568d-b1aa-4501-8d09-6ad9495dcd0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:37.504712 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb3d2f0-7580-4242-8a24-1bd746d6ddd5 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:37.507210 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-5eb3d2f0-7580-4242-8a24-1bd746d6ddd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:37.573043 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb3d2f0-7580-4242-8a24-1bd746d6ddd5 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:37.573682 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e568d-b1aa-4501-8d09-6ad9495dcd0e admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:37.578223 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff8add3-bfb6-4de2-b2a6-371b48bebadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:37.579134 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff8add3-bfb6-4de2-b2a6-371b48bebadd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:37.579511 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff8add3-bfb6-4de2-b2a6-371b48bebadd admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:37.579847 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff8add3-bfb6-4de2-b2a6-371b48bebadd admin admin] PATH_INFO: `/v3/projects/5e58afcc05a242d08ddc0fba7735f904` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:37.581122 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff8add3-bfb6-4de2-b2a6-371b48bebadd admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e58afcc05a242d08ddc0fba7735f904)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:37.581948 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7f8813-3fad-461e-a1f6-5b77e843115a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:37.582775 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f8813-3fad-461e-a1f6-5b77e843115a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:37.583053 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f8813-3fad-461e-a1f6-5b77e843115a admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:37.583151 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff8add3-bfb6-4de2-b2a6-371b48bebadd admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:37.583325 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f8813-3fad-461e-a1f6-5b77e843115a admin admin] PATH_INFO: `/v3/projects/0176b251c9d04c5ba3be400156beab1b` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:37.585261 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7f8813-3fad-461e-a1f6-5b77e843115a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0176b251c9d04c5ba3be400156beab1b)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:37.587191 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7f8813-3fad-461e-a1f6-5b77e843115a admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:37.628217 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-cff8add3-bfb6-4de2-b2a6-371b48bebadd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e58afcc05a242d08ddc0fba7735f904', 'request_id': 'req-cff8add3-bfb6-4de2-b2a6-371b48bebadd'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:37.633871 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-fd7f8813-3fad-461e-a1f6-5b77e843115a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0176b251c9d04c5ba3be400156beab1b', 'request_id': 'req-fd7f8813-3fad-461e-a1f6-5b77e843115a'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:37.635989 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-cff8add3-bfb6-4de2-b2a6-371b48bebadd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e58afcc05a242d08ddc0fba7735f904', 'request_id': 'req-cff8add3-bfb6-4de2-b2a6-371b48bebadd'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:37.640196 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-fd7f8813-3fad-461e-a1f6-5b77e843115a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0176b251c9d04c5ba3be400156beab1b', 'request_id': 'req-fd7f8813-3fad-461e-a1f6-5b77e843115a'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:37.641165 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-cff8add3-bfb6-4de2-b2a6-371b48bebadd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e58afcc05a242d08ddc0fba7735f904', 'request_id': 'req-cff8add3-bfb6-4de2-b2a6-371b48bebadd'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:37.646048 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-fd7f8813-3fad-461e-a1f6-5b77e843115a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0176b251c9d04c5ba3be400156beab1b', 'request_id': 'req-fd7f8813-3fad-461e-a1f6-5b77e843115a'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:37.653898 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-cff8add3-bfb6-4de2-b2a6-371b48bebadd admin admin] The token cache is being invalidate because project 5e58afcc05a242d08ddc0fba7735f904 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:35:37.654196 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-cff8add3-bfb6-4de2-b2a6-371b48bebadd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:37.654790 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-cff8add3-bfb6-4de2-b2a6-371b48bebadd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:37.656356 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1312/2640] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:35:37 2022] DELETE /identity/v3/projects/5e58afcc05a242d08ddc0fba7735f904 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:35:37.658913 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-fd7f8813-3fad-461e-a1f6-5b77e843115a admin admin] The token cache is being invalidate because project 0176b251c9d04c5ba3be400156beab1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:35:37.659197 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-fd7f8813-3fad-461e-a1f6-5b77e843115a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:37.659911 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-fd7f8813-3fad-461e-a1f6-5b77e843115a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:37.660968 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d602c4-ee26-4242-ad5e-b3d8250b0d97 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:37.661249 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d602c4-ee26-4242-ad5e-b3d8250b0d97 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:37.661664 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1329/2641] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:35:37 2022] DELETE /identity/v3/projects/0176b251c9d04c5ba3be400156beab1b => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:35:37.661814 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d602c4-ee26-4242-ad5e-b3d8250b0d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:37.665954 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce5644-b6d0-4e4a-9eb6-f0a499f24794 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:37.666230 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce5644-b6d0-4e4a-9eb6-f0a499f24794 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:37.666503 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce5644-b6d0-4e4a-9eb6-f0a499f24794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:37.681149 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-13d602c4-ee26-4242-ad5e-b3d8250b0d97 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:35:37.682327 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-13d602c4-ee26-4242-ad5e-b3d8250b0d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:37.683941 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-2cce5644-b6d0-4e4a-9eb6-f0a499f24794 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:35:37.685083 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-2cce5644-b6d0-4e4a-9eb6-f0a499f24794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:37.750967 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1313/2642] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:35:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:35:37.751146 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1330/2643] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:35:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:35:37.752582 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954cdeef-a24f-4e00-a300-cfdca21d7e07 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:37.752885 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954cdeef-a24f-4e00-a300-cfdca21d7e07 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:37.753160 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954cdeef-a24f-4e00-a300-cfdca21d7e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:37.755754 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106fb37d-e2f3-42af-8b77-6b103179f39c None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:37.756738 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106fb37d-e2f3-42af-8b77-6b103179f39c None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:37.757097 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106fb37d-e2f3-42af-8b77-6b103179f39c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:37.773227 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-954cdeef-a24f-4e00-a300-cfdca21d7e07 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:35:37.774402 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-954cdeef-a24f-4e00-a300-cfdca21d7e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:37.775252 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-106fb37d-e2f3-42af-8b77-6b103179f39c None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:35:37.776489 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-106fb37d-e2f3-42af-8b77-6b103179f39c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:37.782352 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1314/2644] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:35:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:35:37.784628 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1331/2645] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:35:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:35:37.786385 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954cdeef-a24f-4e00-a300-cfdca21d7e07 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:37.788441 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106fb37d-e2f3-42af-8b77-6b103179f39c None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:37.795730 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954cdeef-a24f-4e00-a300-cfdca21d7e07 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:37.797506 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106fb37d-e2f3-42af-8b77-6b103179f39c None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:37.800282 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5967932-676f-4cd9-81ca-de69524cb2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:37.800927 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5967932-676f-4cd9-81ca-de69524cb2ad admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:37.801204 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5967932-676f-4cd9-81ca-de69524cb2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:37.801471 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5967932-676f-4cd9-81ca-de69524cb2ad admin admin] PATH_INFO: `/v3/domains` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:37.802179 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5967932-676f-4cd9-81ca-de69524cb2ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:35:37.802305 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc76460-c24a-4012-84c0-bf38f6534d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:37.802478 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5967932-676f-4cd9-81ca-de69524cb2ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:37.802975 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc76460-c24a-4012-84c0-bf38f6534d91 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:37.803280 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc76460-c24a-4012-84c0-bf38f6534d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:37.803579 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc76460-c24a-4012-84c0-bf38f6534d91 admin admin] PATH_INFO: `/v3/domains` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:37.804170 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5967932-676f-4cd9-81ca-de69524cb2ad admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:37.804291 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc76460-c24a-4012-84c0-bf38f6534d91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:35:37.804697 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc76460-c24a-4012-84c0-bf38f6534d91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:37.806292 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc76460-c24a-4012-84c0-bf38f6534d91 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:37.815789 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1315/2646] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 9 20:35:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:35:37.817847 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1332/2647] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 9 20:35:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:35:37.822403 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc76460-c24a-4012-84c0-bf38f6534d91 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:37.822540 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5967932-676f-4cd9-81ca-de69524cb2ad admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:37.831821 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5967932-676f-4cd9-81ca-de69524cb2ad admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:37.831956 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc76460-c24a-4012-84c0-bf38f6534d91 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:37.836833 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792043f1-65fb-443a-9dd5-9e832666147a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:37.837450 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39279f48-ff1f-47d4-ba34-caffca5495df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:37.837566 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792043f1-65fb-443a-9dd5-9e832666147a admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:37.837721 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792043f1-65fb-443a-9dd5-9e832666147a admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:37.837987 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792043f1-65fb-443a-9dd5-9e832666147a admin admin] PATH_INFO: `/v3/projects` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:37.838433 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39279f48-ff1f-47d4-ba34-caffca5495df admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:37.838650 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792043f1-65fb-443a-9dd5-9e832666147a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:37.838915 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39279f48-ff1f-47d4-ba34-caffca5495df admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:37.839319 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39279f48-ff1f-47d4-ba34-caffca5495df admin admin] PATH_INFO: `/v3/projects` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:37.840122 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39279f48-ff1f-47d4-ba34-caffca5495df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:37.840562 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792043f1-65fb-443a-9dd5-9e832666147a admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:37.842052 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39279f48-ff1f-47d4-ba34-caffca5495df admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:37.867826 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1333/2648] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:35:37 2022] POST /identity/v3/projects => generated 399 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:35:37.869576 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1316/2649] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:35:37 2022] POST /identity/v3/projects => generated 409 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:35:37.875352 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39279f48-ff1f-47d4-ba34-caffca5495df admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:37.875523 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792043f1-65fb-443a-9dd5-9e832666147a admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:37.934938 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39279f48-ff1f-47d4-ba34-caffca5495df admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:37.936275 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792043f1-65fb-443a-9dd5-9e832666147a admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:37.939595 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8036deff-35a5-4bcc-8bfb-605297da1906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:37.940248 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8036deff-35a5-4bcc-8bfb-605297da1906 admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:37.940518 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8036deff-35a5-4bcc-8bfb-605297da1906 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:37.940788 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8036deff-35a5-4bcc-8bfb-605297da1906 admin admin] PATH_INFO: `/v3/users` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:37.941022 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7e1d91-fe89-497b-a98b-ba2ad0e7a1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:37.941465 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8036deff-35a5-4bcc-8bfb-605297da1906 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:37.941671 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e1d91-fe89-497b-a98b-ba2ad0e7a1ae admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:37.941973 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e1d91-fe89-497b-a98b-ba2ad0e7a1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:37.942270 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e1d91-fe89-497b-a98b-ba2ad0e7a1ae admin admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:37.942940 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7e1d91-fe89-497b-a98b-ba2ad0e7a1ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:37.943992 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8036deff-35a5-4bcc-8bfb-605297da1906 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:37.945766 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7e1d91-fe89-497b-a98b-ba2ad0e7a1ae admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:37.963961 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1334/2650] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:35:37 2022] POST /identity/v3/users => generated 300 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:35:37.965248 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1317/2651] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:35:37 2022] POST /identity/v3/users => generated 305 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 20:35:37.968017 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8036deff-35a5-4bcc-8bfb-605297da1906 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:37.969174 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7e1d91-fe89-497b-a98b-ba2ad0e7a1ae admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:37.977595 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8036deff-35a5-4bcc-8bfb-605297da1906 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:37.978672 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7e1d91-fe89-497b-a98b-ba2ad0e7a1ae admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:37.982333 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a14105-62bc-4a89-a315-657007d98bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:37.983001 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a14105-62bc-4a89-a315-657007d98bdd admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:37.983154 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e147a055-bea6-4909-9fd3-c4403a8636c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:37.983291 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a14105-62bc-4a89-a315-657007d98bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:37.983583 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a14105-62bc-4a89-a315-657007d98bdd admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:37.983887 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e147a055-bea6-4909-9fd3-c4403a8636c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:37.984162 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e147a055-bea6-4909-9fd3-c4403a8636c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:37.984305 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a14105-62bc-4a89-a315-657007d98bdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:37.984430 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e147a055-bea6-4909-9fd3-c4403a8636c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:37.985135 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e147a055-bea6-4909-9fd3-c4403a8636c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:37.985892 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a14105-62bc-4a89-a315-657007d98bdd admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:37.986693 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e147a055-bea6-4909-9fd3-c4403a8636c6 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:37.996508 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1335/2652] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:35:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 09 20:35:37.999609 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1318/2653] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:35:37 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 09 20:35:38.000588 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a14105-62bc-4a89-a315-657007d98bdd admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:38.000711 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e147a055-bea6-4909-9fd3-c4403a8636c6 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:38.010868 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a14105-62bc-4a89-a315-657007d98bdd admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:38.011268 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e147a055-bea6-4909-9fd3-c4403a8636c6 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:38.015577 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64b2e60-ee99-48f2-adec-dfa83d21ae91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:38.015959 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492a8b20-c35b-4e49-a40c-eff0a788ba46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:38.016211 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b2e60-ee99-48f2-adec-dfa83d21ae91 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:38.016487 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b2e60-ee99-48f2-adec-dfa83d21ae91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:38.016593 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492a8b20-c35b-4e49-a40c-eff0a788ba46 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:38.016750 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b2e60-ee99-48f2-adec-dfa83d21ae91 admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:38.016848 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492a8b20-c35b-4e49-a40c-eff0a788ba46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:38.017105 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492a8b20-c35b-4e49-a40c-eff0a788ba46 admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:38.017449 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64b2e60-ee99-48f2-adec-dfa83d21ae91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:38.017842 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492a8b20-c35b-4e49-a40c-eff0a788ba46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:38.019015 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64b2e60-ee99-48f2-adec-dfa83d21ae91 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:38.019410 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492a8b20-c35b-4e49-a40c-eff0a788ba46 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:38.032586 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1319/2654] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:35:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:35:38.032772 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1336/2655] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:35:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 09 20:35:38.033638 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64b2e60-ee99-48f2-adec-dfa83d21ae91 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:38.033938 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492a8b20-c35b-4e49-a40c-eff0a788ba46 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:38.043158 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64b2e60-ee99-48f2-adec-dfa83d21ae91 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:38.043554 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492a8b20-c35b-4e49-a40c-eff0a788ba46 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:38.047593 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8a1cb6-15ce-4529-ac3b-d092bfa42dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:38.048254 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c83b0f1-7cd2-44d1-abc4-b8f411766e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:38.048475 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a1cb6-15ce-4529-ac3b-d092bfa42dab admin admin] REQUEST_METHOD: `PUT` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:38.048705 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a1cb6-15ce-4529-ac3b-d092bfa42dab admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:38.048969 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a1cb6-15ce-4529-ac3b-d092bfa42dab admin admin] PATH_INFO: `/v3/projects/32f19dda92864bbe9ceda1d731e04e3b/users/a0fced3b36b54abeaf2f8dc49fe87e82/roles/79f90a0bf6ea43d0b3c434e31556253a` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:38.049120 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83b0f1-7cd2-44d1-abc4-b8f411766e00 admin admin] REQUEST_METHOD: `PUT` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:38.049400 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83b0f1-7cd2-44d1-abc4-b8f411766e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:38.049673 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83b0f1-7cd2-44d1-abc4-b8f411766e00 admin admin] PATH_INFO: `/v3/projects/98aee6f1a164476aba4d28382bebaade/users/d27fc6f5f7474cca9506c7786c68d46d/roles/79f90a0bf6ea43d0b3c434e31556253a` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:38.063496 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8a1cb6-15ce-4529-ac3b-d092bfa42dab admin admin] RBAC: Authorizing `identity:create_grant(project_id=32f19dda92864bbe9ceda1d731e04e3b, user_id=a0fced3b36b54abeaf2f8dc49fe87e82, role_id=79f90a0bf6ea43d0b3c434e31556253a)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:38.064499 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c83b0f1-7cd2-44d1-abc4-b8f411766e00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98aee6f1a164476aba4d28382bebaade, user_id=d27fc6f5f7474cca9506c7786c68d46d, role_id=79f90a0bf6ea43d0b3c434e31556253a)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:38.066114 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8a1cb6-15ce-4529-ac3b-d092bfa42dab admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:38.067124 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c83b0f1-7cd2-44d1-abc4-b8f411766e00 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:38.079112 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1320/2656] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:35:38 2022] PUT /identity/v3/projects/32f19dda92864bbe9ceda1d731e04e3b/users/a0fced3b36b54abeaf2f8dc49fe87e82/roles/79f90a0bf6ea43d0b3c434e31556253a => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:35:38.080891 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1337/2657] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:35:38 2022] PUT /identity/v3/projects/98aee6f1a164476aba4d28382bebaade/users/d27fc6f5f7474cca9506c7786c68d46d/roles/79f90a0bf6ea43d0b3c434e31556253a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:35:38.089437 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823f4ec-1719-40f6-85b5-81c446032fed None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:38.089720 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823f4ec-1719-40f6-85b5-81c446032fed None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:38.089991 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823f4ec-1719-40f6-85b5-81c446032fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:38.091055 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c420ab7e-825f-43ca-be73-0b919473ffe3 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:38.091345 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c420ab7e-825f-43ca-be73-0b919473ffe3 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:38.091652 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c420ab7e-825f-43ca-be73-0b919473ffe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:38.116385 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-3823f4ec-1719-40f6-85b5-81c446032fed None None] MFA Rules not processed for user `a0fced3b36b54abeaf2f8dc49fe87e82`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:35:38.117615 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-3823f4ec-1719-40f6-85b5-81c446032fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:38.117870 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-c420ab7e-825f-43ca-be73-0b919473ffe3 None None] MFA Rules not processed for user `d27fc6f5f7474cca9506c7786c68d46d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:35:38.118904 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-c420ab7e-825f-43ca-be73-0b919473ffe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:38.180884 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1321/2658] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:35:38 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:35:38.183237 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1338/2659] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:35:38 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:35:38.185199 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3823f4ec-1719-40f6-85b5-81c446032fed None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:38.187352 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c420ab7e-825f-43ca-be73-0b919473ffe3 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:38.244617 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3823f4ec-1719-40f6-85b5-81c446032fed None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:38.249127 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e0c629-0194-4fbf-9021-fd12eaa5e754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:38.249764 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e0c629-0194-4fbf-9021-fd12eaa5e754 admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:38.250040 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e0c629-0194-4fbf-9021-fd12eaa5e754 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:38.250341 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e0c629-0194-4fbf-9021-fd12eaa5e754 admin admin] PATH_INFO: `/v3/projects` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:38.251026 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e0c629-0194-4fbf-9021-fd12eaa5e754 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:38.253051 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e0c629-0194-4fbf-9021-fd12eaa5e754 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:38.260875 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c420ab7e-825f-43ca-be73-0b919473ffe3 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:38.266633 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adf9012-4aca-4315-81da-c6a788f44c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:38.267643 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf9012-4aca-4315-81da-c6a788f44c54 admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:38.268109 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf9012-4aca-4315-81da-c6a788f44c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:38.268432 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf9012-4aca-4315-81da-c6a788f44c54 admin admin] PATH_INFO: `/v3/projects` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:38.269387 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adf9012-4aca-4315-81da-c6a788f44c54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:38.272845 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adf9012-4aca-4315-81da-c6a788f44c54 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:38.281866 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1322/2660] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:35:38 2022] POST /identity/v3/projects => generated 399 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:35:38.286043 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e0c629-0194-4fbf-9021-fd12eaa5e754 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:38.302502 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1339/2661] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:35:38 2022] POST /identity/v3/projects => generated 407 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 20:35:38.303922 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adf9012-4aca-4315-81da-c6a788f44c54 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:38.350479 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e0c629-0194-4fbf-9021-fd12eaa5e754 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:38.362029 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adf9012-4aca-4315-81da-c6a788f44c54 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:38.366612 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1ef9cd-9662-467b-bc98-8fd1fb9e5332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:38.367261 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ef9cd-9662-467b-bc98-8fd1fb9e5332 admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:38.367575 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ef9cd-9662-467b-bc98-8fd1fb9e5332 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:38.367847 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ef9cd-9662-467b-bc98-8fd1fb9e5332 admin admin] PATH_INFO: `/v3/users` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:38.368539 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1ef9cd-9662-467b-bc98-8fd1fb9e5332 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:38.370433 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1ef9cd-9662-467b-bc98-8fd1fb9e5332 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:38.394352 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1340/2662] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:35:38 2022] POST /identity/v3/users => generated 310 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 20:35:38.395424 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1ef9cd-9662-467b-bc98-8fd1fb9e5332 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:38.405526 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1ef9cd-9662-467b-bc98-8fd1fb9e5332 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:38.407981 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b750dcbd-a842-4c88-800b-b282edb4ed1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:38.408641 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750dcbd-a842-4c88-800b-b282edb4ed1f admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:38.408919 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750dcbd-a842-4c88-800b-b282edb4ed1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:38.409187 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750dcbd-a842-4c88-800b-b282edb4ed1f admin admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:38.409848 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b750dcbd-a842-4c88-800b-b282edb4ed1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:38.410371 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b970690-44fe-411a-b596-f1d52236d68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:38.411035 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b970690-44fe-411a-b596-f1d52236d68f admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:38.411313 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b970690-44fe-411a-b596-f1d52236d68f admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:38.411617 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b970690-44fe-411a-b596-f1d52236d68f admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:38.411771 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b750dcbd-a842-4c88-800b-b282edb4ed1f admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:38.412412 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b970690-44fe-411a-b596-f1d52236d68f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:38.414068 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b970690-44fe-411a-b596-f1d52236d68f admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:38.424178 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1341/2663] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:35:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 09 20:35:38.428568 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b970690-44fe-411a-b596-f1d52236d68f admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:38.431293 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1323/2664] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:35:38 2022] POST /identity/v3/users => generated 306 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 20:35:38.435326 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b750dcbd-a842-4c88-800b-b282edb4ed1f admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:38.438448 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b970690-44fe-411a-b596-f1d52236d68f admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:38.442909 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c225bda2-dc2f-43ec-863b-bc0b53528366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:38.444347 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c225bda2-dc2f-43ec-863b-bc0b53528366 admin admin] REQUEST_METHOD: `PUT` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:38.444623 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c225bda2-dc2f-43ec-863b-bc0b53528366 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:38.444973 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b750dcbd-a842-4c88-800b-b282edb4ed1f admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:38.445077 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c225bda2-dc2f-43ec-863b-bc0b53528366 admin admin] PATH_INFO: `/v3/projects/4e231afc7e1e45489897cd7823529210/users/683bd243f0ac4aa284f58fe1fadf2025/roles/274130b78e304bb88789c1b349263f3c` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:38.449517 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44af9f00-2c8a-4e72-9a34-6eae79aa74a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:38.450167 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af9f00-2c8a-4e72-9a34-6eae79aa74a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:38.450442 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af9f00-2c8a-4e72-9a34-6eae79aa74a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:38.450708 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af9f00-2c8a-4e72-9a34-6eae79aa74a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:38.451442 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44af9f00-2c8a-4e72-9a34-6eae79aa74a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:38.453010 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44af9f00-2c8a-4e72-9a34-6eae79aa74a1 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:38.460778 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c225bda2-dc2f-43ec-863b-bc0b53528366 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e231afc7e1e45489897cd7823529210, user_id=683bd243f0ac4aa284f58fe1fadf2025, role_id=274130b78e304bb88789c1b349263f3c)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:38.463287 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1324/2665] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:35:38 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:35:38.466671 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c225bda2-dc2f-43ec-863b-bc0b53528366 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:38.467321 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44af9f00-2c8a-4e72-9a34-6eae79aa74a1 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:38.477465 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44af9f00-2c8a-4e72-9a34-6eae79aa74a1 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:38.479642 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1342/2666] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:35:38 2022] PUT /identity/v3/projects/4e231afc7e1e45489897cd7823529210/users/683bd243f0ac4aa284f58fe1fadf2025/roles/274130b78e304bb88789c1b349263f3c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:35:38.483307 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c225bda2-dc2f-43ec-863b-bc0b53528366 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:38.535256 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f619da-7704-44e0-872e-26a2b41c5dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:38.536158 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f619da-7704-44e0-872e-26a2b41c5dc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:38.536433 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f619da-7704-44e0-872e-26a2b41c5dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:38.536696 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f619da-7704-44e0-872e-26a2b41c5dc6 admin admin] PATH_INFO: `/v3/projects/5cdbb897c41e47ce8e44bcdae6328f8b/users/4f8606be0b9645fda38df4694d1ba0c5/roles/274130b78e304bb88789c1b349263f3c` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:38.542768 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c225bda2-dc2f-43ec-863b-bc0b53528366 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:38.547351 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938066bc-07ae-401f-a5a4-3c0ac7cc0c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:38.548043 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938066bc-07ae-401f-a5a4-3c0ac7cc0c56 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:38.548322 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938066bc-07ae-401f-a5a4-3c0ac7cc0c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:38.548684 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938066bc-07ae-401f-a5a4-3c0ac7cc0c56 admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:38.549294 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938066bc-07ae-401f-a5a4-3c0ac7cc0c56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:38.550707 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f619da-7704-44e0-872e-26a2b41c5dc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cdbb897c41e47ce8e44bcdae6328f8b, user_id=4f8606be0b9645fda38df4694d1ba0c5, role_id=274130b78e304bb88789c1b349263f3c)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:38.550886 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938066bc-07ae-401f-a5a4-3c0ac7cc0c56 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:38.553877 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f619da-7704-44e0-872e-26a2b41c5dc6 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:38.561199 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1343/2667] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:35:38 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 09 20:35:38.565812 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938066bc-07ae-401f-a5a4-3c0ac7cc0c56 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:38.567482 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1325/2668] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:35:38 2022] PUT /identity/v3/projects/5cdbb897c41e47ce8e44bcdae6328f8b/users/4f8606be0b9645fda38df4694d1ba0c5/roles/274130b78e304bb88789c1b349263f3c => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:35:38.572220 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f619da-7704-44e0-872e-26a2b41c5dc6 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:38.576562 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938066bc-07ae-401f-a5a4-3c0ac7cc0c56 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:38.635862 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f619da-7704-44e0-872e-26a2b41c5dc6 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:38.636120 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2159bd-c26c-47b5-be57-0abce20e2fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:38.637016 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2159bd-c26c-47b5-be57-0abce20e2fb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:38.637392 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2159bd-c26c-47b5-be57-0abce20e2fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:38.637762 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2159bd-c26c-47b5-be57-0abce20e2fb1 admin admin] PATH_INFO: `/v3/projects/4e231afc7e1e45489897cd7823529210/users/683bd243f0ac4aa284f58fe1fadf2025/roles/274130b78e304bb88789c1b349263f3c` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:38.639847 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2159bd-c26c-47b5-be57-0abce20e2fb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e231afc7e1e45489897cd7823529210, user_id=683bd243f0ac4aa284f58fe1fadf2025, role_id=274130b78e304bb88789c1b349263f3c)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:38.640588 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb12f621-6960-4c38-b390-1d60eba8025e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:38.641233 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb12f621-6960-4c38-b390-1d60eba8025e admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:38.641508 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb12f621-6960-4c38-b390-1d60eba8025e admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:38.641778 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb12f621-6960-4c38-b390-1d60eba8025e admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:38.642472 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2159bd-c26c-47b5-be57-0abce20e2fb1 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:38.642560 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb12f621-6960-4c38-b390-1d60eba8025e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:38.644077 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb12f621-6960-4c38-b390-1d60eba8025e admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:38.653462 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1344/2669] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:35:38 2022] PUT /identity/v3/projects/4e231afc7e1e45489897cd7823529210/users/683bd243f0ac4aa284f58fe1fadf2025/roles/274130b78e304bb88789c1b349263f3c => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:35:38.656274 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1326/2670] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:35:38 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 09 20:35:38.660448 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2159bd-c26c-47b5-be57-0abce20e2fb1 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:38.664957 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f9812-7f12-4dcb-85b7-06f128372198 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:38.665236 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f9812-7f12-4dcb-85b7-06f128372198 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:38.666026 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f9812-7f12-4dcb-85b7-06f128372198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:38.697721 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-3a4f9812-7f12-4dcb-85b7-06f128372198 None None] MFA Rules not processed for user `683bd243f0ac4aa284f58fe1fadf2025`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:35:38.698952 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-3a4f9812-7f12-4dcb-85b7-06f128372198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:38.726421 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2159bd-c26c-47b5-be57-0abce20e2fb1 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:38.731003 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc5093b-a516-430c-827d-69cb78a467a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:38.732065 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc5093b-a516-430c-827d-69cb78a467a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:38.732849 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc5093b-a516-430c-827d-69cb78a467a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:38.733122 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc5093b-a516-430c-827d-69cb78a467a9 admin admin] PATH_INFO: `/v3/projects/5cdbb897c41e47ce8e44bcdae6328f8b/users/4f8606be0b9645fda38df4694d1ba0c5/roles/274130b78e304bb88789c1b349263f3c` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:38.735065 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc5093b-a516-430c-827d-69cb78a467a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cdbb897c41e47ce8e44bcdae6328f8b, user_id=4f8606be0b9645fda38df4694d1ba0c5, role_id=274130b78e304bb88789c1b349263f3c)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:38.737693 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc5093b-a516-430c-827d-69cb78a467a9 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:38.748120 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1345/2671] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:35:38 2022] PUT /identity/v3/projects/5cdbb897c41e47ce8e44bcdae6328f8b/users/4f8606be0b9645fda38df4694d1ba0c5/roles/274130b78e304bb88789c1b349263f3c => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:35:38.759990 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e36c6-d6b7-4019-8131-1a7d801a6d1e None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:38.760528 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e36c6-d6b7-4019-8131-1a7d801a6d1e None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:38.760805 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e36c6-d6b7-4019-8131-1a7d801a6d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:38.765659 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1327/2672] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:35:38 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:35:38.776346 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f9812-7f12-4dcb-85b7-06f128372198 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:38.777690 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-3a4f9812-7f12-4dcb-85b7-06f128372198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:38.789302 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-0c0e36c6-d6b7-4019-8131-1a7d801a6d1e None None] MFA Rules not processed for user `4f8606be0b9645fda38df4694d1ba0c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:35:38.790463 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-0c0e36c6-d6b7-4019-8131-1a7d801a6d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:38.834827 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f9812-7f12-4dcb-85b7-06f128372198 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:38.860538 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1346/2673] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:35:38 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:35:38.871801 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0e36c6-d6b7-4019-8131-1a7d801a6d1e None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:38.873183 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-0c0e36c6-d6b7-4019-8131-1a7d801a6d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:38.882811 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcfd8d6-4162-4b59-9de3-41d73e7e14e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d65e731386d44948dcc1ecd40cbda65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:38.883481 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcfd8d6-4162-4b59-9de3-41d73e7e14e3 service cinder] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:38.883761 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcfd8d6-4162-4b59-9de3-41d73e7e14e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:38.884030 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcfd8d6-4162-4b59-9de3-41d73e7e14e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:38.928941 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0e36c6-d6b7-4019-8131-1a7d801a6d1e None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:38.932657 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fadad92-52fb-4251-a2fd-953161e16aa5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d65e731386d44948dcc1ecd40cbda65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:38.933292 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fadad92-52fb-4251-a2fd-953161e16aa5 service cinder] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:38.933571 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fadad92-52fb-4251-a2fd-953161e16aa5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:38.933849 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fadad92-52fb-4251-a2fd-953161e16aa5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:38.941960 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcfd8d6-4162-4b59-9de3-41d73e7e14e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:38.942818 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fadad92-52fb-4251-a2fd-953161e16aa5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:38.944163 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcfd8d6-4162-4b59-9de3-41d73e7e14e3 service cinder] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:38.945209 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fadad92-52fb-4251-a2fd-953161e16aa5 service cinder] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:38.954926 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1328/2674] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:35:38 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:35:38.968611 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1347/2675] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:35:38 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 09 20:35:39.045648 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcfd8d6-4162-4b59-9de3-41d73e7e14e3 service cinder] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:39.055596 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcfd8d6-4162-4b59-9de3-41d73e7e14e3 service cinder] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:39.059519 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7647c7b4-9790-46fe-8e62-0d62de80f4d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d65e731386d44948dcc1ecd40cbda65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:39.060145 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7647c7b4-9790-46fe-8e62-0d62de80f4d8 service cinder] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:39.060423 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7647c7b4-9790-46fe-8e62-0d62de80f4d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:39.060690 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7647c7b4-9790-46fe-8e62-0d62de80f4d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:39.114333 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fadad92-52fb-4251-a2fd-953161e16aa5 service cinder] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:39.118772 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7647c7b4-9790-46fe-8e62-0d62de80f4d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:39.120289 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7647c7b4-9790-46fe-8e62-0d62de80f4d8 service cinder] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:39.123978 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fadad92-52fb-4251-a2fd-953161e16aa5 service cinder] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:39.128284 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103de8f6-c7ce-4fa2-94f7-b754061e6d26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d65e731386d44948dcc1ecd40cbda65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:39.129012 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103de8f6-c7ce-4fa2-94f7-b754061e6d26 service cinder] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:39.129189 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1329/2676] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:35:39 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:35:39.131283 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103de8f6-c7ce-4fa2-94f7-b754061e6d26 service cinder] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:39.131662 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103de8f6-c7ce-4fa2-94f7-b754061e6d26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:39.188764 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103de8f6-c7ce-4fa2-94f7-b754061e6d26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:39.190188 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103de8f6-c7ce-4fa2-94f7-b754061e6d26 service cinder] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:39.199553 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1348/2677] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:35:39 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 09 20:35:45.250600 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7647c7b4-9790-46fe-8e62-0d62de80f4d8 service cinder] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:45.311941 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7647c7b4-9790-46fe-8e62-0d62de80f4d8 service cinder] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:45.316715 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1956dfef-be59-42c2-b738-62872329f76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:45.317583 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1956dfef-be59-42c2-b738-62872329f76d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:45.317873 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1956dfef-be59-42c2-b738-62872329f76d admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:45.318143 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1956dfef-be59-42c2-b738-62872329f76d admin admin] PATH_INFO: `/v3/users/a0fced3b36b54abeaf2f8dc49fe87e82` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:45.320068 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1956dfef-be59-42c2-b738-62872329f76d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0fced3b36b54abeaf2f8dc49fe87e82)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:45.322029 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1956dfef-be59-42c2-b738-62872329f76d admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:45.371924 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-1956dfef-be59-42c2-b738-62872329f76d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0fced3b36b54abeaf2f8dc49fe87e82'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:45.379424 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-1956dfef-be59-42c2-b738-62872329f76d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0fced3b36b54abeaf2f8dc49fe87e82'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:45.388700 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-1956dfef-be59-42c2-b738-62872329f76d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0fced3b36b54abeaf2f8dc49fe87e82'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:45.388700 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-1956dfef-be59-42c2-b738-62872329f76d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0fced3b36b54abeaf2f8dc49fe87e82'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:45.389160 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-1956dfef-be59-42c2-b738-62872329f76d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0fced3b36b54abeaf2f8dc49fe87e82'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:45.412779 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1330/2678] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:35:45 2022] DELETE /identity/v3/users/a0fced3b36b54abeaf2f8dc49fe87e82 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:35:45.415016 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425733aa-eeb9-4f2d-ae12-fc0c6d3a5b0e None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:45.415507 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425733aa-eeb9-4f2d-ae12-fc0c6d3a5b0e None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:45.415964 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425733aa-eeb9-4f2d-ae12-fc0c6d3a5b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:45.433664 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-425733aa-eeb9-4f2d-ae12-fc0c6d3a5b0e None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:35:45.434863 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-425733aa-eeb9-4f2d-ae12-fc0c6d3a5b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:45.498775 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1349/2679] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:35:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:35:45.509145 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1956dfef-be59-42c2-b738-62872329f76d admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:45.510793 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-1956dfef-be59-42c2-b738-62872329f76d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:45.572962 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1956dfef-be59-42c2-b738-62872329f76d admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:45.577222 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39040a1-ca0d-4cc3-9391-9cf630869588 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:45.578130 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39040a1-ca0d-4cc3-9391-9cf630869588 service neutron] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:45.578409 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39040a1-ca0d-4cc3-9391-9cf630869588 service neutron] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:45.578679 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39040a1-ca0d-4cc3-9391-9cf630869588 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:45.588928 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39040a1-ca0d-4cc3-9391-9cf630869588 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:45.590364 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39040a1-ca0d-4cc3-9391-9cf630869588 service neutron] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:45.600842 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1331/2680] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:35:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:35:45.885412 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425733aa-eeb9-4f2d-ae12-fc0c6d3a5b0e None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:45.886895 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-425733aa-eeb9-4f2d-ae12-fc0c6d3a5b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:45.900604 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425733aa-eeb9-4f2d-ae12-fc0c6d3a5b0e None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:45.905411 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7359e409-e9e5-4a48-b6f5-5b50ffc8b46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:45.906538 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359e409-e9e5-4a48-b6f5-5b50ffc8b46c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:45.906823 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359e409-e9e5-4a48-b6f5-5b50ffc8b46c admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:45.907089 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359e409-e9e5-4a48-b6f5-5b50ffc8b46c admin admin] PATH_INFO: `/v3/projects/32f19dda92864bbe9ceda1d731e04e3b` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:45.909360 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7359e409-e9e5-4a48-b6f5-5b50ffc8b46c admin admin] RBAC: Authorizing `identity:delete_project(project_id=32f19dda92864bbe9ceda1d731e04e3b)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:45.911269 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7359e409-e9e5-4a48-b6f5-5b50ffc8b46c admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:45.960901 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-7359e409-e9e5-4a48-b6f5-5b50ffc8b46c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32f19dda92864bbe9ceda1d731e04e3b', 'request_id': 'req-7359e409-e9e5-4a48-b6f5-5b50ffc8b46c'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:45.967589 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-7359e409-e9e5-4a48-b6f5-5b50ffc8b46c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32f19dda92864bbe9ceda1d731e04e3b', 'request_id': 'req-7359e409-e9e5-4a48-b6f5-5b50ffc8b46c'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:45.976081 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-7359e409-e9e5-4a48-b6f5-5b50ffc8b46c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32f19dda92864bbe9ceda1d731e04e3b', 'request_id': 'req-7359e409-e9e5-4a48-b6f5-5b50ffc8b46c'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:45.988786 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-7359e409-e9e5-4a48-b6f5-5b50ffc8b46c admin admin] The token cache is being invalidate because project 32f19dda92864bbe9ceda1d731e04e3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:35:45.989072 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-7359e409-e9e5-4a48-b6f5-5b50ffc8b46c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:45.989878 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-7359e409-e9e5-4a48-b6f5-5b50ffc8b46c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:45.992678 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1350/2681] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:35:45 2022] DELETE /identity/v3/projects/32f19dda92864bbe9ceda1d731e04e3b => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:35:45.996788 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39040a1-ca0d-4cc3-9391-9cf630869588 service neutron] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:46.006614 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39040a1-ca0d-4cc3-9391-9cf630869588 service neutron] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:46.071052 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d3b15a-7734-4118-ba90-68bdb4f3ec9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:46.072409 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d3b15a-7734-4118-ba90-68bdb4f3ec9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:46.072700 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d3b15a-7734-4118-ba90-68bdb4f3ec9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:46.072974 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d3b15a-7734-4118-ba90-68bdb4f3ec9f admin admin] PATH_INFO: `/v3/users/4f8606be0b9645fda38df4694d1ba0c5` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:46.074175 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d3b15a-7734-4118-ba90-68bdb4f3ec9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f8606be0b9645fda38df4694d1ba0c5)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:46.076137 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d3b15a-7734-4118-ba90-68bdb4f3ec9f admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:46.132133 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-a0d3b15a-7734-4118-ba90-68bdb4f3ec9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f8606be0b9645fda38df4694d1ba0c5'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:46.139016 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-a0d3b15a-7734-4118-ba90-68bdb4f3ec9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f8606be0b9645fda38df4694d1ba0c5'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:46.146297 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-a0d3b15a-7734-4118-ba90-68bdb4f3ec9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f8606be0b9645fda38df4694d1ba0c5'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:46.147662 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-a0d3b15a-7734-4118-ba90-68bdb4f3ec9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f8606be0b9645fda38df4694d1ba0c5'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:46.148264 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-a0d3b15a-7734-4118-ba90-68bdb4f3ec9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f8606be0b9645fda38df4694d1ba0c5'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:46.165390 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1332/2682] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:35:45 2022] DELETE /identity/v3/users/4f8606be0b9645fda38df4694d1ba0c5 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:35:46.460704 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7359e409-e9e5-4a48-b6f5-5b50ffc8b46c admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:46.462216 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-7359e409-e9e5-4a48-b6f5-5b50ffc8b46c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:46.489293 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7359e409-e9e5-4a48-b6f5-5b50ffc8b46c admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:46.545859 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa802a-c1fe-4d42-a6ce-637f9c7fa53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:46.546706 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa802a-c1fe-4d42-a6ce-637f9c7fa53f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:46.547005 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa802a-c1fe-4d42-a6ce-637f9c7fa53f admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:46.547329 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa802a-c1fe-4d42-a6ce-637f9c7fa53f admin admin] PATH_INFO: `/v3/projects/5cdbb897c41e47ce8e44bcdae6328f8b` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:46.548520 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfa802a-c1fe-4d42-a6ce-637f9c7fa53f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cdbb897c41e47ce8e44bcdae6328f8b)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:46.550414 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfa802a-c1fe-4d42-a6ce-637f9c7fa53f admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:46.594658 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-8bfa802a-c1fe-4d42-a6ce-637f9c7fa53f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cdbb897c41e47ce8e44bcdae6328f8b', 'request_id': 'req-8bfa802a-c1fe-4d42-a6ce-637f9c7fa53f'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:46.600671 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-8bfa802a-c1fe-4d42-a6ce-637f9c7fa53f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cdbb897c41e47ce8e44bcdae6328f8b', 'request_id': 'req-8bfa802a-c1fe-4d42-a6ce-637f9c7fa53f'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:46.605916 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-8bfa802a-c1fe-4d42-a6ce-637f9c7fa53f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cdbb897c41e47ce8e44bcdae6328f8b', 'request_id': 'req-8bfa802a-c1fe-4d42-a6ce-637f9c7fa53f'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:46.617981 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-8bfa802a-c1fe-4d42-a6ce-637f9c7fa53f admin admin] The token cache is being invalidate because project 5cdbb897c41e47ce8e44bcdae6328f8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:35:46.618261 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-8bfa802a-c1fe-4d42-a6ce-637f9c7fa53f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:46.618862 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-8bfa802a-c1fe-4d42-a6ce-637f9c7fa53f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:46.620598 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1351/2683] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:35:46 2022] DELETE /identity/v3/projects/5cdbb897c41e47ce8e44bcdae6328f8b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:35:46.625406 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45447d4-af8e-4ad9-882e-7589469db657 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:46.625885 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45447d4-af8e-4ad9-882e-7589469db657 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:46.625981 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45447d4-af8e-4ad9-882e-7589469db657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:46.644126 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-f45447d4-af8e-4ad9-882e-7589469db657 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:35:46.645305 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-f45447d4-af8e-4ad9-882e-7589469db657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:46.701305 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1333/2684] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:35:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:35:46.710836 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5d484-2758-47b0-be6f-8b061ae052b1 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:46.711131 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5d484-2758-47b0-be6f-8b061ae052b1 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:46.711420 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5d484-2758-47b0-be6f-8b061ae052b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:46.729419 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-abb5d484-2758-47b0-be6f-8b061ae052b1 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:35:46.730539 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-abb5d484-2758-47b0-be6f-8b061ae052b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:46.738585 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1352/2685] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:35:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:35:46.742791 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45447d4-af8e-4ad9-882e-7589469db657 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:46.752219 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45447d4-af8e-4ad9-882e-7589469db657 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:46.757408 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c8371f-630e-43f6-9818-7c41130110ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:46.758051 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c8371f-630e-43f6-9818-7c41130110ff admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:46.758328 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c8371f-630e-43f6-9818-7c41130110ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:46.758597 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c8371f-630e-43f6-9818-7c41130110ff admin admin] PATH_INFO: `/v3/domains` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:46.759312 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c8371f-630e-43f6-9818-7c41130110ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:35:46.759636 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c8371f-630e-43f6-9818-7c41130110ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:46.761494 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c8371f-630e-43f6-9818-7c41130110ff admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:46.773152 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1334/2686] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 9 20:35:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:35:46.777276 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb5d484-2758-47b0-be6f-8b061ae052b1 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:46.786075 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb5d484-2758-47b0-be6f-8b061ae052b1 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:46.790666 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e917e9-3701-4dd9-81ed-f462938e321a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:46.791292 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e917e9-3701-4dd9-81ed-f462938e321a admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:46.791597 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e917e9-3701-4dd9-81ed-f462938e321a admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:46.791869 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e917e9-3701-4dd9-81ed-f462938e321a admin admin] PATH_INFO: `/v3/projects` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:46.792545 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e917e9-3701-4dd9-81ed-f462938e321a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:46.794430 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e917e9-3701-4dd9-81ed-f462938e321a admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:46.819848 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1353/2687] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:35:46 2022] POST /identity/v3/projects => generated 365 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 20:35:46.823892 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c8371f-630e-43f6-9818-7c41130110ff admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:46.833585 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c8371f-630e-43f6-9818-7c41130110ff admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:46.887640 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a2e13-4607-4d74-a56a-173e45d1ae17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:46.888293 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a2e13-4607-4d74-a56a-173e45d1ae17 admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:46.888568 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a2e13-4607-4d74-a56a-173e45d1ae17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:46.888833 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a2e13-4607-4d74-a56a-173e45d1ae17 admin admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:46.889509 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079a2e13-4607-4d74-a56a-173e45d1ae17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:46.891419 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079a2e13-4607-4d74-a56a-173e45d1ae17 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:46.910930 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1335/2688] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:35:46 2022] POST /identity/v3/users => generated 283 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 20:35:46.915166 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e917e9-3701-4dd9-81ed-f462938e321a admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:46.925574 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e917e9-3701-4dd9-81ed-f462938e321a admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:46.931354 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b65437-8a3c-4f8f-bdf2-cc7aef6f9b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:46.932038 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b65437-8a3c-4f8f-bdf2-cc7aef6f9b15 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:46.932322 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b65437-8a3c-4f8f-bdf2-cc7aef6f9b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:46.932605 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b65437-8a3c-4f8f-bdf2-cc7aef6f9b15 admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:46.933326 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b65437-8a3c-4f8f-bdf2-cc7aef6f9b15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:46.934918 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b65437-8a3c-4f8f-bdf2-cc7aef6f9b15 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:46.947064 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1354/2689] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:35:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:35:46.951715 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a2e13-4607-4d74-a56a-173e45d1ae17 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:46.962531 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a2e13-4607-4d74-a56a-173e45d1ae17 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:46.967131 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f513ba7-0eea-4a97-9065-3e63af9f630f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:46.967813 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f513ba7-0eea-4a97-9065-3e63af9f630f admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:46.968089 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f513ba7-0eea-4a97-9065-3e63af9f630f admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:46.968354 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f513ba7-0eea-4a97-9065-3e63af9f630f admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:46.969066 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f513ba7-0eea-4a97-9065-3e63af9f630f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:46.970639 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f513ba7-0eea-4a97-9065-3e63af9f630f admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:46.980802 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1336/2690] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:35:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:35:46.984785 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b65437-8a3c-4f8f-bdf2-cc7aef6f9b15 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:46.994965 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b65437-8a3c-4f8f-bdf2-cc7aef6f9b15 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:46.999525 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b3ff0f-156f-406a-8710-254a2ef3cc6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:47.000383 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b3ff0f-156f-406a-8710-254a2ef3cc6a admin admin] REQUEST_METHOD: `PUT` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:47.000654 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b3ff0f-156f-406a-8710-254a2ef3cc6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:47.000916 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b3ff0f-156f-406a-8710-254a2ef3cc6a admin admin] PATH_INFO: `/v3/projects/73d2dbe1fdf8413e8f3e3f6c38f1f291/users/3f55f40e950e4c5c8805dce34082eeab/roles/79f90a0bf6ea43d0b3c434e31556253a` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:47.015822 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b3ff0f-156f-406a-8710-254a2ef3cc6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=73d2dbe1fdf8413e8f3e3f6c38f1f291, user_id=3f55f40e950e4c5c8805dce34082eeab, role_id=79f90a0bf6ea43d0b3c434e31556253a)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:47.018431 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b3ff0f-156f-406a-8710-254a2ef3cc6a admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:47.033053 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1355/2691] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:35:46 2022] PUT /identity/v3/projects/73d2dbe1fdf8413e8f3e3f6c38f1f291/users/3f55f40e950e4c5c8805dce34082eeab/roles/79f90a0bf6ea43d0b3c434e31556253a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:35:47.043314 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f378e57-7eb3-42be-a7fd-724473911758 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:47.043645 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f378e57-7eb3-42be-a7fd-724473911758 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:47.043920 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f378e57-7eb3-42be-a7fd-724473911758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:47.070100 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-0f378e57-7eb3-42be-a7fd-724473911758 None None] MFA Rules not processed for user `3f55f40e950e4c5c8805dce34082eeab`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:35:47.071311 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-0f378e57-7eb3-42be-a7fd-724473911758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:47.131900 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1337/2692] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:35:47 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:35:47.136952 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b3ff0f-156f-406a-8710-254a2ef3cc6a admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:47.195925 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b3ff0f-156f-406a-8710-254a2ef3cc6a admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:47.200513 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f8e88d-263f-428e-b899-d7feb3b9ede7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:47.201156 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8e88d-263f-428e-b899-d7feb3b9ede7 admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:47.201437 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8e88d-263f-428e-b899-d7feb3b9ede7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:47.201707 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8e88d-263f-428e-b899-d7feb3b9ede7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:47.202378 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f8e88d-263f-428e-b899-d7feb3b9ede7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:47.204284 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f8e88d-263f-428e-b899-d7feb3b9ede7 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:47.228511 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1356/2693] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:35:47 2022] POST /identity/v3/projects => generated 365 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:35:47.232681 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f378e57-7eb3-42be-a7fd-724473911758 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:47.243695 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f378e57-7eb3-42be-a7fd-724473911758 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:47.296466 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd39a3e0-30f6-4452-82b8-b1f7a00f39a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:47.297109 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd39a3e0-30f6-4452-82b8-b1f7a00f39a6 admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:47.297386 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd39a3e0-30f6-4452-82b8-b1f7a00f39a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:47.297655 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd39a3e0-30f6-4452-82b8-b1f7a00f39a6 admin admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:47.298322 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd39a3e0-30f6-4452-82b8-b1f7a00f39a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:47.300276 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd39a3e0-30f6-4452-82b8-b1f7a00f39a6 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:47.320484 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1338/2694] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:35:47 2022] POST /identity/v3/users => generated 289 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 20:35:47.324364 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f8e88d-263f-428e-b899-d7feb3b9ede7 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:47.334891 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f8e88d-263f-428e-b899-d7feb3b9ede7 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:47.339798 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32fd907-340b-4fe5-983b-c887a14fa6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:47.340452 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32fd907-340b-4fe5-983b-c887a14fa6e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:47.340734 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32fd907-340b-4fe5-983b-c887a14fa6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:47.341009 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32fd907-340b-4fe5-983b-c887a14fa6e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:47.341728 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32fd907-340b-4fe5-983b-c887a14fa6e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:47.343336 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32fd907-340b-4fe5-983b-c887a14fa6e9 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:47.354603 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1357/2695] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:35:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:35:47.360803 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd39a3e0-30f6-4452-82b8-b1f7a00f39a6 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:47.369746 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd39a3e0-30f6-4452-82b8-b1f7a00f39a6 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:47.374372 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c7b7cf-35ad-4a81-9c7e-38343864a2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:47.375259 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7b7cf-35ad-4a81-9c7e-38343864a2c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:47.375567 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7b7cf-35ad-4a81-9c7e-38343864a2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:47.375833 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7b7cf-35ad-4a81-9c7e-38343864a2c1 admin admin] PATH_INFO: `/v3/projects/df11dfbe26244d98a240b068ec5cad93/users/f1fb92c0e7cc43b48d3058b86f27c964/roles/274130b78e304bb88789c1b349263f3c` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:47.390200 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c7b7cf-35ad-4a81-9c7e-38343864a2c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df11dfbe26244d98a240b068ec5cad93, user_id=f1fb92c0e7cc43b48d3058b86f27c964, role_id=274130b78e304bb88789c1b349263f3c)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:47.392853 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c7b7cf-35ad-4a81-9c7e-38343864a2c1 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:47.405590 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1339/2696] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:35:47 2022] PUT /identity/v3/projects/df11dfbe26244d98a240b068ec5cad93/users/f1fb92c0e7cc43b48d3058b86f27c964/roles/274130b78e304bb88789c1b349263f3c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:35:47.409403 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32fd907-340b-4fe5-983b-c887a14fa6e9 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:47.420054 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32fd907-340b-4fe5-983b-c887a14fa6e9 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:47.479523 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e7698c-af2c-4843-9808-faae2bf77b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:47.480177 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7698c-af2c-4843-9808-faae2bf77b41 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:47.480461 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7698c-af2c-4843-9808-faae2bf77b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:47.480735 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7698c-af2c-4843-9808-faae2bf77b41 admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:47.481457 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e7698c-af2c-4843-9808-faae2bf77b41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:47.483100 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e7698c-af2c-4843-9808-faae2bf77b41 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:47.493831 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1358/2697] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:35:47 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:35:47.498525 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c7b7cf-35ad-4a81-9c7e-38343864a2c1 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:47.501476 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e7698c-af2c-4843-9808-faae2bf77b41 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:47.503167 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-b0e7698c-af2c-4843-9808-faae2bf77b41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:47.508817 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c7b7cf-35ad-4a81-9c7e-38343864a2c1 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:47.513718 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d725b4-9518-4030-9116-846dcf979bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:47.514582 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d725b4-9518-4030-9116-846dcf979bea admin admin] REQUEST_METHOD: `PUT` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:47.514857 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d725b4-9518-4030-9116-846dcf979bea admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:47.515124 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d725b4-9518-4030-9116-846dcf979bea admin admin] PATH_INFO: `/v3/projects/df11dfbe26244d98a240b068ec5cad93/users/f1fb92c0e7cc43b48d3058b86f27c964/roles/274130b78e304bb88789c1b349263f3c` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:47.515641 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e7698c-af2c-4843-9808-faae2bf77b41 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:47.517139 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d725b4-9518-4030-9116-846dcf979bea admin admin] RBAC: Authorizing `identity:create_grant(project_id=df11dfbe26244d98a240b068ec5cad93, user_id=f1fb92c0e7cc43b48d3058b86f27c964, role_id=274130b78e304bb88789c1b349263f3c)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:47.519806 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d725b4-9518-4030-9116-846dcf979bea admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:47.520222 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01314317-64ad-44f5-ba6a-8b546f35f12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:47.521047 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01314317-64ad-44f5-ba6a-8b546f35f12e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:47.521323 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01314317-64ad-44f5-ba6a-8b546f35f12e admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:47.521664 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01314317-64ad-44f5-ba6a-8b546f35f12e admin admin] PATH_INFO: `/v3/users/d27fc6f5f7474cca9506c7786c68d46d` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:47.522838 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01314317-64ad-44f5-ba6a-8b546f35f12e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d27fc6f5f7474cca9506c7786c68d46d)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:47.524749 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01314317-64ad-44f5-ba6a-8b546f35f12e admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:47.530870 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1340/2698] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:35:47 2022] PUT /identity/v3/projects/df11dfbe26244d98a240b068ec5cad93/users/f1fb92c0e7cc43b48d3058b86f27c964/roles/274130b78e304bb88789c1b349263f3c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:35:47.542851 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fca4d0-4b64-48d8-992c-b496391d64ba None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:47.543135 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fca4d0-4b64-48d8-992c-b496391d64ba None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:47.543439 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fca4d0-4b64-48d8-992c-b496391d64ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:47.572627 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-01314317-64ad-44f5-ba6a-8b546f35f12e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd27fc6f5f7474cca9506c7786c68d46d'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:47.573201 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-18fca4d0-4b64-48d8-992c-b496391d64ba None None] MFA Rules not processed for user `f1fb92c0e7cc43b48d3058b86f27c964`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:35:47.573336 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-01314317-64ad-44f5-ba6a-8b546f35f12e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd27fc6f5f7474cca9506c7786c68d46d'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:47.574414 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-18fca4d0-4b64-48d8-992c-b496391d64ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:47.580016 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-01314317-64ad-44f5-ba6a-8b546f35f12e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd27fc6f5f7474cca9506c7786c68d46d'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:47.580692 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-01314317-64ad-44f5-ba6a-8b546f35f12e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd27fc6f5f7474cca9506c7786c68d46d'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:47.588684 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-01314317-64ad-44f5-ba6a-8b546f35f12e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd27fc6f5f7474cca9506c7786c68d46d'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:47.606018 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1359/2699] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:35:47 2022] DELETE /identity/v3/users/d27fc6f5f7474cca9506c7786c68d46d => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:35:47.610275 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a5a45-a93e-4357-be44-a60be998b75a None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:47.610558 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a5a45-a93e-4357-be44-a60be998b75a None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:47.610828 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a5a45-a93e-4357-be44-a60be998b75a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:47.627865 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-ab2a5a45-a93e-4357-be44-a60be998b75a None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:35:47.629071 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-ab2a5a45-a93e-4357-be44-a60be998b75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:47.645333 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1341/2700] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:35:47 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:35:47.659004 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fca4d0-4b64-48d8-992c-b496391d64ba None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:47.660376 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-18fca4d0-4b64-48d8-992c-b496391d64ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:47.687671 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1360/2701] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:35:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:35:47.697317 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2a5a45-a93e-4357-be44-a60be998b75a None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:47.698694 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-ab2a5a45-a93e-4357-be44-a60be998b75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:47.721922 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fca4d0-4b64-48d8-992c-b496391d64ba None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:47.753945 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2a5a45-a93e-4357-be44-a60be998b75a None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:47.758216 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d869fb5b-32c3-4c76-8004-14145fe7ed53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:47.758918 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d869fb5b-32c3-4c76-8004-14145fe7ed53 service neutron] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:47.759216 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d869fb5b-32c3-4c76-8004-14145fe7ed53 service neutron] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:47.759612 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d869fb5b-32c3-4c76-8004-14145fe7ed53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:47.768844 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867ad724-c041-4f8d-8710-b3fe33fe0468 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d65e731386d44948dcc1ecd40cbda65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:47.769019 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d869fb5b-32c3-4c76-8004-14145fe7ed53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:47.769489 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ad724-c041-4f8d-8710-b3fe33fe0468 service cinder] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:47.769767 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ad724-c041-4f8d-8710-b3fe33fe0468 service cinder] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:47.770032 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ad724-c041-4f8d-8710-b3fe33fe0468 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:47.770343 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d869fb5b-32c3-4c76-8004-14145fe7ed53 service neutron] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:47.780280 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1361/2702] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:35:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 09 20:35:47.829496 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867ad724-c041-4f8d-8710-b3fe33fe0468 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:47.830996 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867ad724-c041-4f8d-8710-b3fe33fe0468 service cinder] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:47.841770 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1342/2703] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:35:47 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 09 20:35:47.925277 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d869fb5b-32c3-4c76-8004-14145fe7ed53 service neutron] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:47.935928 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d869fb5b-32c3-4c76-8004-14145fe7ed53 service neutron] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:47.939768 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e0fb85-4326-4cb3-9e52-d284f00eb04e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d65e731386d44948dcc1ecd40cbda65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:47.940408 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e0fb85-4326-4cb3-9e52-d284f00eb04e service cinder] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:47.940692 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e0fb85-4326-4cb3-9e52-d284f00eb04e service cinder] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:47.940964 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e0fb85-4326-4cb3-9e52-d284f00eb04e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:47.942761 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-b3e0fb85-4326-4cb3-9e52-d284f00eb04e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:48.006861 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e0fb85-4326-4cb3-9e52-d284f00eb04e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:48.011222 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e0fb85-4326-4cb3-9e52-d284f00eb04e service cinder] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:48.022787 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1362/2704] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:35:47 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:35:48.063855 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867ad724-c041-4f8d-8710-b3fe33fe0468 service cinder] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:48.065483 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-867ad724-c041-4f8d-8710-b3fe33fe0468 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:48.081515 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867ad724-c041-4f8d-8710-b3fe33fe0468 service cinder] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:48.087821 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0cf959-1a61-4f7b-beda-230132650738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:48.088684 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0cf959-1a61-4f7b-beda-230132650738 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:48.088963 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0cf959-1a61-4f7b-beda-230132650738 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:48.089229 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0cf959-1a61-4f7b-beda-230132650738 admin admin] PATH_INFO: `/v3/projects/98aee6f1a164476aba4d28382bebaade` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:48.090408 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0cf959-1a61-4f7b-beda-230132650738 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98aee6f1a164476aba4d28382bebaade)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:48.092339 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0cf959-1a61-4f7b-beda-230132650738 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:48.142113 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-3a0cf959-1a61-4f7b-beda-230132650738 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98aee6f1a164476aba4d28382bebaade', 'request_id': 'req-3a0cf959-1a61-4f7b-beda-230132650738'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:48.148813 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-3a0cf959-1a61-4f7b-beda-230132650738 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98aee6f1a164476aba4d28382bebaade', 'request_id': 'req-3a0cf959-1a61-4f7b-beda-230132650738'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:48.155794 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-3a0cf959-1a61-4f7b-beda-230132650738 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98aee6f1a164476aba4d28382bebaade', 'request_id': 'req-3a0cf959-1a61-4f7b-beda-230132650738'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:48.168969 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-3a0cf959-1a61-4f7b-beda-230132650738 admin admin] The token cache is being invalidate because project 98aee6f1a164476aba4d28382bebaade was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:35:48.169254 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-3a0cf959-1a61-4f7b-beda-230132650738 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:48.169914 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-3a0cf959-1a61-4f7b-beda-230132650738 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:48.171646 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1343/2705] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:35:48 2022] DELETE /identity/v3/projects/98aee6f1a164476aba4d28382bebaade => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:35:48.175687 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e0fb85-4326-4cb3-9e52-d284f00eb04e service cinder] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:48.188188 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e0fb85-4326-4cb3-9e52-d284f00eb04e service cinder] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:48.248556 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10f6d41-ade9-4ffd-9b63-325da3f941b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:48.250250 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f6d41-ade9-4ffd-9b63-325da3f941b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:48.250535 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f6d41-ade9-4ffd-9b63-325da3f941b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:48.250812 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f6d41-ade9-4ffd-9b63-325da3f941b1 admin admin] PATH_INFO: `/v3/users/683bd243f0ac4aa284f58fe1fadf2025` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:48.252426 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10f6d41-ade9-4ffd-9b63-325da3f941b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=683bd243f0ac4aa284f58fe1fadf2025)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:48.254349 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10f6d41-ade9-4ffd-9b63-325da3f941b1 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:48.308767 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-b10f6d41-ade9-4ffd-9b63-325da3f941b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '683bd243f0ac4aa284f58fe1fadf2025'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:48.309638 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-b10f6d41-ade9-4ffd-9b63-325da3f941b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '683bd243f0ac4aa284f58fe1fadf2025'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:48.317021 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-b10f6d41-ade9-4ffd-9b63-325da3f941b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '683bd243f0ac4aa284f58fe1fadf2025'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:48.317679 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-b10f6d41-ade9-4ffd-9b63-325da3f941b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '683bd243f0ac4aa284f58fe1fadf2025'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:48.325109 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-b10f6d41-ade9-4ffd-9b63-325da3f941b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '683bd243f0ac4aa284f58fe1fadf2025'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:48.342497 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1363/2706] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:35:48 2022] DELETE /identity/v3/users/683bd243f0ac4aa284f58fe1fadf2025 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:35:48.614506 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0cf959-1a61-4f7b-beda-230132650738 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:48.616224 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-3a0cf959-1a61-4f7b-beda-230132650738 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:48.631613 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0cf959-1a61-4f7b-beda-230132650738 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:48.686753 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db168039-d1cc-48be-a5a3-0bc2440fcc01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:48.687625 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db168039-d1cc-48be-a5a3-0bc2440fcc01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:48.687908 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db168039-d1cc-48be-a5a3-0bc2440fcc01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:48.688178 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db168039-d1cc-48be-a5a3-0bc2440fcc01 admin admin] PATH_INFO: `/v3/projects/4e231afc7e1e45489897cd7823529210` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:48.689338 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db168039-d1cc-48be-a5a3-0bc2440fcc01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e231afc7e1e45489897cd7823529210)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:48.691248 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db168039-d1cc-48be-a5a3-0bc2440fcc01 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:48.735305 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-db168039-d1cc-48be-a5a3-0bc2440fcc01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e231afc7e1e45489897cd7823529210', 'request_id': 'req-db168039-d1cc-48be-a5a3-0bc2440fcc01'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:48.741134 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-db168039-d1cc-48be-a5a3-0bc2440fcc01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e231afc7e1e45489897cd7823529210', 'request_id': 'req-db168039-d1cc-48be-a5a3-0bc2440fcc01'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:48.746317 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-db168039-d1cc-48be-a5a3-0bc2440fcc01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e231afc7e1e45489897cd7823529210', 'request_id': 'req-db168039-d1cc-48be-a5a3-0bc2440fcc01'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:48.758565 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-db168039-d1cc-48be-a5a3-0bc2440fcc01 admin admin] The token cache is being invalidate because project 4e231afc7e1e45489897cd7823529210 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:35:48.758852 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-db168039-d1cc-48be-a5a3-0bc2440fcc01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:48.759501 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-db168039-d1cc-48be-a5a3-0bc2440fcc01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:48.761296 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1344/2707] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:35:48 2022] DELETE /identity/v3/projects/4e231afc7e1e45489897cd7823529210 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:35:48.766175 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d042333-df00-4a70-bfbf-28f33ce5d0b4 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:48.766625 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d042333-df00-4a70-bfbf-28f33ce5d0b4 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:48.766841 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d042333-df00-4a70-bfbf-28f33ce5d0b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:48.786268 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-4d042333-df00-4a70-bfbf-28f33ce5d0b4 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:35:48.787387 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-4d042333-df00-4a70-bfbf-28f33ce5d0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:48.843924 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1364/2708] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:35:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:35:48.851759 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa650aa-1890-45c9-add4-43f4806a1295 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:48.852062 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa650aa-1890-45c9-add4-43f4806a1295 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:48.852347 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa650aa-1890-45c9-add4-43f4806a1295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:48.870068 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-caa650aa-1890-45c9-add4-43f4806a1295 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:35:48.871262 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-caa650aa-1890-45c9-add4-43f4806a1295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:48.879038 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1345/2709] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:35:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:35:48.883997 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d042333-df00-4a70-bfbf-28f33ce5d0b4 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:48.893525 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d042333-df00-4a70-bfbf-28f33ce5d0b4 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:48.898788 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8bad3f-2afc-4ef8-a00f-8edf5bb0d8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:48.899472 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8bad3f-2afc-4ef8-a00f-8edf5bb0d8e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:48.899752 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8bad3f-2afc-4ef8-a00f-8edf5bb0d8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:48.900082 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8bad3f-2afc-4ef8-a00f-8edf5bb0d8e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:48.900737 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8bad3f-2afc-4ef8-a00f-8edf5bb0d8e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:35:48.901046 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8bad3f-2afc-4ef8-a00f-8edf5bb0d8e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:48.902777 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8bad3f-2afc-4ef8-a00f-8edf5bb0d8e3 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:48.914325 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1365/2710] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 9 20:35:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:35:48.918703 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa650aa-1890-45c9-add4-43f4806a1295 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:48.928091 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa650aa-1890-45c9-add4-43f4806a1295 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:48.932656 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deb1b2d-a49b-4dd8-815e-82ce35d88058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:48.933289 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb1b2d-a49b-4dd8-815e-82ce35d88058 admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:48.933568 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb1b2d-a49b-4dd8-815e-82ce35d88058 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:48.933839 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb1b2d-a49b-4dd8-815e-82ce35d88058 admin admin] PATH_INFO: `/v3/projects` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:48.934518 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deb1b2d-a49b-4dd8-815e-82ce35d88058 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:48.936456 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deb1b2d-a49b-4dd8-815e-82ce35d88058 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:48.965566 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1346/2711] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:35:48 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:35:48.969363 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8bad3f-2afc-4ef8-a00f-8edf5bb0d8e3 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:48.979122 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8bad3f-2afc-4ef8-a00f-8edf5bb0d8e3 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:49.031911 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f380c0c-11a6-4300-a4bc-a3fe81a499c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:49.032568 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f380c0c-11a6-4300-a4bc-a3fe81a499c0 admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:49.032852 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f380c0c-11a6-4300-a4bc-a3fe81a499c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:49.033128 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f380c0c-11a6-4300-a4bc-a3fe81a499c0 admin admin] PATH_INFO: `/v3/users` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:49.033820 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f380c0c-11a6-4300-a4bc-a3fe81a499c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:49.036082 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f380c0c-11a6-4300-a4bc-a3fe81a499c0 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:49.055002 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1366/2712] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:35:48 2022] POST /identity/v3/users => generated 290 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:35:49.058917 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deb1b2d-a49b-4dd8-815e-82ce35d88058 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:49.069481 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deb1b2d-a49b-4dd8-815e-82ce35d88058 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:49.074085 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c6205a-d32b-43f0-82d8-d4b8bb493102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:49.074724 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c6205a-d32b-43f0-82d8-d4b8bb493102 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:49.074999 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c6205a-d32b-43f0-82d8-d4b8bb493102 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:49.075269 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c6205a-d32b-43f0-82d8-d4b8bb493102 admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:49.076188 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c6205a-d32b-43f0-82d8-d4b8bb493102 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:49.077772 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c6205a-d32b-43f0-82d8-d4b8bb493102 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:49.088376 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1347/2713] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:35:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:35:49.092157 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f380c0c-11a6-4300-a4bc-a3fe81a499c0 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:49.101876 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f380c0c-11a6-4300-a4bc-a3fe81a499c0 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:49.106394 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271caf3f-eaab-4202-8242-bcd38fbbb183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:49.107027 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271caf3f-eaab-4202-8242-bcd38fbbb183 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:49.107308 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271caf3f-eaab-4202-8242-bcd38fbbb183 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:49.107622 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271caf3f-eaab-4202-8242-bcd38fbbb183 admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:49.108374 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271caf3f-eaab-4202-8242-bcd38fbbb183 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:49.109927 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271caf3f-eaab-4202-8242-bcd38fbbb183 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:49.120471 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1367/2714] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:35:49 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:35:49.123743 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c6205a-d32b-43f0-82d8-d4b8bb493102 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:49.134344 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c6205a-d32b-43f0-82d8-d4b8bb493102 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:49.139275 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdf9c52-62d2-4695-b574-34d40e7efbd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:49.140154 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf9c52-62d2-4695-b574-34d40e7efbd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:49.140434 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf9c52-62d2-4695-b574-34d40e7efbd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:49.140726 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf9c52-62d2-4695-b574-34d40e7efbd6 admin admin] PATH_INFO: `/v3/projects/0798113e24334fa9a85d5205a2196114/users/3657e7cca6724b228fa312340b596233/roles/79f90a0bf6ea43d0b3c434e31556253a` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:49.154737 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdf9c52-62d2-4695-b574-34d40e7efbd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0798113e24334fa9a85d5205a2196114, user_id=3657e7cca6724b228fa312340b596233, role_id=79f90a0bf6ea43d0b3c434e31556253a)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:49.157402 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdf9c52-62d2-4695-b574-34d40e7efbd6 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:49.169770 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1348/2715] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:35:49 2022] PUT /identity/v3/projects/0798113e24334fa9a85d5205a2196114/users/3657e7cca6724b228fa312340b596233/roles/79f90a0bf6ea43d0b3c434e31556253a => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:35:49.181712 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2f3b24-e769-477f-99ea-0709c709045c None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:49.182000 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2f3b24-e769-477f-99ea-0709c709045c None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:49.182276 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2f3b24-e769-477f-99ea-0709c709045c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:49.208292 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-8b2f3b24-e769-477f-99ea-0709c709045c None None] MFA Rules not processed for user `3657e7cca6724b228fa312340b596233`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:35:49.209498 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-8b2f3b24-e769-477f-99ea-0709c709045c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:49.270033 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1368/2716] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:35:49 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:35:49.274671 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdf9c52-62d2-4695-b574-34d40e7efbd6 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:49.332664 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdf9c52-62d2-4695-b574-34d40e7efbd6 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:49.337425 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22954b0-3a1e-496d-8932-2b44e89a092a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:49.338071 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22954b0-3a1e-496d-8932-2b44e89a092a admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:49.338349 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22954b0-3a1e-496d-8932-2b44e89a092a admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:49.338620 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22954b0-3a1e-496d-8932-2b44e89a092a admin admin] PATH_INFO: `/v3/projects` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:49.339293 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22954b0-3a1e-496d-8932-2b44e89a092a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:49.341227 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22954b0-3a1e-496d-8932-2b44e89a092a admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:49.368088 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1349/2717] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:35:49 2022] POST /identity/v3/projects => generated 381 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:35:49.372098 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2f3b24-e769-477f-99ea-0709c709045c None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:49.383467 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2f3b24-e769-477f-99ea-0709c709045c None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:49.438114 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0458307b-b187-4366-9676-61b0a95eb33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:49.438779 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0458307b-b187-4366-9676-61b0a95eb33f admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:49.439056 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0458307b-b187-4366-9676-61b0a95eb33f admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:49.439324 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0458307b-b187-4366-9676-61b0a95eb33f admin admin] PATH_INFO: `/v3/users` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:49.440027 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0458307b-b187-4366-9676-61b0a95eb33f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:49.441899 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0458307b-b187-4366-9676-61b0a95eb33f admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:49.461861 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1369/2718] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:35:49 2022] POST /identity/v3/users => generated 297 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 20:35:49.465854 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22954b0-3a1e-496d-8932-2b44e89a092a admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:49.476807 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22954b0-3a1e-496d-8932-2b44e89a092a admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:49.481562 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865524df-d49b-43bc-be44-ee681c500d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:49.482136 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865524df-d49b-43bc-be44-ee681c500d00 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:49.482410 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865524df-d49b-43bc-be44-ee681c500d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:49.482678 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865524df-d49b-43bc-be44-ee681c500d00 admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:49.483388 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865524df-d49b-43bc-be44-ee681c500d00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:49.485037 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865524df-d49b-43bc-be44-ee681c500d00 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:49.496951 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1350/2719] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:35:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 09 20:35:49.500971 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0458307b-b187-4366-9676-61b0a95eb33f admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:49.511185 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0458307b-b187-4366-9676-61b0a95eb33f admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:49.515876 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cae234-594f-4195-b049-0f8cb612d3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:49.516809 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cae234-594f-4195-b049-0f8cb612d3fa admin admin] REQUEST_METHOD: `PUT` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:49.517155 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cae234-594f-4195-b049-0f8cb612d3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:49.517497 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cae234-594f-4195-b049-0f8cb612d3fa admin admin] PATH_INFO: `/v3/projects/e172dcf4a1074d66ae68db63daf82a97/users/298abb2d55ae4398b0a0cbf9de807683/roles/274130b78e304bb88789c1b349263f3c` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:49.532260 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cae234-594f-4195-b049-0f8cb612d3fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=e172dcf4a1074d66ae68db63daf82a97, user_id=298abb2d55ae4398b0a0cbf9de807683, role_id=274130b78e304bb88789c1b349263f3c)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:49.535039 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cae234-594f-4195-b049-0f8cb612d3fa admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:49.550811 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1370/2720] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:35:49 2022] PUT /identity/v3/projects/e172dcf4a1074d66ae68db63daf82a97/users/298abb2d55ae4398b0a0cbf9de807683/roles/274130b78e304bb88789c1b349263f3c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:35:49.554863 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865524df-d49b-43bc-be44-ee681c500d00 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:49.564920 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865524df-d49b-43bc-be44-ee681c500d00 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:49.633017 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31209490-2be9-474e-9684-cc163593c38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:49.633884 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31209490-2be9-474e-9684-cc163593c38e admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:49.634203 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31209490-2be9-474e-9684-cc163593c38e admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:49.634660 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31209490-2be9-474e-9684-cc163593c38e admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:49.635924 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31209490-2be9-474e-9684-cc163593c38e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:49.637980 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31209490-2be9-474e-9684-cc163593c38e admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:49.648386 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1351/2721] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:35:49 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:35:49.653658 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cae234-594f-4195-b049-0f8cb612d3fa admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:49.665750 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cae234-594f-4195-b049-0f8cb612d3fa admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:49.670395 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075ed6a9-2604-408b-96cf-4ffecc809113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:49.671271 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075ed6a9-2604-408b-96cf-4ffecc809113 admin admin] REQUEST_METHOD: `PUT` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:49.671611 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075ed6a9-2604-408b-96cf-4ffecc809113 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:49.671889 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075ed6a9-2604-408b-96cf-4ffecc809113 admin admin] PATH_INFO: `/v3/projects/e172dcf4a1074d66ae68db63daf82a97/users/298abb2d55ae4398b0a0cbf9de807683/roles/274130b78e304bb88789c1b349263f3c` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:49.673849 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075ed6a9-2604-408b-96cf-4ffecc809113 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e172dcf4a1074d66ae68db63daf82a97, user_id=298abb2d55ae4398b0a0cbf9de807683, role_id=274130b78e304bb88789c1b349263f3c)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:49.676518 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075ed6a9-2604-408b-96cf-4ffecc809113 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:49.687704 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1371/2722] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:35:49 2022] PUT /identity/v3/projects/e172dcf4a1074d66ae68db63daf82a97/users/298abb2d55ae4398b0a0cbf9de807683/roles/274130b78e304bb88789c1b349263f3c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:35:49.698030 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df73287-5c47-4cc4-b410-1333f30291af None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:49.698484 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df73287-5c47-4cc4-b410-1333f30291af None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:49.698599 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df73287-5c47-4cc4-b410-1333f30291af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:49.723338 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-0df73287-5c47-4cc4-b410-1333f30291af None None] MFA Rules not processed for user `298abb2d55ae4398b0a0cbf9de807683`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:35:49.725056 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-0df73287-5c47-4cc4-b410-1333f30291af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:49.789824 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1352/2723] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:35:49 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:35:49.800693 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075ed6a9-2604-408b-96cf-4ffecc809113 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:49.802374 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-075ed6a9-2604-408b-96cf-4ffecc809113 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:49.857960 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075ed6a9-2604-408b-96cf-4ffecc809113 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:49.861447 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90541aed-4b1d-4ded-89cc-a41994916f10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d65e731386d44948dcc1ecd40cbda65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:49.862073 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90541aed-4b1d-4ded-89cc-a41994916f10 service cinder] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:49.862351 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90541aed-4b1d-4ded-89cc-a41994916f10 service cinder] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:49.862618 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90541aed-4b1d-4ded-89cc-a41994916f10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:49.871282 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90541aed-4b1d-4ded-89cc-a41994916f10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:49.872711 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90541aed-4b1d-4ded-89cc-a41994916f10 service cinder] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:49.881725 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1372/2724] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:35:49 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:35:50.235638 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df73287-5c47-4cc4-b410-1333f30291af None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:50.295949 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df73287-5c47-4cc4-b410-1333f30291af None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:50.300332 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30098efc-909b-45ae-8a7c-9d596959edcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:50.301170 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30098efc-909b-45ae-8a7c-9d596959edcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:50.301442 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30098efc-909b-45ae-8a7c-9d596959edcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:50.301707 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30098efc-909b-45ae-8a7c-9d596959edcb admin admin] PATH_INFO: `/v3/users/3657e7cca6724b228fa312340b596233` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:50.302852 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30098efc-909b-45ae-8a7c-9d596959edcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=3657e7cca6724b228fa312340b596233)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:50.304859 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30098efc-909b-45ae-8a7c-9d596959edcb admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:50.350469 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-30098efc-909b-45ae-8a7c-9d596959edcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3657e7cca6724b228fa312340b596233'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:50.357083 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-30098efc-909b-45ae-8a7c-9d596959edcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3657e7cca6724b228fa312340b596233'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:50.363594 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-30098efc-909b-45ae-8a7c-9d596959edcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3657e7cca6724b228fa312340b596233'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:50.364144 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-30098efc-909b-45ae-8a7c-9d596959edcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3657e7cca6724b228fa312340b596233'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:50.364736 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-30098efc-909b-45ae-8a7c-9d596959edcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3657e7cca6724b228fa312340b596233'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:50.381577 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1353/2725] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:35:50 2022] DELETE /identity/v3/users/3657e7cca6724b228fa312340b596233 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:35:50.386360 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2343090-76d8-4fff-9d92-bc4f3b281e88 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:50.386645 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2343090-76d8-4fff-9d92-bc4f3b281e88 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:50.386950 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2343090-76d8-4fff-9d92-bc4f3b281e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:50.404616 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-b2343090-76d8-4fff-9d92-bc4f3b281e88 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:35:50.405787 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-b2343090-76d8-4fff-9d92-bc4f3b281e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:50.462271 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1373/2726] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:35:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:35:50.471842 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30098efc-909b-45ae-8a7c-9d596959edcb admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:50.473250 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-30098efc-909b-45ae-8a7c-9d596959edcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:50.527810 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30098efc-909b-45ae-8a7c-9d596959edcb admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:50.531370 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cd079d-0f4a-4cc0-aadd-2919cb2e42b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:50.532026 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd079d-0f4a-4cc0-aadd-2919cb2e42b5 service neutron] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:50.532306 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd079d-0f4a-4cc0-aadd-2919cb2e42b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:50.532574 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd079d-0f4a-4cc0-aadd-2919cb2e42b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:50.541327 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cd079d-0f4a-4cc0-aadd-2919cb2e42b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:50.542745 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cd079d-0f4a-4cc0-aadd-2919cb2e42b5 service neutron] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:50.551863 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1354/2727] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:35:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:35:50.833213 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2343090-76d8-4fff-9d92-bc4f3b281e88 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:50.835062 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-b2343090-76d8-4fff-9d92-bc4f3b281e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:50.848645 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2343090-76d8-4fff-9d92-bc4f3b281e88 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:50.853394 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4750966-eb0d-415b-9d14-1b1a3134984c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:50.854509 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4750966-eb0d-415b-9d14-1b1a3134984c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:50.855089 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4750966-eb0d-415b-9d14-1b1a3134984c admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:50.855549 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4750966-eb0d-415b-9d14-1b1a3134984c admin admin] PATH_INFO: `/v3/projects/0798113e24334fa9a85d5205a2196114` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:50.857163 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4750966-eb0d-415b-9d14-1b1a3134984c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0798113e24334fa9a85d5205a2196114)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:50.859289 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4750966-eb0d-415b-9d14-1b1a3134984c admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:50.909333 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-b4750966-eb0d-415b-9d14-1b1a3134984c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0798113e24334fa9a85d5205a2196114', 'request_id': 'req-b4750966-eb0d-415b-9d14-1b1a3134984c'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:50.917983 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-b4750966-eb0d-415b-9d14-1b1a3134984c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0798113e24334fa9a85d5205a2196114', 'request_id': 'req-b4750966-eb0d-415b-9d14-1b1a3134984c'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:50.923334 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-b4750966-eb0d-415b-9d14-1b1a3134984c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0798113e24334fa9a85d5205a2196114', 'request_id': 'req-b4750966-eb0d-415b-9d14-1b1a3134984c'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:50.936560 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-b4750966-eb0d-415b-9d14-1b1a3134984c admin admin] The token cache is being invalidate because project 0798113e24334fa9a85d5205a2196114 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:35:50.936848 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-b4750966-eb0d-415b-9d14-1b1a3134984c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:50.937451 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-b4750966-eb0d-415b-9d14-1b1a3134984c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:50.939232 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1374/2728] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:35:50 2022] DELETE /identity/v3/projects/0798113e24334fa9a85d5205a2196114 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:35:50.942954 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cd079d-0f4a-4cc0-aadd-2919cb2e42b5 service neutron] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:50.954763 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cd079d-0f4a-4cc0-aadd-2919cb2e42b5 service neutron] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:51.015581 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b8a006-a35c-4f95-ad64-dc5c81e42a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:51.015581 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8a006-a35c-4f95-ad64-dc5c81e42a9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:51.015581 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8a006-a35c-4f95-ad64-dc5c81e42a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:51.015581 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8a006-a35c-4f95-ad64-dc5c81e42a9f admin admin] PATH_INFO: `/v3/users/298abb2d55ae4398b0a0cbf9de807683` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:51.015956 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b8a006-a35c-4f95-ad64-dc5c81e42a9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=298abb2d55ae4398b0a0cbf9de807683)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:51.017695 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b8a006-a35c-4f95-ad64-dc5c81e42a9f admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:51.063513 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-e3b8a006-a35c-4f95-ad64-dc5c81e42a9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '298abb2d55ae4398b0a0cbf9de807683'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:51.070393 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-e3b8a006-a35c-4f95-ad64-dc5c81e42a9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '298abb2d55ae4398b0a0cbf9de807683'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:51.077663 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-e3b8a006-a35c-4f95-ad64-dc5c81e42a9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '298abb2d55ae4398b0a0cbf9de807683'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:51.078268 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-e3b8a006-a35c-4f95-ad64-dc5c81e42a9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '298abb2d55ae4398b0a0cbf9de807683'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:51.078952 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-e3b8a006-a35c-4f95-ad64-dc5c81e42a9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '298abb2d55ae4398b0a0cbf9de807683'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:51.096179 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1355/2729] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:35:50 2022] DELETE /identity/v3/users/298abb2d55ae4398b0a0cbf9de807683 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:35:51.372069 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4750966-eb0d-415b-9d14-1b1a3134984c admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:51.373625 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-b4750966-eb0d-415b-9d14-1b1a3134984c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:51.395258 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4750966-eb0d-415b-9d14-1b1a3134984c admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:51.465448 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8237e10f-dd62-41ca-b0fb-d68812f14a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:51.466391 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237e10f-dd62-41ca-b0fb-d68812f14a51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:51.466827 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237e10f-dd62-41ca-b0fb-d68812f14a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:51.467221 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237e10f-dd62-41ca-b0fb-d68812f14a51 admin admin] PATH_INFO: `/v3/projects/e172dcf4a1074d66ae68db63daf82a97` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:51.468665 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8237e10f-dd62-41ca-b0fb-d68812f14a51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e172dcf4a1074d66ae68db63daf82a97)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:51.470685 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8237e10f-dd62-41ca-b0fb-d68812f14a51 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:51.525920 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-8237e10f-dd62-41ca-b0fb-d68812f14a51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e172dcf4a1074d66ae68db63daf82a97', 'request_id': 'req-8237e10f-dd62-41ca-b0fb-d68812f14a51'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:51.532234 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-8237e10f-dd62-41ca-b0fb-d68812f14a51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e172dcf4a1074d66ae68db63daf82a97', 'request_id': 'req-8237e10f-dd62-41ca-b0fb-d68812f14a51'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:51.537681 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-8237e10f-dd62-41ca-b0fb-d68812f14a51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e172dcf4a1074d66ae68db63daf82a97', 'request_id': 'req-8237e10f-dd62-41ca-b0fb-d68812f14a51'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:51.549275 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-8237e10f-dd62-41ca-b0fb-d68812f14a51 admin admin] The token cache is being invalidate because project e172dcf4a1074d66ae68db63daf82a97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:35:51.549559 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-8237e10f-dd62-41ca-b0fb-d68812f14a51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:51.550170 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-8237e10f-dd62-41ca-b0fb-d68812f14a51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:51.551716 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1375/2730] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:35:51 2022] DELETE /identity/v3/projects/e172dcf4a1074d66ae68db63daf82a97 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:35:51.559096 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5dad9f-41fa-4fc8-b9fd-a45137cb8c08 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:51.559387 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5dad9f-41fa-4fc8-b9fd-a45137cb8c08 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:51.559721 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5dad9f-41fa-4fc8-b9fd-a45137cb8c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:51.578385 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-9b5dad9f-41fa-4fc8-b9fd-a45137cb8c08 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:35:51.579612 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-9b5dad9f-41fa-4fc8-b9fd-a45137cb8c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:51.636429 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1356/2731] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:35:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:35:51.644460 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238221c-f9de-41ec-915d-49b33d5b09fc None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:51.644745 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238221c-f9de-41ec-915d-49b33d5b09fc None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:51.645090 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238221c-f9de-41ec-915d-49b33d5b09fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:51.665363 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-4238221c-f9de-41ec-915d-49b33d5b09fc None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:35:51.666559 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-4238221c-f9de-41ec-915d-49b33d5b09fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:51.678240 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1376/2732] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:35:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:35:51.679443 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5dad9f-41fa-4fc8-b9fd-a45137cb8c08 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:51.688878 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5dad9f-41fa-4fc8-b9fd-a45137cb8c08 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:51.694357 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1696342-fc5d-4cdd-a0e0-fa752a295eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:51.694996 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1696342-fc5d-4cdd-a0e0-fa752a295eaf admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:51.695273 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1696342-fc5d-4cdd-a0e0-fa752a295eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:51.695582 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1696342-fc5d-4cdd-a0e0-fa752a295eaf admin admin] PATH_INFO: `/v3/domains` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:51.696304 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1696342-fc5d-4cdd-a0e0-fa752a295eaf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:35:51.696628 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1696342-fc5d-4cdd-a0e0-fa752a295eaf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:51.698210 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1696342-fc5d-4cdd-a0e0-fa752a295eaf admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:51.709372 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1357/2733] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 9 20:35:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:35:51.713722 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4238221c-f9de-41ec-915d-49b33d5b09fc None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:51.722709 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4238221c-f9de-41ec-915d-49b33d5b09fc None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:51.727905 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274c67d2-af77-4ee4-8f7f-c47289a08cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:51.728539 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c67d2-af77-4ee4-8f7f-c47289a08cfd admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:51.728817 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c67d2-af77-4ee4-8f7f-c47289a08cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:51.729086 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c67d2-af77-4ee4-8f7f-c47289a08cfd admin admin] PATH_INFO: `/v3/projects` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:51.729765 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274c67d2-af77-4ee4-8f7f-c47289a08cfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:51.731658 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274c67d2-af77-4ee4-8f7f-c47289a08cfd admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:51.755417 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1377/2734] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:35:51 2022] POST /identity/v3/projects => generated 369 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 20:35:51.759462 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1696342-fc5d-4cdd-a0e0-fa752a295eaf admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:51.769446 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1696342-fc5d-4cdd-a0e0-fa752a295eaf admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:51.821677 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b9142b-1c99-486b-9d9e-5afd3fc3bc5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:51.822358 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b9142b-1c99-486b-9d9e-5afd3fc3bc5e admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:51.822637 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b9142b-1c99-486b-9d9e-5afd3fc3bc5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:51.822898 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b9142b-1c99-486b-9d9e-5afd3fc3bc5e admin admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:51.823605 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b9142b-1c99-486b-9d9e-5afd3fc3bc5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:51.825616 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b9142b-1c99-486b-9d9e-5afd3fc3bc5e admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:51.844101 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1358/2735] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:35:51 2022] POST /identity/v3/users => generated 285 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 20:35:51.848078 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274c67d2-af77-4ee4-8f7f-c47289a08cfd admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:51.858521 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274c67d2-af77-4ee4-8f7f-c47289a08cfd admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:51.862969 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dace90-b371-4afa-93ee-70efae66e36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:51.863634 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dace90-b371-4afa-93ee-70efae66e36c admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:51.863914 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dace90-b371-4afa-93ee-70efae66e36c admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:51.864184 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dace90-b371-4afa-93ee-70efae66e36c admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:51.864889 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dace90-b371-4afa-93ee-70efae66e36c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:51.867279 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dace90-b371-4afa-93ee-70efae66e36c admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:51.877221 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1378/2736] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:35:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:35:51.880902 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b9142b-1c99-486b-9d9e-5afd3fc3bc5e admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:51.890633 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b9142b-1c99-486b-9d9e-5afd3fc3bc5e admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:51.894997 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711bc118-3b82-4b65-9b2d-7b19c9485229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:51.895651 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711bc118-3b82-4b65-9b2d-7b19c9485229 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:51.895929 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711bc118-3b82-4b65-9b2d-7b19c9485229 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:51.896196 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711bc118-3b82-4b65-9b2d-7b19c9485229 admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:51.896980 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711bc118-3b82-4b65-9b2d-7b19c9485229 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:51.898537 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711bc118-3b82-4b65-9b2d-7b19c9485229 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:51.908771 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1359/2737] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:35:51 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:35:51.913117 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dace90-b371-4afa-93ee-70efae66e36c admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:51.922885 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dace90-b371-4afa-93ee-70efae66e36c admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:51.927490 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e983d-3ca2-469c-8660-8fc881aafda1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:51.928765 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e983d-3ca2-469c-8660-8fc881aafda1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:51.929051 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e983d-3ca2-469c-8660-8fc881aafda1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:51.929327 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e983d-3ca2-469c-8660-8fc881aafda1 admin admin] PATH_INFO: `/v3/projects/aad287354c8943418a1329c08e790c84/users/7b822b00f9af400c8229497e8c2051cf/roles/79f90a0bf6ea43d0b3c434e31556253a` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:51.944484 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483e983d-3ca2-469c-8660-8fc881aafda1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aad287354c8943418a1329c08e790c84, user_id=7b822b00f9af400c8229497e8c2051cf, role_id=79f90a0bf6ea43d0b3c434e31556253a)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:51.947381 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483e983d-3ca2-469c-8660-8fc881aafda1 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:51.961822 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1379/2738] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:35:51 2022] PUT /identity/v3/projects/aad287354c8943418a1329c08e790c84/users/7b822b00f9af400c8229497e8c2051cf/roles/79f90a0bf6ea43d0b3c434e31556253a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:35:51.973057 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e3a27d-b92b-457c-93d9-569463cd3b2a None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:51.973561 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e3a27d-b92b-457c-93d9-569463cd3b2a None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:51.973662 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e3a27d-b92b-457c-93d9-569463cd3b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:52.001313 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-58e3a27d-b92b-457c-93d9-569463cd3b2a None None] MFA Rules not processed for user `7b822b00f9af400c8229497e8c2051cf`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:35:52.002490 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-58e3a27d-b92b-457c-93d9-569463cd3b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:52.063896 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1360/2739] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:35:51 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:35:52.075581 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e983d-3ca2-469c-8660-8fc881aafda1 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:52.077287 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-483e983d-3ca2-469c-8660-8fc881aafda1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:52.133646 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e983d-3ca2-469c-8660-8fc881aafda1 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:52.137602 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c1825b-be16-4b63-85e3-e77cfff896cf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65db5d9a86fd48acb5874df0165c0ef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:52.138239 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c1825b-be16-4b63-85e3-e77cfff896cf service glance] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:52.138521 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c1825b-be16-4b63-85e3-e77cfff896cf service glance] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:52.138803 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c1825b-be16-4b63-85e3-e77cfff896cf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:52.147564 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c1825b-be16-4b63-85e3-e77cfff896cf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:52.148958 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c1825b-be16-4b63-85e3-e77cfff896cf service glance] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:52.157467 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1380/2740] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:35:52 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:35:52.704783 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e3a27d-b92b-457c-93d9-569463cd3b2a None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:52.706193 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-58e3a27d-b92b-457c-93d9-569463cd3b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:52.771229 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e3a27d-b92b-457c-93d9-569463cd3b2a None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:52.776273 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ff7a13-59d8-4892-87c6-cf1cbb322941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:52.777124 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff7a13-59d8-4892-87c6-cf1cbb322941 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:52.777405 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff7a13-59d8-4892-87c6-cf1cbb322941 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:52.777676 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff7a13-59d8-4892-87c6-cf1cbb322941 admin admin] PATH_INFO: `/v3/users/3f55f40e950e4c5c8805dce34082eeab` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:52.778871 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ff7a13-59d8-4892-87c6-cf1cbb322941 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f55f40e950e4c5c8805dce34082eeab)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:52.781095 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ff7a13-59d8-4892-87c6-cf1cbb322941 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:52.826755 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-51ff7a13-59d8-4892-87c6-cf1cbb322941 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f55f40e950e4c5c8805dce34082eeab'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:52.833575 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-51ff7a13-59d8-4892-87c6-cf1cbb322941 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f55f40e950e4c5c8805dce34082eeab'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:52.841222 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-51ff7a13-59d8-4892-87c6-cf1cbb322941 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f55f40e950e4c5c8805dce34082eeab'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:52.841929 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-51ff7a13-59d8-4892-87c6-cf1cbb322941 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f55f40e950e4c5c8805dce34082eeab'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:52.842530 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-51ff7a13-59d8-4892-87c6-cf1cbb322941 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f55f40e950e4c5c8805dce34082eeab'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:52.859650 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1361/2741] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:35:52 2022] DELETE /identity/v3/users/3f55f40e950e4c5c8805dce34082eeab => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:35:52.864497 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83178ef-5e27-4f5a-a3af-7840c4234e57 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:52.864964 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83178ef-5e27-4f5a-a3af-7840c4234e57 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:52.865641 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83178ef-5e27-4f5a-a3af-7840c4234e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:52.886895 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-a83178ef-5e27-4f5a-a3af-7840c4234e57 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:35:52.888503 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-a83178ef-5e27-4f5a-a3af-7840c4234e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:52.953110 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1381/2742] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:35:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:35:52.963103 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ff7a13-59d8-4892-87c6-cf1cbb322941 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:52.964555 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-51ff7a13-59d8-4892-87c6-cf1cbb322941 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:53.027755 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ff7a13-59d8-4892-87c6-cf1cbb322941 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:53.031469 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58c56c2-a3f4-4491-9408-57d0e844fd1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:53.032109 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c56c2-a3f4-4491-9408-57d0e844fd1a service neutron] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:53.032388 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c56c2-a3f4-4491-9408-57d0e844fd1a service neutron] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:53.032659 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c56c2-a3f4-4491-9408-57d0e844fd1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:53.042204 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58c56c2-a3f4-4491-9408-57d0e844fd1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:53.043669 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58c56c2-a3f4-4491-9408-57d0e844fd1a service neutron] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:53.053940 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1362/2743] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:35:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:35:53.323710 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83178ef-5e27-4f5a-a3af-7840c4234e57 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:53.325268 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-a83178ef-5e27-4f5a-a3af-7840c4234e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:53.338954 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83178ef-5e27-4f5a-a3af-7840c4234e57 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:53.343933 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d31136b-a47c-4e4c-abd7-93e9adf6b749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:53.344786 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31136b-a47c-4e4c-abd7-93e9adf6b749 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:53.345062 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31136b-a47c-4e4c-abd7-93e9adf6b749 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:53.345330 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31136b-a47c-4e4c-abd7-93e9adf6b749 admin admin] PATH_INFO: `/v3/projects/73d2dbe1fdf8413e8f3e3f6c38f1f291` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:53.346506 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d31136b-a47c-4e4c-abd7-93e9adf6b749 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73d2dbe1fdf8413e8f3e3f6c38f1f291)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:53.348437 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d31136b-a47c-4e4c-abd7-93e9adf6b749 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:53.396686 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-9d31136b-a47c-4e4c-abd7-93e9adf6b749 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73d2dbe1fdf8413e8f3e3f6c38f1f291', 'request_id': 'req-9d31136b-a47c-4e4c-abd7-93e9adf6b749'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:53.402850 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-9d31136b-a47c-4e4c-abd7-93e9adf6b749 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73d2dbe1fdf8413e8f3e3f6c38f1f291', 'request_id': 'req-9d31136b-a47c-4e4c-abd7-93e9adf6b749'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:53.408392 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-9d31136b-a47c-4e4c-abd7-93e9adf6b749 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73d2dbe1fdf8413e8f3e3f6c38f1f291', 'request_id': 'req-9d31136b-a47c-4e4c-abd7-93e9adf6b749'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:53.422023 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-9d31136b-a47c-4e4c-abd7-93e9adf6b749 admin admin] The token cache is being invalidate because project 73d2dbe1fdf8413e8f3e3f6c38f1f291 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:35:53.422311 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-9d31136b-a47c-4e4c-abd7-93e9adf6b749 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:53.422921 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-9d31136b-a47c-4e4c-abd7-93e9adf6b749 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:53.424497 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1382/2744] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:35:53 2022] DELETE /identity/v3/projects/73d2dbe1fdf8413e8f3e3f6c38f1f291 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:35:53.429350 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58c56c2-a3f4-4491-9408-57d0e844fd1a service neutron] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:53.438884 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58c56c2-a3f4-4491-9408-57d0e844fd1a service neutron] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:53.494546 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0f4503-1a96-4240-8076-1e3cc1d77cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:53.495517 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f4503-1a96-4240-8076-1e3cc1d77cc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:53.495799 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f4503-1a96-4240-8076-1e3cc1d77cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:53.496120 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f4503-1a96-4240-8076-1e3cc1d77cc8 admin admin] PATH_INFO: `/v3/users/f1fb92c0e7cc43b48d3058b86f27c964` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:53.497470 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0f4503-1a96-4240-8076-1e3cc1d77cc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1fb92c0e7cc43b48d3058b86f27c964)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:53.499634 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0f4503-1a96-4240-8076-1e3cc1d77cc8 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:53.549682 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-dc0f4503-1a96-4240-8076-1e3cc1d77cc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1fb92c0e7cc43b48d3058b86f27c964'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:53.557304 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-dc0f4503-1a96-4240-8076-1e3cc1d77cc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1fb92c0e7cc43b48d3058b86f27c964'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:53.564968 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-dc0f4503-1a96-4240-8076-1e3cc1d77cc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1fb92c0e7cc43b48d3058b86f27c964'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:53.568695 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-dc0f4503-1a96-4240-8076-1e3cc1d77cc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1fb92c0e7cc43b48d3058b86f27c964'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:53.570270 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-dc0f4503-1a96-4240-8076-1e3cc1d77cc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1fb92c0e7cc43b48d3058b86f27c964'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:53.591547 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1363/2745] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:35:53 2022] DELETE /identity/v3/users/f1fb92c0e7cc43b48d3058b86f27c964 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:35:53.884016 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d31136b-a47c-4e4c-abd7-93e9adf6b749 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:53.885727 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-9d31136b-a47c-4e4c-abd7-93e9adf6b749 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:53.899761 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d31136b-a47c-4e4c-abd7-93e9adf6b749 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:53.960412 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d322dca-e169-4f4d-b061-54a868759bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:53.961465 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d322dca-e169-4f4d-b061-54a868759bcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:53.961742 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d322dca-e169-4f4d-b061-54a868759bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:53.962014 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d322dca-e169-4f4d-b061-54a868759bcf admin admin] PATH_INFO: `/v3/projects/df11dfbe26244d98a240b068ec5cad93` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:53.963240 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d322dca-e169-4f4d-b061-54a868759bcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=df11dfbe26244d98a240b068ec5cad93)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:53.965169 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d322dca-e169-4f4d-b061-54a868759bcf admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:54.016849 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-2d322dca-e169-4f4d-b061-54a868759bcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df11dfbe26244d98a240b068ec5cad93', 'request_id': 'req-2d322dca-e169-4f4d-b061-54a868759bcf'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:54.024110 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-2d322dca-e169-4f4d-b061-54a868759bcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df11dfbe26244d98a240b068ec5cad93', 'request_id': 'req-2d322dca-e169-4f4d-b061-54a868759bcf'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:54.029393 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-2d322dca-e169-4f4d-b061-54a868759bcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df11dfbe26244d98a240b068ec5cad93', 'request_id': 'req-2d322dca-e169-4f4d-b061-54a868759bcf'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:54.041150 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-2d322dca-e169-4f4d-b061-54a868759bcf admin admin] The token cache is being invalidate because project df11dfbe26244d98a240b068ec5cad93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:35:54.041437 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-2d322dca-e169-4f4d-b061-54a868759bcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:54.042049 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-2d322dca-e169-4f4d-b061-54a868759bcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:35:54.043613 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1383/2746] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:35:53 2022] DELETE /identity/v3/projects/df11dfbe26244d98a240b068ec5cad93 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:35:54.048872 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a7153c-6832-438c-87b6-a68133d216b1 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:54.049389 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a7153c-6832-438c-87b6-a68133d216b1 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:54.049389 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a7153c-6832-438c-87b6-a68133d216b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:54.067696 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-18a7153c-6832-438c-87b6-a68133d216b1 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:35:54.069597 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-18a7153c-6832-438c-87b6-a68133d216b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:54.126709 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1364/2747] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:35:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:35:54.136267 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b97c4-ab90-4be9-a583-28308e0a8310 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:54.136575 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b97c4-ab90-4be9-a583-28308e0a8310 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:54.136847 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b97c4-ab90-4be9-a583-28308e0a8310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:54.157117 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-a58b97c4-ab90-4be9-a583-28308e0a8310 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:35:54.158311 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-a58b97c4-ab90-4be9-a583-28308e0a8310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:54.166322 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1384/2748] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:35:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:35:54.170501 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a7153c-6832-438c-87b6-a68133d216b1 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:54.180596 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a7153c-6832-438c-87b6-a68133d216b1 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:54.185146 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ed3d2c-fdb5-4cfc-9538-378e7d20d07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:54.185785 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ed3d2c-fdb5-4cfc-9538-378e7d20d07f admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:54.186067 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ed3d2c-fdb5-4cfc-9538-378e7d20d07f admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:54.186341 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ed3d2c-fdb5-4cfc-9538-378e7d20d07f admin admin] PATH_INFO: `/v3/domains` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:54.187062 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ed3d2c-fdb5-4cfc-9538-378e7d20d07f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:35:54.187369 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ed3d2c-fdb5-4cfc-9538-378e7d20d07f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:54.189007 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ed3d2c-fdb5-4cfc-9538-378e7d20d07f admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:54.201202 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1365/2749] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 9 20:35:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:35:54.205638 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58b97c4-ab90-4be9-a583-28308e0a8310 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:54.215771 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58b97c4-ab90-4be9-a583-28308e0a8310 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:54.220410 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64828c9a-5353-4521-8f31-f00c4621a76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:54.221050 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64828c9a-5353-4521-8f31-f00c4621a76c admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:54.221327 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64828c9a-5353-4521-8f31-f00c4621a76c admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:54.221598 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64828c9a-5353-4521-8f31-f00c4621a76c admin admin] PATH_INFO: `/v3/projects` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:54.222275 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64828c9a-5353-4521-8f31-f00c4621a76c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:54.224212 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64828c9a-5353-4521-8f31-f00c4621a76c admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:54.249399 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1385/2750] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:35:54 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:35:54.253953 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ed3d2c-fdb5-4cfc-9538-378e7d20d07f admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:54.264938 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ed3d2c-fdb5-4cfc-9538-378e7d20d07f admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:54.322698 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d43ad8-5ab3-437a-891e-04d8e418ccc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:54.323278 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d43ad8-5ab3-437a-891e-04d8e418ccc8 admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:54.323589 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d43ad8-5ab3-437a-891e-04d8e418ccc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:54.323860 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d43ad8-5ab3-437a-891e-04d8e418ccc8 admin admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:54.324541 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d43ad8-5ab3-437a-891e-04d8e418ccc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:54.326469 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d43ad8-5ab3-437a-891e-04d8e418ccc8 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:54.347089 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1366/2751] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:35:54 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:35:54.351691 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64828c9a-5353-4521-8f31-f00c4621a76c admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:54.361970 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64828c9a-5353-4521-8f31-f00c4621a76c admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:54.367218 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f5a233-8cd2-485d-8c42-2b8f2948b2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:54.367900 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f5a233-8cd2-485d-8c42-2b8f2948b2e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:54.368184 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f5a233-8cd2-485d-8c42-2b8f2948b2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:54.368457 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f5a233-8cd2-485d-8c42-2b8f2948b2e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:54.369209 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f5a233-8cd2-485d-8c42-2b8f2948b2e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:54.370799 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f5a233-8cd2-485d-8c42-2b8f2948b2e0 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:54.381714 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1386/2752] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:35:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:35:54.385980 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d43ad8-5ab3-437a-891e-04d8e418ccc8 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:54.395983 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d43ad8-5ab3-437a-891e-04d8e418ccc8 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:54.400743 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d1fa29-416b-4689-8394-b36fc7b6450d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:54.401396 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1fa29-416b-4689-8394-b36fc7b6450d admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:54.401675 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1fa29-416b-4689-8394-b36fc7b6450d admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:54.401943 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1fa29-416b-4689-8394-b36fc7b6450d admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:54.402660 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d1fa29-416b-4689-8394-b36fc7b6450d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:54.404295 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d1fa29-416b-4689-8394-b36fc7b6450d admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:54.414376 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1367/2753] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:35:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:35:54.418597 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f5a233-8cd2-485d-8c42-2b8f2948b2e0 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:54.429102 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f5a233-8cd2-485d-8c42-2b8f2948b2e0 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:54.433871 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d501c717-9e39-4c9b-a19c-1cc0dbb6811a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:54.434643 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d501c717-9e39-4c9b-a19c-1cc0dbb6811a admin admin] REQUEST_METHOD: `PUT` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:54.434925 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d501c717-9e39-4c9b-a19c-1cc0dbb6811a admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:54.435198 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d501c717-9e39-4c9b-a19c-1cc0dbb6811a admin admin] PATH_INFO: `/v3/projects/0eb4b5dbf0e548dea9e86a6d4fc9a789/users/93b6168308ca499db2847e4bc0328c73/roles/79f90a0bf6ea43d0b3c434e31556253a` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:54.451696 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d501c717-9e39-4c9b-a19c-1cc0dbb6811a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0eb4b5dbf0e548dea9e86a6d4fc9a789, user_id=93b6168308ca499db2847e4bc0328c73, role_id=79f90a0bf6ea43d0b3c434e31556253a)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:54.454331 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d501c717-9e39-4c9b-a19c-1cc0dbb6811a admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:54.467564 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1387/2754] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:35:54 2022] PUT /identity/v3/projects/0eb4b5dbf0e548dea9e86a6d4fc9a789/users/93b6168308ca499db2847e4bc0328c73/roles/79f90a0bf6ea43d0b3c434e31556253a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:35:54.479114 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ccc7d7-27bd-4504-9aef-b2e159e6eb6c None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:54.479419 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ccc7d7-27bd-4504-9aef-b2e159e6eb6c None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:54.479702 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ccc7d7-27bd-4504-9aef-b2e159e6eb6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:54.508178 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-98ccc7d7-27bd-4504-9aef-b2e159e6eb6c None None] MFA Rules not processed for user `93b6168308ca499db2847e4bc0328c73`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:35:54.509373 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-98ccc7d7-27bd-4504-9aef-b2e159e6eb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:54.571038 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1368/2755] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:35:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:35:54.582258 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d501c717-9e39-4c9b-a19c-1cc0dbb6811a admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:35:54.583792 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-d501c717-9e39-4c9b-a19c-1cc0dbb6811a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:35:54.643068 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d501c717-9e39-4c9b-a19c-1cc0dbb6811a admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:35:54.646801 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4adf6c-a537-458f-82b0-75e8bce90815 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d65e731386d44948dcc1ecd40cbda65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:35:54.647469 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4adf6c-a537-458f-82b0-75e8bce90815 service cinder] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:35:54.647755 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4adf6c-a537-458f-82b0-75e8bce90815 service cinder] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:35:54.648120 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4adf6c-a537-458f-82b0-75e8bce90815 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:35:54.656616 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4adf6c-a537-458f-82b0-75e8bce90815 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:35:54.658027 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4adf6c-a537-458f-82b0-75e8bce90815 service cinder] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:35:54.668031 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1388/2756] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:35:54 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:36:04.356723 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ccc7d7-27bd-4504-9aef-b2e159e6eb6c None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:36:04.416980 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ccc7d7-27bd-4504-9aef-b2e159e6eb6c None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:36:04.421338 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00023c92-0926-4567-adb9-f6ef5091eea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:36:04.422173 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00023c92-0926-4567-adb9-f6ef5091eea6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:36:04.422445 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00023c92-0926-4567-adb9-f6ef5091eea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:36:04.422709 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00023c92-0926-4567-adb9-f6ef5091eea6 admin admin] PATH_INFO: `/v3/users/93b6168308ca499db2847e4bc0328c73` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:36:04.423886 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00023c92-0926-4567-adb9-f6ef5091eea6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93b6168308ca499db2847e4bc0328c73)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:36:04.425782 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00023c92-0926-4567-adb9-f6ef5091eea6 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:36:04.469429 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-00023c92-0926-4567-adb9-f6ef5091eea6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93b6168308ca499db2847e4bc0328c73'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:36:04.476030 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-00023c92-0926-4567-adb9-f6ef5091eea6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93b6168308ca499db2847e4bc0328c73'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:36:04.483268 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-00023c92-0926-4567-adb9-f6ef5091eea6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93b6168308ca499db2847e4bc0328c73'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:36:04.483908 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-00023c92-0926-4567-adb9-f6ef5091eea6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93b6168308ca499db2847e4bc0328c73'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:36:04.484628 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-00023c92-0926-4567-adb9-f6ef5091eea6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93b6168308ca499db2847e4bc0328c73'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:36:04.502249 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1369/2757] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:36:04 2022] DELETE /identity/v3/users/93b6168308ca499db2847e4bc0328c73 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:36:04.506732 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c137c9a-7368-4218-8093-59ab3945a830 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:36:04.507234 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c137c9a-7368-4218-8093-59ab3945a830 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:36:04.507356 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c137c9a-7368-4218-8093-59ab3945a830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:36:04.523954 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-5c137c9a-7368-4218-8093-59ab3945a830 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:36:04.525396 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-5c137c9a-7368-4218-8093-59ab3945a830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:36:04.583467 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1389/2758] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:36:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:36:04.593091 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00023c92-0926-4567-adb9-f6ef5091eea6 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:36:04.594458 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-00023c92-0926-4567-adb9-f6ef5091eea6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:36:04.649552 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00023c92-0926-4567-adb9-f6ef5091eea6 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:36:04.653645 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c57fec-f69f-49fb-a768-2362f2ce4757 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:36:04.654282 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c57fec-f69f-49fb-a768-2362f2ce4757 service neutron] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:36:04.654556 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c57fec-f69f-49fb-a768-2362f2ce4757 service neutron] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:36:04.654823 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c57fec-f69f-49fb-a768-2362f2ce4757 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:36:04.663577 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c57fec-f69f-49fb-a768-2362f2ce4757 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:36:04.665001 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c57fec-f69f-49fb-a768-2362f2ce4757 service neutron] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:36:04.674615 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1370/2759] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:36:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:36:04.937362 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c137c9a-7368-4218-8093-59ab3945a830 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:36:04.938798 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-5c137c9a-7368-4218-8093-59ab3945a830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:36:04.951562 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c137c9a-7368-4218-8093-59ab3945a830 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:36:04.956166 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc3cb33-001d-45de-870e-bb7c901f7de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:36:04.957020 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc3cb33-001d-45de-870e-bb7c901f7de9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:36:04.957301 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc3cb33-001d-45de-870e-bb7c901f7de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:36:04.957577 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc3cb33-001d-45de-870e-bb7c901f7de9 admin admin] PATH_INFO: `/v3/projects/0eb4b5dbf0e548dea9e86a6d4fc9a789` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:36:04.958758 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc3cb33-001d-45de-870e-bb7c901f7de9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0eb4b5dbf0e548dea9e86a6d4fc9a789)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:36:04.960711 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc3cb33-001d-45de-870e-bb7c901f7de9 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:36:05.005504 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-fdc3cb33-001d-45de-870e-bb7c901f7de9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0eb4b5dbf0e548dea9e86a6d4fc9a789', 'request_id': 'req-fdc3cb33-001d-45de-870e-bb7c901f7de9'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:36:05.012422 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-fdc3cb33-001d-45de-870e-bb7c901f7de9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0eb4b5dbf0e548dea9e86a6d4fc9a789', 'request_id': 'req-fdc3cb33-001d-45de-870e-bb7c901f7de9'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:36:05.017467 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-fdc3cb33-001d-45de-870e-bb7c901f7de9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0eb4b5dbf0e548dea9e86a6d4fc9a789', 'request_id': 'req-fdc3cb33-001d-45de-870e-bb7c901f7de9'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:36:05.029460 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-fdc3cb33-001d-45de-870e-bb7c901f7de9 admin admin] The token cache is being invalidate because project 0eb4b5dbf0e548dea9e86a6d4fc9a789 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:36:05.029729 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-fdc3cb33-001d-45de-870e-bb7c901f7de9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:36:05.030376 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-fdc3cb33-001d-45de-870e-bb7c901f7de9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:36:05.032099 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1390/2760] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:36:04 2022] DELETE /identity/v3/projects/0eb4b5dbf0e548dea9e86a6d4fc9a789 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:36:05.037051 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b59c01-3892-4c89-9fe4-434af5c8d313 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:36:05.037334 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b59c01-3892-4c89-9fe4-434af5c8d313 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:36:05.037601 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b59c01-3892-4c89-9fe4-434af5c8d313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:36:05.054765 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-a6b59c01-3892-4c89-9fe4-434af5c8d313 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:36:05.056494 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-a6b59c01-3892-4c89-9fe4-434af5c8d313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:36:05.113578 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1371/2761] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:36:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:36:05.121470 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b56a50b-7e06-4e12-8d1a-a742874a90b5 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:36:05.121764 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b56a50b-7e06-4e12-8d1a-a742874a90b5 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:36:05.122040 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b56a50b-7e06-4e12-8d1a-a742874a90b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:36:05.140145 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-7b56a50b-7e06-4e12-8d1a-a742874a90b5 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:36:05.141343 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-7b56a50b-7e06-4e12-8d1a-a742874a90b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:36:05.149379 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1391/2762] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:36:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:36:05.153626 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b59c01-3892-4c89-9fe4-434af5c8d313 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:36:05.163205 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b59c01-3892-4c89-9fe4-434af5c8d313 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:36:05.168584 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0d0597-6957-4934-b46d-cb92ef3d24d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:36:05.169233 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d0597-6957-4934-b46d-cb92ef3d24d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:36:05.169512 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d0597-6957-4934-b46d-cb92ef3d24d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:36:05.169782 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d0597-6957-4934-b46d-cb92ef3d24d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:36:05.170502 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0d0597-6957-4934-b46d-cb92ef3d24d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:36:05.170808 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0d0597-6957-4934-b46d-cb92ef3d24d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:36:05.172444 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0d0597-6957-4934-b46d-cb92ef3d24d1 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:36:05.184446 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1372/2763] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 9 20:36:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:36:05.188742 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b56a50b-7e06-4e12-8d1a-a742874a90b5 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:36:05.197973 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b56a50b-7e06-4e12-8d1a-a742874a90b5 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:36:05.202576 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17977ee3-a5a0-4a8b-b829-5516e4bdb7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:36:05.203214 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17977ee3-a5a0-4a8b-b829-5516e4bdb7d5 admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:36:05.203529 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17977ee3-a5a0-4a8b-b829-5516e4bdb7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:36:05.203804 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17977ee3-a5a0-4a8b-b829-5516e4bdb7d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:36:05.204520 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17977ee3-a5a0-4a8b-b829-5516e4bdb7d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:36:05.206456 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17977ee3-a5a0-4a8b-b829-5516e4bdb7d5 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:36:05.230962 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1392/2764] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:36:05 2022] POST /identity/v3/projects => generated 373 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 20:36:05.234934 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0d0597-6957-4934-b46d-cb92ef3d24d1 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:36:05.245565 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0d0597-6957-4934-b46d-cb92ef3d24d1 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:36:05.307220 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa9d380-2407-4784-bf66-fb1bfb99d439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:36:05.307909 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa9d380-2407-4784-bf66-fb1bfb99d439 admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:36:05.308189 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa9d380-2407-4784-bf66-fb1bfb99d439 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:36:05.308461 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa9d380-2407-4784-bf66-fb1bfb99d439 admin admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:36:05.309148 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa9d380-2407-4784-bf66-fb1bfb99d439 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:36:05.311056 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa9d380-2407-4784-bf66-fb1bfb99d439 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:36:05.330787 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1373/2765] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:36:05 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:36:05.334804 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17977ee3-a5a0-4a8b-b829-5516e4bdb7d5 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:36:05.344894 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17977ee3-a5a0-4a8b-b829-5516e4bdb7d5 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:36:05.349606 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d24cb3f-a4ae-4c2d-bf34-a85398dfde01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:36:05.350254 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d24cb3f-a4ae-4c2d-bf34-a85398dfde01 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:36:05.350535 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d24cb3f-a4ae-4c2d-bf34-a85398dfde01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:36:05.350806 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d24cb3f-a4ae-4c2d-bf34-a85398dfde01 admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:36:05.351552 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d24cb3f-a4ae-4c2d-bf34-a85398dfde01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:36:05.353643 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d24cb3f-a4ae-4c2d-bf34-a85398dfde01 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:36:05.363940 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1393/2766] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:36:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:36:05.367939 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa9d380-2407-4784-bf66-fb1bfb99d439 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:36:05.378941 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa9d380-2407-4784-bf66-fb1bfb99d439 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:36:05.384968 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4079b5c2-13d2-4688-8f80-c11c3a3c3c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:36:05.385870 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079b5c2-13d2-4688-8f80-c11c3a3c3c45 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:36:05.386144 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079b5c2-13d2-4688-8f80-c11c3a3c3c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:36:05.386413 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079b5c2-13d2-4688-8f80-c11c3a3c3c45 admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:36:05.387127 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4079b5c2-13d2-4688-8f80-c11c3a3c3c45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:36:05.388740 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4079b5c2-13d2-4688-8f80-c11c3a3c3c45 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:36:05.398830 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1374/2767] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:36:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:36:05.403146 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d24cb3f-a4ae-4c2d-bf34-a85398dfde01 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:36:05.412764 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d24cb3f-a4ae-4c2d-bf34-a85398dfde01 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:36:05.418022 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f623edfc-e248-4e5f-960e-ee65f4957ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:36:05.418885 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623edfc-e248-4e5f-960e-ee65f4957ba7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:36:05.419163 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623edfc-e248-4e5f-960e-ee65f4957ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:36:05.419460 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623edfc-e248-4e5f-960e-ee65f4957ba7 admin admin] PATH_INFO: `/v3/projects/5c2236bae25a403e87f16039620cac17/users/925d362ab9e847f281d212a8b5b630a4/roles/79f90a0bf6ea43d0b3c434e31556253a` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:36:05.433992 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f623edfc-e248-4e5f-960e-ee65f4957ba7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c2236bae25a403e87f16039620cac17, user_id=925d362ab9e847f281d212a8b5b630a4, role_id=79f90a0bf6ea43d0b3c434e31556253a)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:36:05.436639 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f623edfc-e248-4e5f-960e-ee65f4957ba7 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:36:05.449131 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1394/2768] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:36:05 2022] PUT /identity/v3/projects/5c2236bae25a403e87f16039620cac17/users/925d362ab9e847f281d212a8b5b630a4/roles/79f90a0bf6ea43d0b3c434e31556253a => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:36:05.458925 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e737b627-faf9-4a36-a77e-c5d83c00c003 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:36:05.459262 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e737b627-faf9-4a36-a77e-c5d83c00c003 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:36:05.459591 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e737b627-faf9-4a36-a77e-c5d83c00c003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:36:05.486208 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-e737b627-faf9-4a36-a77e-c5d83c00c003 None None] MFA Rules not processed for user `925d362ab9e847f281d212a8b5b630a4`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:36:05.487388 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-e737b627-faf9-4a36-a77e-c5d83c00c003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:36:05.548706 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1375/2769] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:36:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:36:05.559207 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f623edfc-e248-4e5f-960e-ee65f4957ba7 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:36:05.561006 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-f623edfc-e248-4e5f-960e-ee65f4957ba7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:36:05.620221 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f623edfc-e248-4e5f-960e-ee65f4957ba7 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:36:05.623758 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e57b02-06d9-450f-8a83-c846af49c492 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d65e731386d44948dcc1ecd40cbda65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:36:05.624392 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e57b02-06d9-450f-8a83-c846af49c492 service cinder] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:36:05.624670 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e57b02-06d9-450f-8a83-c846af49c492 service cinder] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:36:05.624941 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e57b02-06d9-450f-8a83-c846af49c492 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:36:05.632938 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e57b02-06d9-450f-8a83-c846af49c492 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:36:05.634363 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e57b02-06d9-450f-8a83-c846af49c492 service cinder] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:36:05.643729 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1395/2770] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:36:05 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:36:08.014632 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3876014e-ced3-41f3-9a4f-d8fd2b1a96a7 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:36:08.015163 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3876014e-ced3-41f3-9a4f-d8fd2b1a96a7 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:36:08.015272 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3876014e-ced3-41f3-9a4f-d8fd2b1a96a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:36:08.032128 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-3876014e-ced3-41f3-9a4f-d8fd2b1a96a7 None None] MFA Rules not processed for user `925d362ab9e847f281d212a8b5b630a4`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:36:08.033292 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-3876014e-ced3-41f3-9a4f-d8fd2b1a96a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:36:08.040271 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1376/2771] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:36:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:36:08.486716 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e57b02-06d9-450f-8a83-c846af49c492 service cinder] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:36:08.488105 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-d6e57b02-06d9-450f-8a83-c846af49c492 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:36:08.554917 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e57b02-06d9-450f-8a83-c846af49c492 service cinder] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:36:08.559933 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82202cc-c698-4a05-9889-1d8e3857583b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '285198b50b50431f96f9225d106417a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:36:08.560563 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82202cc-c698-4a05-9889-1d8e3857583b service placement] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:36:08.560842 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82202cc-c698-4a05-9889-1d8e3857583b service placement] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:36:08.561139 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82202cc-c698-4a05-9889-1d8e3857583b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:36:08.562887 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-e82202cc-c698-4a05-9889-1d8e3857583b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:36:08.574143 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82202cc-c698-4a05-9889-1d8e3857583b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:36:08.575744 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82202cc-c698-4a05-9889-1d8e3857583b service placement] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:36:08.585440 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1396/2772] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:36:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:36:10.309155 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3876014e-ced3-41f3-9a4f-d8fd2b1a96a7 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:36:10.310693 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-3876014e-ced3-41f3-9a4f-d8fd2b1a96a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:36:10.372351 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3876014e-ced3-41f3-9a4f-d8fd2b1a96a7 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:36:10.375977 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2092ebce-8a63-4d4b-9291-5736eb65a6c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:36:10.376698 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092ebce-8a63-4d4b-9291-5736eb65a6c5 service neutron] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:36:10.377036 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092ebce-8a63-4d4b-9291-5736eb65a6c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:36:10.377370 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092ebce-8a63-4d4b-9291-5736eb65a6c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:36:10.379177 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-2092ebce-8a63-4d4b-9291-5736eb65a6c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:36:10.390631 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2092ebce-8a63-4d4b-9291-5736eb65a6c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:36:10.392102 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2092ebce-8a63-4d4b-9291-5736eb65a6c5 service neutron] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:36:10.401018 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1377/2773] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:36:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:36:20.562578 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82202cc-c698-4a05-9889-1d8e3857583b service placement] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:36:20.564058 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-e82202cc-c698-4a05-9889-1d8e3857583b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:36:20.643710 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82202cc-c698-4a05-9889-1d8e3857583b service placement] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:36:20.649061 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e13240-22c5-4231-b722-c957c11cb484 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb59440b21074d9da15679dc2d745f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:36:20.649699 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e13240-22c5-4231-b722-c957c11cb484 service nova] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:36:20.650199 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e13240-22c5-4231-b722-c957c11cb484 service nova] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:36:20.650478 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e13240-22c5-4231-b722-c957c11cb484 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:36:20.652272 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-25e13240-22c5-4231-b722-c957c11cb484 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:36:20.663839 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e13240-22c5-4231-b722-c957c11cb484 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:36:20.665559 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e13240-22c5-4231-b722-c957c11cb484 service nova] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:36:20.675799 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1397/2774] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:36:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:36:31.062503 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22299c02-dac3-416c-9904-ed5c5d40eb3e None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:36:31.062957 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22299c02-dac3-416c-9904-ed5c5d40eb3e None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:36:31.063065 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22299c02-dac3-416c-9904-ed5c5d40eb3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:36:31.080810 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-22299c02-dac3-416c-9904-ed5c5d40eb3e None None] MFA Rules not processed for user `0227b2954e61426388214e96e1741eb2`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:36:31.081977 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-22299c02-dac3-416c-9904-ed5c5d40eb3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:36:31.132473 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1378/2775] 10.222.0.44 () {58 vars in 1009 bytes} [Mon May 9 20:36:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:36:31.177546 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e13240-22c5-4231-b722-c957c11cb484 service nova] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:36:31.178929 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-25e13240-22c5-4231-b722-c957c11cb484 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:36:31.245124 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e13240-22c5-4231-b722-c957c11cb484 service nova] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:36:31.250022 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7f3c63-16b9-4d27-87d0-625468b7094f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965089f1a92f49bd883b337d6042c69f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:36:31.250652 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f3c63-16b9-4d27-87d0-625468b7094f service swift] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:36:31.250931 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f3c63-16b9-4d27-87d0-625468b7094f service swift] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:36:31.251203 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f3c63-16b9-4d27-87d0-625468b7094f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:36:31.259641 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7f3c63-16b9-4d27-87d0-625468b7094f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:36:31.261457 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7f3c63-16b9-4d27-87d0-625468b7094f service swift] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:36:31.269635 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1398/2776] 10.222.0.44 () {60 vars in 1384 bytes} [Mon May 9 20:36:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 09 20:36:31.773415 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d433c-dc97-4093-a8fd-d88f15ef08df None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:36:31.773701 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d433c-dc97-4093-a8fd-d88f15ef08df None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:36:31.774483 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d433c-dc97-4093-a8fd-d88f15ef08df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:36:31.792136 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-487d433c-dc97-4093-a8fd-d88f15ef08df None None] MFA Rules not processed for user `0227b2954e61426388214e96e1741eb2`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:36:31.793299 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-487d433c-dc97-4093-a8fd-d88f15ef08df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:36:31.800193 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1379/2777] 10.222.0.44 () {58 vars in 967 bytes} [Mon May 9 20:36:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:36:31.812214 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7f3c63-16b9-4d27-87d0-625468b7094f service swift] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:36:31.822518 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7f3c63-16b9-4d27-87d0-625468b7094f service swift] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:36:31.827467 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a7762-ca84-4d3d-84f5-161bbb3acb57 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965089f1a92f49bd883b337d6042c69f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:36:31.828085 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a7762-ca84-4d3d-84f5-161bbb3acb57 service swift] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:36:31.828363 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a7762-ca84-4d3d-84f5-161bbb3acb57 service swift] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:36:31.828632 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a7762-ca84-4d3d-84f5-161bbb3acb57 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:36:31.836334 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758a7762-ca84-4d3d-84f5-161bbb3acb57 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:36:31.838385 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758a7762-ca84-4d3d-84f5-161bbb3acb57 service swift] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:36:31.846037 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1399/2778] 10.222.0.44 () {60 vars in 1384 bytes} [Mon May 9 20:36:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 09 20:36:32.038141 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34184857-5d93-431b-8eb6-6fd1463daf52 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:36:32.038425 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34184857-5d93-431b-8eb6-6fd1463daf52 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:36:32.038699 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34184857-5d93-431b-8eb6-6fd1463daf52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:36:32.057780 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-34184857-5d93-431b-8eb6-6fd1463daf52 None None] MFA Rules not processed for user `0227b2954e61426388214e96e1741eb2`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:36:32.058957 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-34184857-5d93-431b-8eb6-6fd1463daf52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:36:32.065920 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1380/2779] 10.222.0.44 () {58 vars in 1009 bytes} [Mon May 9 20:36:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:36:32.077924 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a7762-ca84-4d3d-84f5-161bbb3acb57 service swift] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:36:32.088728 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a7762-ca84-4d3d-84f5-161bbb3acb57 service swift] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:36:32.093645 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cff9d7d-d9b0-4a4d-a400-5299b337faad service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965089f1a92f49bd883b337d6042c69f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:36:32.094265 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff9d7d-d9b0-4a4d-a400-5299b337faad service swift] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:36:32.094541 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff9d7d-d9b0-4a4d-a400-5299b337faad service swift] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:36:32.094810 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff9d7d-d9b0-4a4d-a400-5299b337faad service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:36:32.103102 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cff9d7d-d9b0-4a4d-a400-5299b337faad service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:36:32.104693 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cff9d7d-d9b0-4a4d-a400-5299b337faad service swift] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:36:32.112465 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1400/2780] 10.222.0.44 () {60 vars in 1384 bytes} [Mon May 9 20:36:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 09 20:36:32.419080 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d9e42-0259-4168-8ddc-ebdd54511d7e None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:36:32.419428 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d9e42-0259-4168-8ddc-ebdd54511d7e None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:36:32.419708 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d9e42-0259-4168-8ddc-ebdd54511d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:36:32.437701 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-747d9e42-0259-4168-8ddc-ebdd54511d7e None None] MFA Rules not processed for user `0227b2954e61426388214e96e1741eb2`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:36:32.438889 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-747d9e42-0259-4168-8ddc-ebdd54511d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:36:32.446485 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1381/2781] 10.222.0.44 () {58 vars in 967 bytes} [Mon May 9 20:36:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:36:32.459985 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cff9d7d-d9b0-4a4d-a400-5299b337faad service swift] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:36:32.472205 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cff9d7d-d9b0-4a4d-a400-5299b337faad service swift] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:36:32.478027 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809d4c79-6c53-4c3a-a9fb-ced984021f07 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965089f1a92f49bd883b337d6042c69f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:36:32.478662 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d4c79-6c53-4c3a-a9fb-ced984021f07 service swift] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:36:32.478942 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d4c79-6c53-4c3a-a9fb-ced984021f07 service swift] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:36:32.479582 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d4c79-6c53-4c3a-a9fb-ced984021f07 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:36:32.488311 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809d4c79-6c53-4c3a-a9fb-ced984021f07 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:36:32.490024 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809d4c79-6c53-4c3a-a9fb-ced984021f07 service swift] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:36:32.500057 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1401/2782] 10.222.0.44 () {60 vars in 1384 bytes} [Mon May 9 20:36:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 09 20:36:34.515824 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d9e42-0259-4168-8ddc-ebdd54511d7e None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:36:34.576669 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d9e42-0259-4168-8ddc-ebdd54511d7e None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:36:34.581159 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1158857e-db59-485b-a65b-75c7540d0268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:36:34.582032 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1158857e-db59-485b-a65b-75c7540d0268 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:36:34.582308 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1158857e-db59-485b-a65b-75c7540d0268 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:36:34.582574 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1158857e-db59-485b-a65b-75c7540d0268 admin admin] PATH_INFO: `/v3/users/925d362ab9e847f281d212a8b5b630a4` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:36:34.583778 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1158857e-db59-485b-a65b-75c7540d0268 admin admin] RBAC: Authorizing `identity:delete_user(user_id=925d362ab9e847f281d212a8b5b630a4)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:36:34.585683 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1158857e-db59-485b-a65b-75c7540d0268 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:36:34.630036 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-1158857e-db59-485b-a65b-75c7540d0268 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '925d362ab9e847f281d212a8b5b630a4'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:36:34.637130 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-1158857e-db59-485b-a65b-75c7540d0268 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '925d362ab9e847f281d212a8b5b630a4'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:36:34.648382 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-1158857e-db59-485b-a65b-75c7540d0268 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '925d362ab9e847f281d212a8b5b630a4'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:36:34.649091 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-1158857e-db59-485b-a65b-75c7540d0268 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '925d362ab9e847f281d212a8b5b630a4'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:36:34.649928 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-1158857e-db59-485b-a65b-75c7540d0268 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '925d362ab9e847f281d212a8b5b630a4'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:36:34.659809 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809d4c79-6c53-4c3a-a9fb-ced984021f07 service swift] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:36:34.661282 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-809d4c79-6c53-4c3a-a9fb-ced984021f07 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:36:34.670785 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1382/2783] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:36:34 2022] DELETE /identity/v3/users/925d362ab9e847f281d212a8b5b630a4 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:36:34.675264 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809d4c79-6c53-4c3a-a9fb-ced984021f07 service swift] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:36:34.675464 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac38dc-6944-4277-b3ec-2ccd9f9dd7ab None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:36:34.675753 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac38dc-6944-4277-b3ec-2ccd9f9dd7ab None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:36:34.676142 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac38dc-6944-4277-b3ec-2ccd9f9dd7ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:36:34.693782 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-2eac38dc-6944-4277-b3ec-2ccd9f9dd7ab None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:36:34.694964 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-2eac38dc-6944-4277-b3ec-2ccd9f9dd7ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:36:34.730210 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b37cc5-8f70-4340-8444-5827ec38258f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:36:34.731081 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b37cc5-8f70-4340-8444-5827ec38258f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:36:34.731363 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b37cc5-8f70-4340-8444-5827ec38258f admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:36:34.731674 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b37cc5-8f70-4340-8444-5827ec38258f admin admin] PATH_INFO: `/v3/users/7b822b00f9af400c8229497e8c2051cf` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:36:34.732908 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b37cc5-8f70-4340-8444-5827ec38258f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b822b00f9af400c8229497e8c2051cf)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:36:34.734908 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b37cc5-8f70-4340-8444-5827ec38258f admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:36:34.750749 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1383/2784] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:36:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:36:34.761163 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eac38dc-6944-4277-b3ec-2ccd9f9dd7ab None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:36:34.762527 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-2eac38dc-6944-4277-b3ec-2ccd9f9dd7ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:36:34.781821 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-05b37cc5-8f70-4340-8444-5827ec38258f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b822b00f9af400c8229497e8c2051cf'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:36:34.782476 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-05b37cc5-8f70-4340-8444-5827ec38258f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b822b00f9af400c8229497e8c2051cf'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:36:34.789096 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-05b37cc5-8f70-4340-8444-5827ec38258f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b822b00f9af400c8229497e8c2051cf'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:36:34.790573 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-05b37cc5-8f70-4340-8444-5827ec38258f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b822b00f9af400c8229497e8c2051cf'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:36:34.797997 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-05b37cc5-8f70-4340-8444-5827ec38258f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b822b00f9af400c8229497e8c2051cf'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:36:34.815183 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1402/2785] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:36:34 2022] DELETE /identity/v3/users/7b822b00f9af400c8229497e8c2051cf => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:36:34.819484 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eac38dc-6944-4277-b3ec-2ccd9f9dd7ab None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:36:34.821384 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be7fdd-f4a0-4ddb-a17b-1f2280808a6e None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:36:34.821670 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be7fdd-f4a0-4ddb-a17b-1f2280808a6e None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:36:34.821943 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be7fdd-f4a0-4ddb-a17b-1f2280808a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:36:34.840715 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-84be7fdd-f4a0-4ddb-a17b-1f2280808a6e None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:36:34.841931 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-84be7fdd-f4a0-4ddb-a17b-1f2280808a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:36:34.866197 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8882b0-49a5-4b7a-b8ce-295cc71b3295 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:36:34.866838 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8882b0-49a5-4b7a-b8ce-295cc71b3295 service neutron] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:36:34.867115 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8882b0-49a5-4b7a-b8ce-295cc71b3295 service neutron] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:36:34.867387 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8882b0-49a5-4b7a-b8ce-295cc71b3295 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:36:34.869918 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-8c8882b0-49a5-4b7a-b8ce-295cc71b3295 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:36:34.899493 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1403/2786] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:36:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:36:34.908928 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be7fdd-f4a0-4ddb-a17b-1f2280808a6e None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:36:34.910331 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-84be7fdd-f4a0-4ddb-a17b-1f2280808a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:36:34.922286 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be7fdd-f4a0-4ddb-a17b-1f2280808a6e None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:36:34.925868 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e010f7f1-5d15-4598-896e-9bdde29e7fa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:36:34.926495 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e010f7f1-5d15-4598-896e-9bdde29e7fa6 service neutron] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:36:34.926780 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e010f7f1-5d15-4598-896e-9bdde29e7fa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:36:34.927054 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e010f7f1-5d15-4598-896e-9bdde29e7fa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:36:34.932061 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8882b0-49a5-4b7a-b8ce-295cc71b3295 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:36:34.933506 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8882b0-49a5-4b7a-b8ce-295cc71b3295 service neutron] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:36:34.936902 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e010f7f1-5d15-4598-896e-9bdde29e7fa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:36:34.938315 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e010f7f1-5d15-4598-896e-9bdde29e7fa6 service neutron] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:36:34.942850 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1384/2787] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:36:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 09 20:36:34.948681 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1404/2788] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:36:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 09 20:36:35.224674 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8882b0-49a5-4b7a-b8ce-295cc71b3295 service neutron] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:36:35.226199 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-8c8882b0-49a5-4b7a-b8ce-295cc71b3295 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:36:35.239008 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8882b0-49a5-4b7a-b8ce-295cc71b3295 service neutron] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:36:35.244536 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0bd2aa-80f1-4a55-a7e7-2f4a16ee0c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:36:35.245397 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0bd2aa-80f1-4a55-a7e7-2f4a16ee0c43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:36:35.245678 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0bd2aa-80f1-4a55-a7e7-2f4a16ee0c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:36:35.245994 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0bd2aa-80f1-4a55-a7e7-2f4a16ee0c43 admin admin] PATH_INFO: `/v3/projects/5c2236bae25a403e87f16039620cac17` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:36:35.247180 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0bd2aa-80f1-4a55-a7e7-2f4a16ee0c43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c2236bae25a403e87f16039620cac17)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:36:35.249121 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0bd2aa-80f1-4a55-a7e7-2f4a16ee0c43 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:36:35.296288 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-af0bd2aa-80f1-4a55-a7e7-2f4a16ee0c43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c2236bae25a403e87f16039620cac17', 'request_id': 'req-af0bd2aa-80f1-4a55-a7e7-2f4a16ee0c43'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:36:35.302913 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-af0bd2aa-80f1-4a55-a7e7-2f4a16ee0c43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c2236bae25a403e87f16039620cac17', 'request_id': 'req-af0bd2aa-80f1-4a55-a7e7-2f4a16ee0c43'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:36:35.309805 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-af0bd2aa-80f1-4a55-a7e7-2f4a16ee0c43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c2236bae25a403e87f16039620cac17', 'request_id': 'req-af0bd2aa-80f1-4a55-a7e7-2f4a16ee0c43'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:36:35.321117 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e010f7f1-5d15-4598-896e-9bdde29e7fa6 service neutron] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:36:35.322735 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-e010f7f1-5d15-4598-896e-9bdde29e7fa6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:36:35.326619 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-af0bd2aa-80f1-4a55-a7e7-2f4a16ee0c43 admin admin] The token cache is being invalidate because project 5c2236bae25a403e87f16039620cac17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:36:35.327119 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-af0bd2aa-80f1-4a55-a7e7-2f4a16ee0c43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:36:35.328446 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-af0bd2aa-80f1-4a55-a7e7-2f4a16ee0c43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:36:35.331225 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1385/2789] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:36:35 2022] DELETE /identity/v3/projects/5c2236bae25a403e87f16039620cac17 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:36:35.336873 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a8c896-c2cf-40f8-a02e-122ba6076997 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:36:35.337210 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a8c896-c2cf-40f8-a02e-122ba6076997 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:36:35.337457 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a8c896-c2cf-40f8-a02e-122ba6076997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:36:35.350762 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e010f7f1-5d15-4598-896e-9bdde29e7fa6 service neutron] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:36:35.356973 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-23a8c896-c2cf-40f8-a02e-122ba6076997 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:36:35.358179 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-23a8c896-c2cf-40f8-a02e-122ba6076997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:36:35.424056 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae7a53b-d9ed-4f53-b73d-59eb621b66c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:36:35.424912 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae7a53b-d9ed-4f53-b73d-59eb621b66c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:36:35.425186 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae7a53b-d9ed-4f53-b73d-59eb621b66c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:36:35.425453 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae7a53b-d9ed-4f53-b73d-59eb621b66c8 admin admin] PATH_INFO: `/v3/projects/aad287354c8943418a1329c08e790c84` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:36:35.426601 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae7a53b-d9ed-4f53-b73d-59eb621b66c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aad287354c8943418a1329c08e790c84)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:36:35.428184 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1386/2790] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:36:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:36:35.428656 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae7a53b-d9ed-4f53-b73d-59eb621b66c8 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:36:35.436649 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac344ace-16fe-474c-8325-10391ff3ef28 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:36:35.436961 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac344ace-16fe-474c-8325-10391ff3ef28 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:36:35.437235 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac344ace-16fe-474c-8325-10391ff3ef28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:36:35.456801 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-ac344ace-16fe-474c-8325-10391ff3ef28 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:36:35.458249 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-ac344ace-16fe-474c-8325-10391ff3ef28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:36:35.466974 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1387/2791] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:36:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:36:35.470998 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac344ace-16fe-474c-8325-10391ff3ef28 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:36:35.476249 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-9ae7a53b-d9ed-4f53-b73d-59eb621b66c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aad287354c8943418a1329c08e790c84', 'request_id': 'req-9ae7a53b-d9ed-4f53-b73d-59eb621b66c8'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:36:35.481298 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac344ace-16fe-474c-8325-10391ff3ef28 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:36:35.483275 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-9ae7a53b-d9ed-4f53-b73d-59eb621b66c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aad287354c8943418a1329c08e790c84', 'request_id': 'req-9ae7a53b-d9ed-4f53-b73d-59eb621b66c8'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:36:35.488790 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-9ae7a53b-d9ed-4f53-b73d-59eb621b66c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aad287354c8943418a1329c08e790c84', 'request_id': 'req-9ae7a53b-d9ed-4f53-b73d-59eb621b66c8'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:36:35.502375 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-9ae7a53b-d9ed-4f53-b73d-59eb621b66c8 admin admin] The token cache is being invalidate because project aad287354c8943418a1329c08e790c84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:36:35.502776 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-9ae7a53b-d9ed-4f53-b73d-59eb621b66c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:36:35.503526 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-9ae7a53b-d9ed-4f53-b73d-59eb621b66c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:36:35.505143 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1405/2792] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:36:35 2022] DELETE /identity/v3/projects/aad287354c8943418a1329c08e790c84 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:36:35.510435 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d41c93-5920-4425-aece-d619c870aca7 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:36:35.510736 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d41c93-5920-4425-aece-d619c870aca7 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:36:35.511007 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d41c93-5920-4425-aece-d619c870aca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:36:35.528801 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-a2d41c93-5920-4425-aece-d619c870aca7 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:36:35.529908 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-a2d41c93-5920-4425-aece-d619c870aca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:36:35.536304 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c315b-4f52-486b-8500-dea689de5e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:36:35.536959 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c315b-4f52-486b-8500-dea689de5e90 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:36:35.537234 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c315b-4f52-486b-8500-dea689de5e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:36:35.537501 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c315b-4f52-486b-8500-dea689de5e90 admin admin] PATH_INFO: `/v3/domains` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:36:35.538214 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89c315b-4f52-486b-8500-dea689de5e90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:36:35.538518 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89c315b-4f52-486b-8500-dea689de5e90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:36:35.540222 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89c315b-4f52-486b-8500-dea689de5e90 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:36:35.551589 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1388/2793] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 9 20:36:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:36:35.556483 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c315b-4f52-486b-8500-dea689de5e90 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:36:35.558218 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-f89c315b-4f52-486b-8500-dea689de5e90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:36:35.570347 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c315b-4f52-486b-8500-dea689de5e90 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:36:35.575932 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f40d4b-5853-4b2c-82de-0c26923ac052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:36:35.576582 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f40d4b-5853-4b2c-82de-0c26923ac052 admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:36:35.576859 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f40d4b-5853-4b2c-82de-0c26923ac052 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:36:35.577124 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f40d4b-5853-4b2c-82de-0c26923ac052 admin admin] PATH_INFO: `/v3/projects` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:36:35.577801 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f40d4b-5853-4b2c-82de-0c26923ac052 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:36:35.579726 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f40d4b-5853-4b2c-82de-0c26923ac052 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:36:35.590772 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1406/2794] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:36:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:36:35.599089 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd53d11-4d4c-4626-9737-1e5efc459ceb None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:36:35.599375 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd53d11-4d4c-4626-9737-1e5efc459ceb None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:36:35.599693 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd53d11-4d4c-4626-9737-1e5efc459ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:36:35.608019 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1389/2795] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:36:35 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 20:36:35.612250 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f40d4b-5853-4b2c-82de-0c26923ac052 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:36:35.622709 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-1bd53d11-4d4c-4626-9737-1e5efc459ceb None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:36:35.624080 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-1bd53d11-4d4c-4626-9737-1e5efc459ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:36:35.674883 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f40d4b-5853-4b2c-82de-0c26923ac052 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:36:35.679619 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8300b55f-93a7-4fd2-be1b-ea0ff61ac241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:36:35.681359 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300b55f-93a7-4fd2-be1b-ea0ff61ac241 admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:36:35.681656 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300b55f-93a7-4fd2-be1b-ea0ff61ac241 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:36:35.681932 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300b55f-93a7-4fd2-be1b-ea0ff61ac241 admin admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:36:35.682622 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8300b55f-93a7-4fd2-be1b-ea0ff61ac241 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:36:35.684604 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8300b55f-93a7-4fd2-be1b-ea0ff61ac241 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:36:35.688141 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1407/2796] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:36:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:36:35.692349 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd53d11-4d4c-4626-9737-1e5efc459ceb None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:36:35.701560 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd53d11-4d4c-4626-9737-1e5efc459ceb None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:36:35.705059 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1390/2797] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:36:35 2022] POST /identity/v3/users => generated 286 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:36:35.706899 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94a6baa-0b21-4c37-8fd2-fb4c9e9d7c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:36:35.707616 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a6baa-0b21-4c37-8fd2-fb4c9e9d7c10 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:36:35.707893 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a6baa-0b21-4c37-8fd2-fb4c9e9d7c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:36:35.708168 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a6baa-0b21-4c37-8fd2-fb4c9e9d7c10 admin admin] PATH_INFO: `/v3/domains` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:36:35.708882 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94a6baa-0b21-4c37-8fd2-fb4c9e9d7c10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:36:35.709185 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94a6baa-0b21-4c37-8fd2-fb4c9e9d7c10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:36:35.710782 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94a6baa-0b21-4c37-8fd2-fb4c9e9d7c10 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:36:35.712333 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8300b55f-93a7-4fd2-be1b-ea0ff61ac241 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:36:35.722105 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8300b55f-93a7-4fd2-be1b-ea0ff61ac241 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:36:35.723595 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1408/2798] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 9 20:36:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 20:36:35.728010 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94a6baa-0b21-4c37-8fd2-fb4c9e9d7c10 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:36:35.728162 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa83f0-ab1b-4dc4-bee6-b8aadd283995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:36:35.728768 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa83f0-ab1b-4dc4-bee6-b8aadd283995 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:36:35.728991 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa83f0-ab1b-4dc4-bee6-b8aadd283995 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:36:35.729262 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa83f0-ab1b-4dc4-bee6-b8aadd283995 admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:36:35.730111 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fa83f0-ab1b-4dc4-bee6-b8aadd283995 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:36:35.731749 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fa83f0-ab1b-4dc4-bee6-b8aadd283995 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:36:35.737378 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94a6baa-0b21-4c37-8fd2-fb4c9e9d7c10 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:36:35.744979 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1391/2799] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:36:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:36:35.745149 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef1372-f237-40c5-863f-9ea40f3eebf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:36:35.745149 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef1372-f237-40c5-863f-9ea40f3eebf8 admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:36:35.745149 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef1372-f237-40c5-863f-9ea40f3eebf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:36:35.745149 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef1372-f237-40c5-863f-9ea40f3eebf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:36:35.745641 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bef1372-f237-40c5-863f-9ea40f3eebf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:36:35.745954 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa83f0-ab1b-4dc4-bee6-b8aadd283995 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:36:35.747056 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bef1372-f237-40c5-863f-9ea40f3eebf8 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:36:35.755197 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa83f0-ab1b-4dc4-bee6-b8aadd283995 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:36:35.760838 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60c8685-b100-47e1-a4cb-e250225b5c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:36:35.761472 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c8685-b100-47e1-a4cb-e250225b5c02 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:36:35.761749 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c8685-b100-47e1-a4cb-e250225b5c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:36:35.762023 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c8685-b100-47e1-a4cb-e250225b5c02 admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:36:35.762728 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60c8685-b100-47e1-a4cb-e250225b5c02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:36:35.764340 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60c8685-b100-47e1-a4cb-e250225b5c02 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:36:35.776896 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1409/2800] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:36:35 2022] POST /identity/v3/projects => generated 391 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 20:36:35.777109 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1392/2801] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:36:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 09 20:36:35.778272 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef1372-f237-40c5-863f-9ea40f3eebf8 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:36:35.779629 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60c8685-b100-47e1-a4cb-e250225b5c02 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:36:35.788940 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60c8685-b100-47e1-a4cb-e250225b5c02 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:36:35.837893 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef1372-f237-40c5-863f-9ea40f3eebf8 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:36:35.842494 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dd320b-5d0d-40a9-aa49-a62a80acb5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:36:35.843150 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd320b-5d0d-40a9-aa49-a62a80acb5e1 admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:36:35.843460 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd320b-5d0d-40a9-aa49-a62a80acb5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:36:35.843565 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1da806-3482-497a-9850-20b12a9aa862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:36:35.843740 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd320b-5d0d-40a9-aa49-a62a80acb5e1 admin admin] PATH_INFO: `/v3/users` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:36:35.844336 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1da806-3482-497a-9850-20b12a9aa862 admin admin] REQUEST_METHOD: `PUT` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:36:35.844447 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dd320b-5d0d-40a9-aa49-a62a80acb5e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:36:35.844615 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1da806-3482-497a-9850-20b12a9aa862 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:36:35.844884 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1da806-3482-497a-9850-20b12a9aa862 admin admin] PATH_INFO: `/v3/projects/5e23dd64fa8645c3a4ced56a7c9c62df/users/a408358ce1ea44a1ad62c41ebadd841d/roles/79f90a0bf6ea43d0b3c434e31556253a` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:36:35.846353 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dd320b-5d0d-40a9-aa49-a62a80acb5e1 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:36:35.860323 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1da806-3482-497a-9850-20b12a9aa862 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e23dd64fa8645c3a4ced56a7c9c62df, user_id=a408358ce1ea44a1ad62c41ebadd841d, role_id=79f90a0bf6ea43d0b3c434e31556253a)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:36:35.863958 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1da806-3482-497a-9850-20b12a9aa862 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:36:35.870654 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1410/2802] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:36:35 2022] POST /identity/v3/users => generated 296 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 20:36:35.871941 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dd320b-5d0d-40a9-aa49-a62a80acb5e1 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:36:35.877067 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1393/2803] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:36:35 2022] PUT /identity/v3/projects/5e23dd64fa8645c3a4ced56a7c9c62df/users/a408358ce1ea44a1ad62c41ebadd841d/roles/79f90a0bf6ea43d0b3c434e31556253a => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:36:35.881643 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dd320b-5d0d-40a9-aa49-a62a80acb5e1 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:36:35.881802 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85fa0de-3bee-4462-8ac3-fb844281679c None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:36:35.882075 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85fa0de-3bee-4462-8ac3-fb844281679c None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:36:35.882382 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85fa0de-3bee-4462-8ac3-fb844281679c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:36:35.900682 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-f85fa0de-3bee-4462-8ac3-fb844281679c None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:36:35.901891 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-f85fa0de-3bee-4462-8ac3-fb844281679c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:36:35.939346 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f713862f-4d4f-4861-955d-f42ca63fb1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:36:35.940085 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f713862f-4d4f-4861-955d-f42ca63fb1d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:36:35.940354 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f713862f-4d4f-4861-955d-f42ca63fb1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:36:35.940628 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f713862f-4d4f-4861-955d-f42ca63fb1d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:36:35.941357 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f713862f-4d4f-4861-955d-f42ca63fb1d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:36:35.942962 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f713862f-4d4f-4861-955d-f42ca63fb1d1 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:36:35.953833 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1411/2804] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:36:35 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:36:35.959691 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f713862f-4d4f-4861-955d-f42ca63fb1d1 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:36:35.963985 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1394/2805] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:36:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:36:35.971123 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f713862f-4d4f-4861-955d-f42ca63fb1d1 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:36:35.973379 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85fa0de-3bee-4462-8ac3-fb844281679c None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:36:35.974718 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-f85fa0de-3bee-4462-8ac3-fb844281679c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:36:35.977008 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25522f12-3643-4718-aed1-ecfe6beb5ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:36:35.977644 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25522f12-3643-4718-aed1-ecfe6beb5ae7 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:36:35.978051 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25522f12-3643-4718-aed1-ecfe6beb5ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:36:35.978460 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25522f12-3643-4718-aed1-ecfe6beb5ae7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:36:35.979282 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25522f12-3643-4718-aed1-ecfe6beb5ae7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:36:35.980920 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25522f12-3643-4718-aed1-ecfe6beb5ae7 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:36:35.994047 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1412/2806] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:36:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:36:35.995094 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25522f12-3643-4718-aed1-ecfe6beb5ae7 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:36:36.004367 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25522f12-3643-4718-aed1-ecfe6beb5ae7 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:36:36.009906 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b46953-9b43-4a54-a56e-0b450b5088e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:36:36.011043 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b46953-9b43-4a54-a56e-0b450b5088e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:36:36.011320 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b46953-9b43-4a54-a56e-0b450b5088e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:36:36.011633 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b46953-9b43-4a54-a56e-0b450b5088e5 admin admin] PATH_INFO: `/v3/projects/62a40a77959a4f3e86c6ebcf7fe08240/users/ed253d7ac978403baa36a76b49e651c1/roles/79f90a0bf6ea43d0b3c434e31556253a` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:36:36.026610 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b46953-9b43-4a54-a56e-0b450b5088e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62a40a77959a4f3e86c6ebcf7fe08240, user_id=ed253d7ac978403baa36a76b49e651c1, role_id=79f90a0bf6ea43d0b3c434e31556253a)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:36:36.029280 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b46953-9b43-4a54-a56e-0b450b5088e5 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:36:36.030146 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85fa0de-3bee-4462-8ac3-fb844281679c None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:36:36.033890 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdcde42-c642-4612-9843-46e477d5020c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:36:36.034705 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdcde42-c642-4612-9843-46e477d5020c service neutron] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:36:36.035123 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdcde42-c642-4612-9843-46e477d5020c service neutron] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:36:36.035552 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdcde42-c642-4612-9843-46e477d5020c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:36:36.043456 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1413/2807] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:36:35 2022] PUT /identity/v3/projects/62a40a77959a4f3e86c6ebcf7fe08240/users/ed253d7ac978403baa36a76b49e651c1/roles/79f90a0bf6ea43d0b3c434e31556253a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:36:36.051866 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdcde42-c642-4612-9843-46e477d5020c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:36:36.051866 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdcde42-c642-4612-9843-46e477d5020c service neutron] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:36:36.054268 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78d03d-9f3a-4fb4-a2c9-5e303c685a29 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:36:36.054552 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78d03d-9f3a-4fb4-a2c9-5e303c685a29 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:36:36.054824 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78d03d-9f3a-4fb4-a2c9-5e303c685a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:36:36.056288 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1395/2808] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:36:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 09 20:36:36.082932 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-4f78d03d-9f3a-4fb4-a2c9-5e303c685a29 None None] MFA Rules not processed for user `ed253d7ac978403baa36a76b49e651c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:36:36.084199 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-4f78d03d-9f3a-4fb4-a2c9-5e303c685a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:36:36.152296 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1414/2809] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:36:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:36:36.162531 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdcde42-c642-4612-9843-46e477d5020c service neutron] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:36:36.163960 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-efdcde42-c642-4612-9843-46e477d5020c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:36:36.223379 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdcde42-c642-4612-9843-46e477d5020c service neutron] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:36:36.277005 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67367a85-cb77-4ee6-b695-75d37256b7d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d65e731386d44948dcc1ecd40cbda65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:36:36.278247 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67367a85-cb77-4ee6-b695-75d37256b7d8 service cinder] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:36:36.278820 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67367a85-cb77-4ee6-b695-75d37256b7d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:36:36.279428 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67367a85-cb77-4ee6-b695-75d37256b7d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:36:36.294140 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67367a85-cb77-4ee6-b695-75d37256b7d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:36:36.296904 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67367a85-cb77-4ee6-b695-75d37256b7d8 service cinder] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:36:36.313455 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1396/2810] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:36:36 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:36:40.170675 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fcfcc6-d78c-42f1-a2ac-f6cc105a1ffb None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:36:40.171095 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fcfcc6-d78c-42f1-a2ac-f6cc105a1ffb None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:36:40.171308 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fcfcc6-d78c-42f1-a2ac-f6cc105a1ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:36:40.203143 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-51fcfcc6-d78c-42f1-a2ac-f6cc105a1ffb None None] MFA Rules not processed for user `a408358ce1ea44a1ad62c41ebadd841d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:36:40.204570 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-51fcfcc6-d78c-42f1-a2ac-f6cc105a1ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:36:40.279273 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1415/2811] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:36:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:36:40.283787 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67367a85-cb77-4ee6-b695-75d37256b7d8 service cinder] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:36:40.368813 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67367a85-cb77-4ee6-b695-75d37256b7d8 service cinder] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:36:40.378068 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a51716-7b5c-45ac-add9-b1c12c90c76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:36:40.378753 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a51716-7b5c-45ac-add9-b1c12c90c76a admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:36:40.379029 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a51716-7b5c-45ac-add9-b1c12c90c76a admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:36:40.379296 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a51716-7b5c-45ac-add9-b1c12c90c76a admin admin] PATH_INFO: `/v3/projects` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:36:40.380032 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a51716-7b5c-45ac-add9-b1c12c90c76a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:36:40.381956 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a51716-7b5c-45ac-add9-b1c12c90c76a admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:36:40.414059 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1397/2812] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:36:40 2022] POST /identity/v3/projects => generated 373 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:36:40.416167 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fcfcc6-d78c-42f1-a2ac-f6cc105a1ffb None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:36:40.427221 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fcfcc6-d78c-42f1-a2ac-f6cc105a1ffb None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:36:40.494829 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a02135d-a492-4e6e-a207-e9bee3dff482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:36:40.495620 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a02135d-a492-4e6e-a207-e9bee3dff482 admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:36:40.495917 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a02135d-a492-4e6e-a207-e9bee3dff482 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:36:40.496300 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a02135d-a492-4e6e-a207-e9bee3dff482 admin admin] PATH_INFO: `/v3/users` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:36:40.497084 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a02135d-a492-4e6e-a207-e9bee3dff482 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:36:40.499046 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a02135d-a492-4e6e-a207-e9bee3dff482 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:36:40.522048 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1416/2813] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:36:40 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:36:40.523293 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a51716-7b5c-45ac-add9-b1c12c90c76a admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:36:40.533571 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a51716-7b5c-45ac-add9-b1c12c90c76a admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:36:40.538184 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab575994-ee10-4fd9-a1e8-83378c674b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:36:40.538840 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab575994-ee10-4fd9-a1e8-83378c674b37 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:36:40.539114 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab575994-ee10-4fd9-a1e8-83378c674b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:36:40.540051 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab575994-ee10-4fd9-a1e8-83378c674b37 admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:36:40.540772 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab575994-ee10-4fd9-a1e8-83378c674b37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:36:40.542365 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab575994-ee10-4fd9-a1e8-83378c674b37 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:36:40.558467 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1398/2814] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:36:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:36:40.559585 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a02135d-a492-4e6e-a207-e9bee3dff482 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:36:40.570854 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a02135d-a492-4e6e-a207-e9bee3dff482 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:36:40.575690 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7130d486-fda7-430d-9c54-5ca3a1ebeffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:36:40.576965 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130d486-fda7-430d-9c54-5ca3a1ebeffa admin admin] REQUEST_METHOD: `PUT` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:36:40.577251 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130d486-fda7-430d-9c54-5ca3a1ebeffa admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:36:40.577696 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130d486-fda7-430d-9c54-5ca3a1ebeffa admin admin] PATH_INFO: `/v3/projects/badcb1610440490eab569e8d918ff5d0/users/f6b89d91230b446da9002ece6dd38337/roles/274130b78e304bb88789c1b349263f3c` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:36:40.594579 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7130d486-fda7-430d-9c54-5ca3a1ebeffa admin admin] RBAC: Authorizing `identity:create_grant(project_id=badcb1610440490eab569e8d918ff5d0, user_id=f6b89d91230b446da9002ece6dd38337, role_id=274130b78e304bb88789c1b349263f3c)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:36:40.597300 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7130d486-fda7-430d-9c54-5ca3a1ebeffa admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:36:40.611471 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1417/2815] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:36:40 2022] PUT /identity/v3/projects/badcb1610440490eab569e8d918ff5d0/users/f6b89d91230b446da9002ece6dd38337/roles/274130b78e304bb88789c1b349263f3c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:36:40.615490 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab575994-ee10-4fd9-a1e8-83378c674b37 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:36:40.625985 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab575994-ee10-4fd9-a1e8-83378c674b37 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:36:40.686123 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9588e955-be31-4a80-8934-d585a976e2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:36:40.686817 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588e955-be31-4a80-8934-d585a976e2e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:36:40.687095 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588e955-be31-4a80-8934-d585a976e2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:36:40.687364 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588e955-be31-4a80-8934-d585a976e2e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:36:40.688115 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9588e955-be31-4a80-8934-d585a976e2e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:36:40.689751 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9588e955-be31-4a80-8934-d585a976e2e6 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:36:40.700424 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1399/2816] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:36:40 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 09 20:36:40.704502 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7130d486-fda7-430d-9c54-5ca3a1ebeffa admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:36:40.715806 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7130d486-fda7-430d-9c54-5ca3a1ebeffa admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:36:40.731554 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093d05eb-0618-46f3-be94-b5f48adcc107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:36:40.732630 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d05eb-0618-46f3-be94-b5f48adcc107 admin admin] REQUEST_METHOD: `PUT` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:36:40.732914 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d05eb-0618-46f3-be94-b5f48adcc107 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:36:40.733183 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d05eb-0618-46f3-be94-b5f48adcc107 admin admin] PATH_INFO: `/v3/projects/badcb1610440490eab569e8d918ff5d0/users/f6b89d91230b446da9002ece6dd38337/roles/274130b78e304bb88789c1b349263f3c` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:36:40.735174 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093d05eb-0618-46f3-be94-b5f48adcc107 admin admin] RBAC: Authorizing `identity:create_grant(project_id=badcb1610440490eab569e8d918ff5d0, user_id=f6b89d91230b446da9002ece6dd38337, role_id=274130b78e304bb88789c1b349263f3c)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:36:40.737838 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093d05eb-0618-46f3-be94-b5f48adcc107 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:36:40.755465 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1418/2817] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:36:40 2022] PUT /identity/v3/projects/badcb1610440490eab569e8d918ff5d0/users/f6b89d91230b446da9002ece6dd38337/roles/274130b78e304bb88789c1b349263f3c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:36:45.584171 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f41e5-8f66-4994-9611-b1d6c350c204 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:36:45.584624 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f41e5-8f66-4994-9611-b1d6c350c204 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:36:45.584909 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f41e5-8f66-4994-9611-b1d6c350c204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:36:45.614634 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-b21f41e5-8f66-4994-9611-b1d6c350c204 None None] MFA Rules not processed for user `f6b89d91230b446da9002ece6dd38337`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:36:45.615941 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-b21f41e5-8f66-4994-9611-b1d6c350c204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:36:45.689519 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1400/2818] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:36:45 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:36:45.703202 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093d05eb-0618-46f3-be94-b5f48adcc107 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:36:45.705071 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-093d05eb-0618-46f3-be94-b5f48adcc107 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:36:45.788077 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093d05eb-0618-46f3-be94-b5f48adcc107 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:36:45.793729 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ebf8ca-b96e-41cc-8d54-db3a8f1a0850 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb59440b21074d9da15679dc2d745f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:36:45.794392 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ebf8ca-b96e-41cc-8d54-db3a8f1a0850 service nova] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:36:45.794665 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ebf8ca-b96e-41cc-8d54-db3a8f1a0850 service nova] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:36:45.794939 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ebf8ca-b96e-41cc-8d54-db3a8f1a0850 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:36:45.855561 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ebf8ca-b96e-41cc-8d54-db3a8f1a0850 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:36:45.858071 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ebf8ca-b96e-41cc-8d54-db3a8f1a0850 service nova] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:36:45.868679 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1419/2819] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:36:45 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:36:46.939004 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2709e-70d0-4023-9a2a-655cca4d700c None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:36:46.939549 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2709e-70d0-4023-9a2a-655cca4d700c None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:36:46.939783 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2709e-70d0-4023-9a2a-655cca4d700c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:36:46.958557 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-0ff2709e-70d0-4023-9a2a-655cca4d700c None None] MFA Rules not processed for user `a408358ce1ea44a1ad62c41ebadd841d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:36:46.959810 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-0ff2709e-70d0-4023-9a2a-655cca4d700c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:36:46.968780 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1401/2820] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:36:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:36:58.984212 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ebf8ca-b96e-41cc-8d54-db3a8f1a0850 service nova] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:36:59.053556 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ebf8ca-b96e-41cc-8d54-db3a8f1a0850 service nova] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:36:59.058363 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1599ac81-3874-4b78-b756-0611397e85b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:36:59.059221 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1599ac81-3874-4b78-b756-0611397e85b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:36:59.059544 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1599ac81-3874-4b78-b756-0611397e85b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:36:59.059823 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1599ac81-3874-4b78-b756-0611397e85b2 admin admin] PATH_INFO: `/v3/users/ed253d7ac978403baa36a76b49e651c1` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:36:59.061006 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1599ac81-3874-4b78-b756-0611397e85b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed253d7ac978403baa36a76b49e651c1)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:36:59.062959 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1599ac81-3874-4b78-b756-0611397e85b2 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:36:59.110102 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-1599ac81-3874-4b78-b756-0611397e85b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed253d7ac978403baa36a76b49e651c1'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:36:59.110759 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-1599ac81-3874-4b78-b756-0611397e85b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed253d7ac978403baa36a76b49e651c1'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:36:59.117683 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-1599ac81-3874-4b78-b756-0611397e85b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed253d7ac978403baa36a76b49e651c1'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:36:59.118337 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-1599ac81-3874-4b78-b756-0611397e85b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed253d7ac978403baa36a76b49e651c1'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:36:59.125527 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-1599ac81-3874-4b78-b756-0611397e85b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed253d7ac978403baa36a76b49e651c1'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:36:59.142851 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1420/2821] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:36:58 2022] DELETE /identity/v3/users/ed253d7ac978403baa36a76b49e651c1 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:36:59.147296 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad31a2-82ab-427e-a8d8-b31f0f90ab8d None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:36:59.147843 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad31a2-82ab-427e-a8d8-b31f0f90ab8d None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:36:59.147843 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad31a2-82ab-427e-a8d8-b31f0f90ab8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:36:59.165349 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-78ad31a2-82ab-427e-a8d8-b31f0f90ab8d None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:36:59.166475 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-78ad31a2-82ab-427e-a8d8-b31f0f90ab8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:36:59.224715 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1402/2822] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:36:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:36:59.234517 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1599ac81-3874-4b78-b756-0611397e85b2 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:36:59.235926 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-1599ac81-3874-4b78-b756-0611397e85b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:36:59.293821 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1599ac81-3874-4b78-b756-0611397e85b2 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:36:59.297500 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f713baa-5b64-41d1-90a5-c12111dcfbde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:36:59.298138 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f713baa-5b64-41d1-90a5-c12111dcfbde service neutron] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:36:59.298419 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f713baa-5b64-41d1-90a5-c12111dcfbde service neutron] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:36:59.298688 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f713baa-5b64-41d1-90a5-c12111dcfbde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:36:59.308095 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f713baa-5b64-41d1-90a5-c12111dcfbde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:36:59.309549 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f713baa-5b64-41d1-90a5-c12111dcfbde service neutron] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:36:59.318776 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1421/2823] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:36:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:36:59.580097 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ad31a2-82ab-427e-a8d8-b31f0f90ab8d None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:36:59.581537 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-78ad31a2-82ab-427e-a8d8-b31f0f90ab8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:36:59.594541 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ad31a2-82ab-427e-a8d8-b31f0f90ab8d None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:36:59.599525 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ad808-536c-42ac-8330-9040e6f4dfae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:36:59.600639 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ad808-536c-42ac-8330-9040e6f4dfae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:36:59.600775 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ad808-536c-42ac-8330-9040e6f4dfae admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:36:59.601044 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ad808-536c-42ac-8330-9040e6f4dfae admin admin] PATH_INFO: `/v3/projects/62a40a77959a4f3e86c6ebcf7fe08240` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:36:59.602404 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7ad808-536c-42ac-8330-9040e6f4dfae admin admin] RBAC: Authorizing `identity:delete_project(project_id=62a40a77959a4f3e86c6ebcf7fe08240)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:36:59.605417 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7ad808-536c-42ac-8330-9040e6f4dfae admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:36:59.653175 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-dc7ad808-536c-42ac-8330-9040e6f4dfae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62a40a77959a4f3e86c6ebcf7fe08240', 'request_id': 'req-dc7ad808-536c-42ac-8330-9040e6f4dfae'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:36:59.659056 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-dc7ad808-536c-42ac-8330-9040e6f4dfae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62a40a77959a4f3e86c6ebcf7fe08240', 'request_id': 'req-dc7ad808-536c-42ac-8330-9040e6f4dfae'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:36:59.664320 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-dc7ad808-536c-42ac-8330-9040e6f4dfae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62a40a77959a4f3e86c6ebcf7fe08240', 'request_id': 'req-dc7ad808-536c-42ac-8330-9040e6f4dfae'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:36:59.676793 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-dc7ad808-536c-42ac-8330-9040e6f4dfae admin admin] The token cache is being invalidate because project 62a40a77959a4f3e86c6ebcf7fe08240 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:36:59.677071 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-dc7ad808-536c-42ac-8330-9040e6f4dfae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:36:59.677678 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-dc7ad808-536c-42ac-8330-9040e6f4dfae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:36:59.679186 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1403/2824] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:36:59 2022] DELETE /identity/v3/projects/62a40a77959a4f3e86c6ebcf7fe08240 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:36:59.684994 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd3340-47a0-4e0b-9545-1b2690bdeb08 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:36:59.685283 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd3340-47a0-4e0b-9545-1b2690bdeb08 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:36:59.685553 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd3340-47a0-4e0b-9545-1b2690bdeb08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:36:59.702535 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-f3cd3340-47a0-4e0b-9545-1b2690bdeb08 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:36:59.703688 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-f3cd3340-47a0-4e0b-9545-1b2690bdeb08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:36:59.762160 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1422/2825] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:36:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 20:36:59.769762 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1a62dd-2426-4f6b-869d-39438ceda8f5 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:36:59.770117 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1a62dd-2426-4f6b-869d-39438ceda8f5 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:36:59.770459 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1a62dd-2426-4f6b-869d-39438ceda8f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:36:59.788646 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-3e1a62dd-2426-4f6b-869d-39438ceda8f5 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:36:59.789823 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-3e1a62dd-2426-4f6b-869d-39438ceda8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:36:59.798420 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1404/2826] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:36:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:36:59.802769 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cd3340-47a0-4e0b-9545-1b2690bdeb08 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:36:59.813277 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cd3340-47a0-4e0b-9545-1b2690bdeb08 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:36:59.817883 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d963a841-bdce-409f-8953-65e2d6de2d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:36:59.818526 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d963a841-bdce-409f-8953-65e2d6de2d5e admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:36:59.818809 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d963a841-bdce-409f-8953-65e2d6de2d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:36:59.819086 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d963a841-bdce-409f-8953-65e2d6de2d5e admin admin] PATH_INFO: `/v3/domains` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:36:59.819848 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d963a841-bdce-409f-8953-65e2d6de2d5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:36:59.820156 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d963a841-bdce-409f-8953-65e2d6de2d5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:36:59.822657 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d963a841-bdce-409f-8953-65e2d6de2d5e admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:36:59.833706 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1423/2827] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 9 20:36:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:36:59.837951 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1a62dd-2426-4f6b-869d-39438ceda8f5 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:36:59.846921 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1a62dd-2426-4f6b-869d-39438ceda8f5 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:36:59.851507 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eefc6c-0d61-4086-9cfd-0da8cd8620ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:36:59.852131 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eefc6c-0d61-4086-9cfd-0da8cd8620ca admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:36:59.852964 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eefc6c-0d61-4086-9cfd-0da8cd8620ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:36:59.853253 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eefc6c-0d61-4086-9cfd-0da8cd8620ca admin admin] PATH_INFO: `/v3/projects` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:36:59.854044 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eefc6c-0d61-4086-9cfd-0da8cd8620ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:36:59.855961 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eefc6c-0d61-4086-9cfd-0da8cd8620ca admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:36:59.880893 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1405/2828] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:36:59 2022] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:36:59.884854 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d963a841-bdce-409f-8953-65e2d6de2d5e admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:36:59.894673 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d963a841-bdce-409f-8953-65e2d6de2d5e admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:36:59.949780 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd16ad1-5d77-407a-acd3-f3a5cbdbb63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:36:59.950478 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd16ad1-5d77-407a-acd3-f3a5cbdbb63e admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:36:59.950704 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd16ad1-5d77-407a-acd3-f3a5cbdbb63e admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:36:59.950977 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd16ad1-5d77-407a-acd3-f3a5cbdbb63e admin admin] PATH_INFO: `/v3/users` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:36:59.951698 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd16ad1-5d77-407a-acd3-f3a5cbdbb63e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:36:59.954014 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd16ad1-5d77-407a-acd3-f3a5cbdbb63e admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:36:59.976520 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1424/2829] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:36:59 2022] POST /identity/v3/users => generated 293 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:36:59.978226 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eefc6c-0d61-4086-9cfd-0da8cd8620ca admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:36:59.988398 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eefc6c-0d61-4086-9cfd-0da8cd8620ca admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:36:59.993051 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769a610a-2b5e-4ec5-9621-a90560134c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:36:59.994319 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a610a-2b5e-4ec5-9621-a90560134c5f admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:36:59.994658 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a610a-2b5e-4ec5-9621-a90560134c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:36:59.995017 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a610a-2b5e-4ec5-9621-a90560134c5f admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:36:59.995833 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769a610a-2b5e-4ec5-9621-a90560134c5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:36:59.997473 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769a610a-2b5e-4ec5-9621-a90560134c5f admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:37:00.007876 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1406/2830] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:36:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:37:00.012120 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd16ad1-5d77-407a-acd3-f3a5cbdbb63e admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:37:00.021869 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd16ad1-5d77-407a-acd3-f3a5cbdbb63e admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:37:00.027159 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4409c4-e490-4146-a315-64fdbd899295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:37:00.028216 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4409c4-e490-4146-a315-64fdbd899295 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:37:00.028702 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4409c4-e490-4146-a315-64fdbd899295 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:37:00.029156 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4409c4-e490-4146-a315-64fdbd899295 admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:37:00.029969 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4409c4-e490-4146-a315-64fdbd899295 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:37:00.031747 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4409c4-e490-4146-a315-64fdbd899295 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:37:00.042081 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1425/2831] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:37:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:37:00.046165 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769a610a-2b5e-4ec5-9621-a90560134c5f admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:37:00.057438 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769a610a-2b5e-4ec5-9621-a90560134c5f admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:37:00.062094 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48786e1-e57d-4d39-879f-0a220be93204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:37:00.062984 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48786e1-e57d-4d39-879f-0a220be93204 admin admin] REQUEST_METHOD: `PUT` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:37:00.063261 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48786e1-e57d-4d39-879f-0a220be93204 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:37:00.063564 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48786e1-e57d-4d39-879f-0a220be93204 admin admin] PATH_INFO: `/v3/projects/36dd3d47f0c54036a5821e6815744e22/users/0022312a6d124579a4d627acbc27bc01/roles/79f90a0bf6ea43d0b3c434e31556253a` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:37:00.078309 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48786e1-e57d-4d39-879f-0a220be93204 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36dd3d47f0c54036a5821e6815744e22, user_id=0022312a6d124579a4d627acbc27bc01, role_id=79f90a0bf6ea43d0b3c434e31556253a)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:37:00.080973 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48786e1-e57d-4d39-879f-0a220be93204 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:37:00.093466 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1407/2832] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:37:00 2022] PUT /identity/v3/projects/36dd3d47f0c54036a5821e6815744e22/users/0022312a6d124579a4d627acbc27bc01/roles/79f90a0bf6ea43d0b3c434e31556253a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:37:00.098707 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e362a0f2-718c-4fe5-9938-8623aacce12f None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:37:00.098991 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e362a0f2-718c-4fe5-9938-8623aacce12f None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:37:00.099260 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e362a0f2-718c-4fe5-9938-8623aacce12f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:37:00.116870 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-e362a0f2-718c-4fe5-9938-8623aacce12f None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:37:00.118136 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-e362a0f2-718c-4fe5-9938-8623aacce12f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:37:00.175603 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1426/2833] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:37:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:37:00.185920 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48786e1-e57d-4d39-879f-0a220be93204 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:37:00.187668 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-b48786e1-e57d-4d39-879f-0a220be93204 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:37:00.242204 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48786e1-e57d-4d39-879f-0a220be93204 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:37:00.245878 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1c94f6-2bb3-4a7f-82fe-b5cfc027388a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:37:00.246507 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c94f6-2bb3-4a7f-82fe-b5cfc027388a service neutron] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:37:00.246784 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c94f6-2bb3-4a7f-82fe-b5cfc027388a service neutron] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:37:00.247052 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c94f6-2bb3-4a7f-82fe-b5cfc027388a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:37:00.255667 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1c94f6-2bb3-4a7f-82fe-b5cfc027388a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:37:00.257094 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1c94f6-2bb3-4a7f-82fe-b5cfc027388a service neutron] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:37:00.266483 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1408/2834] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:37:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:37:03.999774 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3addd5b-a191-4ea2-b3ef-280bbe82e106 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:37:04.000307 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3addd5b-a191-4ea2-b3ef-280bbe82e106 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:37:04.000425 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3addd5b-a191-4ea2-b3ef-280bbe82e106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:37:04.026766 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-f3addd5b-a191-4ea2-b3ef-280bbe82e106 None None] MFA Rules not processed for user `0022312a6d124579a4d627acbc27bc01`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:37:04.027901 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-f3addd5b-a191-4ea2-b3ef-280bbe82e106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:37:04.092834 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1427/2835] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:37:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:37:04.097284 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1c94f6-2bb3-4a7f-82fe-b5cfc027388a service neutron] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:37:04.108191 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1c94f6-2bb3-4a7f-82fe-b5cfc027388a service neutron] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:37:04.112887 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6fc5ff-7138-4c08-b01e-12238e0c5ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:37:04.113530 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6fc5ff-7138-4c08-b01e-12238e0c5ef5 admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:37:04.113803 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6fc5ff-7138-4c08-b01e-12238e0c5ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:37:04.114067 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6fc5ff-7138-4c08-b01e-12238e0c5ef5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:37:04.114748 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6fc5ff-7138-4c08-b01e-12238e0c5ef5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:37:04.116676 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6fc5ff-7138-4c08-b01e-12238e0c5ef5 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:37:04.151548 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1409/2836] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:37:04 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:37:04.152646 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3addd5b-a191-4ea2-b3ef-280bbe82e106 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:37:04.163708 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3addd5b-a191-4ea2-b3ef-280bbe82e106 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:37:04.224785 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c3d9a1-de87-4539-90dc-41fd5774852a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:37:04.225453 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c3d9a1-de87-4539-90dc-41fd5774852a admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:37:04.227732 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c3d9a1-de87-4539-90dc-41fd5774852a admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:37:04.228251 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c3d9a1-de87-4539-90dc-41fd5774852a admin admin] PATH_INFO: `/v3/users` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:37:04.228757 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c3d9a1-de87-4539-90dc-41fd5774852a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:37:04.230692 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c3d9a1-de87-4539-90dc-41fd5774852a admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:37:04.254560 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1428/2837] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:37:04 2022] POST /identity/v3/users => generated 298 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 20:37:04.261442 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6fc5ff-7138-4c08-b01e-12238e0c5ef5 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:37:04.269789 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6fc5ff-7138-4c08-b01e-12238e0c5ef5 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:37:04.274765 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d54b7b5-46a1-420a-9335-f9511aeb1e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:37:04.275466 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d54b7b5-46a1-420a-9335-f9511aeb1e80 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:37:04.275751 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d54b7b5-46a1-420a-9335-f9511aeb1e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:37:04.276023 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d54b7b5-46a1-420a-9335-f9511aeb1e80 admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:37:04.276750 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d54b7b5-46a1-420a-9335-f9511aeb1e80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:37:04.278440 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d54b7b5-46a1-420a-9335-f9511aeb1e80 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:37:04.290530 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1410/2838] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 09 20:37:04.295147 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c3d9a1-de87-4539-90dc-41fd5774852a admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:37:04.306030 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c3d9a1-de87-4539-90dc-41fd5774852a admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:37:04.311095 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88af1403-eba9-4e65-94ac-b475f67b4c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:37:04.317916 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af1403-eba9-4e65-94ac-b475f67b4c94 admin admin] REQUEST_METHOD: `PUT` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:37:04.317916 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af1403-eba9-4e65-94ac-b475f67b4c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:37:04.317916 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af1403-eba9-4e65-94ac-b475f67b4c94 admin admin] PATH_INFO: `/v3/projects/2d7e18dee2644530bb546a658647d04b/users/c7fa957498714cdd960372ffa7168ed2/roles/274130b78e304bb88789c1b349263f3c` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:37:04.349971 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88af1403-eba9-4e65-94ac-b475f67b4c94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d7e18dee2644530bb546a658647d04b, user_id=c7fa957498714cdd960372ffa7168ed2, role_id=274130b78e304bb88789c1b349263f3c)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:37:04.353341 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88af1403-eba9-4e65-94ac-b475f67b4c94 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:37:04.366605 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1429/2839] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:37:04 2022] PUT /identity/v3/projects/2d7e18dee2644530bb546a658647d04b/users/c7fa957498714cdd960372ffa7168ed2/roles/274130b78e304bb88789c1b349263f3c => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:37:04.371023 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d54b7b5-46a1-420a-9335-f9511aeb1e80 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:37:04.384601 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d54b7b5-46a1-420a-9335-f9511aeb1e80 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:37:04.453636 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdec14c5-8548-4630-9a99-d7bae7c7b501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:37:04.454330 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec14c5-8548-4630-9a99-d7bae7c7b501 admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:37:04.454617 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec14c5-8548-4630-9a99-d7bae7c7b501 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:37:04.454889 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec14c5-8548-4630-9a99-d7bae7c7b501 admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:37:04.455673 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdec14c5-8548-4630-9a99-d7bae7c7b501 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:37:04.457498 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdec14c5-8548-4630-9a99-d7bae7c7b501 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:37:04.471512 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1411/2840] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:37:04.473333 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88af1403-eba9-4e65-94ac-b475f67b4c94 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:37:04.484752 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88af1403-eba9-4e65-94ac-b475f67b4c94 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:37:04.489666 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c137e3d-03a2-427c-8f7c-4eb552cffc29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:37:04.490625 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c137e3d-03a2-427c-8f7c-4eb552cffc29 admin admin] REQUEST_METHOD: `PUT` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:37:04.490908 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c137e3d-03a2-427c-8f7c-4eb552cffc29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:37:04.491184 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c137e3d-03a2-427c-8f7c-4eb552cffc29 admin admin] PATH_INFO: `/v3/projects/2d7e18dee2644530bb546a658647d04b/users/c7fa957498714cdd960372ffa7168ed2/roles/274130b78e304bb88789c1b349263f3c` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:37:04.493993 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c137e3d-03a2-427c-8f7c-4eb552cffc29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d7e18dee2644530bb546a658647d04b, user_id=c7fa957498714cdd960372ffa7168ed2, role_id=274130b78e304bb88789c1b349263f3c)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:37:04.496749 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c137e3d-03a2-427c-8f7c-4eb552cffc29 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:37:04.507654 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1430/2841] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:37:04 2022] PUT /identity/v3/projects/2d7e18dee2644530bb546a658647d04b/users/c7fa957498714cdd960372ffa7168ed2/roles/274130b78e304bb88789c1b349263f3c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:37:09.038202 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8cdda-3304-463b-8be5-1f9d585f536e None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:37:09.039119 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8cdda-3304-463b-8be5-1f9d585f536e None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:37:09.040296 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8cdda-3304-463b-8be5-1f9d585f536e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:37:09.087066 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-17a8cdda-3304-463b-8be5-1f9d585f536e None None] MFA Rules not processed for user `c7fa957498714cdd960372ffa7168ed2`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:37:09.089366 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-17a8cdda-3304-463b-8be5-1f9d585f536e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:37:09.193931 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1412/2842] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:37:09 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:37:09.206243 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c137e3d-03a2-427c-8f7c-4eb552cffc29 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:37:09.207951 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-3c137e3d-03a2-427c-8f7c-4eb552cffc29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:37:09.293427 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c137e3d-03a2-427c-8f7c-4eb552cffc29 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:37:09.297398 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30b1c39-6b9e-42db-b63c-cda1adbe58b4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65db5d9a86fd48acb5874df0165c0ef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:37:09.298049 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b1c39-6b9e-42db-b63c-cda1adbe58b4 service glance] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:37:09.298328 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b1c39-6b9e-42db-b63c-cda1adbe58b4 service glance] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:37:09.298599 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b1c39-6b9e-42db-b63c-cda1adbe58b4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:37:09.356332 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30b1c39-6b9e-42db-b63c-cda1adbe58b4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:37:09.357766 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30b1c39-6b9e-42db-b63c-cda1adbe58b4 service glance] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:37:09.366906 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1431/2843] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:37:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:37:09.468545 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d729f869-6b6b-40a8-93ef-0805065234f8 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:37:09.469067 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d729f869-6b6b-40a8-93ef-0805065234f8 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:37:09.469341 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d729f869-6b6b-40a8-93ef-0805065234f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:37:09.488105 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-d729f869-6b6b-40a8-93ef-0805065234f8 None None] MFA Rules not processed for user `0227b2954e61426388214e96e1741eb2`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:37:09.489311 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-d729f869-6b6b-40a8-93ef-0805065234f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:37:09.555181 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1413/2844] 10.222.0.44 () {58 vars in 1009 bytes} [Mon May 9 20:37:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:37:09.570889 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30b1c39-6b9e-42db-b63c-cda1adbe58b4 service glance] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:37:09.573950 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-a30b1c39-6b9e-42db-b63c-cda1adbe58b4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:37:09.689294 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30b1c39-6b9e-42db-b63c-cda1adbe58b4 service glance] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:37:09.696790 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4fc4c1-7f21-49a7-90d0-2d237a8fc5d9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965089f1a92f49bd883b337d6042c69f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:37:09.697455 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4fc4c1-7f21-49a7-90d0-2d237a8fc5d9 service swift] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:37:09.697738 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4fc4c1-7f21-49a7-90d0-2d237a8fc5d9 service swift] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:37:09.698011 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4fc4c1-7f21-49a7-90d0-2d237a8fc5d9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:37:09.706476 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4fc4c1-7f21-49a7-90d0-2d237a8fc5d9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:37:09.708129 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4fc4c1-7f21-49a7-90d0-2d237a8fc5d9 service swift] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:37:09.728215 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1432/2845] 10.222.0.44 () {60 vars in 1384 bytes} [Mon May 9 20:37:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 09 20:37:09.921917 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d729f869-6b6b-40a8-93ef-0805065234f8 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:37:09.997555 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d729f869-6b6b-40a8-93ef-0805065234f8 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:37:10.001841 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeb32c3-34c5-4052-8837-440d15beb5f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:37:10.002785 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb32c3-34c5-4052-8837-440d15beb5f6 service neutron] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:37:10.003693 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb32c3-34c5-4052-8837-440d15beb5f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:37:10.004926 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb32c3-34c5-4052-8837-440d15beb5f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:37:10.006844 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-abeb32c3-34c5-4052-8837-440d15beb5f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:37:10.034155 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeb32c3-34c5-4052-8837-440d15beb5f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:37:10.036013 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeb32c3-34c5-4052-8837-440d15beb5f6 service neutron] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:37:10.049414 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1414/2846] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:37:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:37:19.658535 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8fd0d0-6e65-476b-888e-f33181318a30 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:37:19.659040 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8fd0d0-6e65-476b-888e-f33181318a30 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:37:19.659199 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8fd0d0-6e65-476b-888e-f33181318a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:37:19.675599 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-7f8fd0d0-6e65-476b-888e-f33181318a30 None None] MFA Rules not processed for user `0022312a6d124579a4d627acbc27bc01`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:37:19.676812 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-7f8fd0d0-6e65-476b-888e-f33181318a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:37:19.684012 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1433/2847] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:37:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 26 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:37:20.176198 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeb32c3-34c5-4052-8837-440d15beb5f6 service neutron] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:37:20.177582 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-abeb32c3-34c5-4052-8837-440d15beb5f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:37:20.188520 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeb32c3-34c5-4052-8837-440d15beb5f6 service neutron] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:37:20.192074 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d36c67a-ec05-4c47-9b52-7c7ead295ee6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:37:20.192692 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d36c67a-ec05-4c47-9b52-7c7ead295ee6 service neutron] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:37:20.192965 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d36c67a-ec05-4c47-9b52-7c7ead295ee6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:37:20.193228 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d36c67a-ec05-4c47-9b52-7c7ead295ee6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:37:20.194879 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-6d36c67a-ec05-4c47-9b52-7c7ead295ee6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:37:20.204273 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d36c67a-ec05-4c47-9b52-7c7ead295ee6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:37:20.205678 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d36c67a-ec05-4c47-9b52-7c7ead295ee6 service neutron] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:37:20.213532 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1415/2848] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:37:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:37:22.539035 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d45cd5-9cc7-401b-b6d4-3db09c32cebd None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:37:22.539917 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d45cd5-9cc7-401b-b6d4-3db09c32cebd None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:37:22.540377 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d45cd5-9cc7-401b-b6d4-3db09c32cebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:37:22.559301 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-e9d45cd5-9cc7-401b-b6d4-3db09c32cebd None None] MFA Rules not processed for user `0227b2954e61426388214e96e1741eb2`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:37:22.560535 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-e9d45cd5-9cc7-401b-b6d4-3db09c32cebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:37:22.568043 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1434/2849] 10.222.0.44 () {58 vars in 1009 bytes} [Mon May 9 20:37:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:37:22.581386 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d36c67a-ec05-4c47-9b52-7c7ead295ee6 service neutron] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:37:22.593979 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d36c67a-ec05-4c47-9b52-7c7ead295ee6 service neutron] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:37:22.599561 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b4678-e812-4fdb-ab11-997d5a879586 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965089f1a92f49bd883b337d6042c69f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:37:22.599561 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b4678-e812-4fdb-ab11-997d5a879586 service swift] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:37:22.600105 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b4678-e812-4fdb-ab11-997d5a879586 service swift] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:37:22.600437 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b4678-e812-4fdb-ab11-997d5a879586 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:37:22.608463 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1b4678-e812-4fdb-ab11-997d5a879586 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:37:22.610135 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1b4678-e812-4fdb-ab11-997d5a879586 service swift] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:37:22.618784 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1416/2850] 10.222.0.44 () {60 vars in 1384 bytes} [Mon May 9 20:37:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 09 20:37:35.219264 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d45cd5-9cc7-401b-b6d4-3db09c32cebd None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:37:35.231214 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d45cd5-9cc7-401b-b6d4-3db09c32cebd None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:37:35.235595 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dada4cfb-7307-47b0-948e-5b5199ae177b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:37:35.236232 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dada4cfb-7307-47b0-948e-5b5199ae177b service neutron] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:37:35.236513 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dada4cfb-7307-47b0-948e-5b5199ae177b service neutron] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:37:35.236786 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dada4cfb-7307-47b0-948e-5b5199ae177b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:37:35.238571 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-dada4cfb-7307-47b0-948e-5b5199ae177b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:37:35.299044 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dada4cfb-7307-47b0-948e-5b5199ae177b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:37:35.300428 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dada4cfb-7307-47b0-948e-5b5199ae177b service neutron] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:37:35.309912 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1435/2851] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:37:35 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:37:37.011069 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b4678-e812-4fdb-ab11-997d5a879586 service swift] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:37:37.012596 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-dd1b4678-e812-4fdb-ab11-997d5a879586 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:37:37.089214 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b4678-e812-4fdb-ab11-997d5a879586 service swift] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:37:37.094556 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d39638-dffe-4557-ae80-cdc071a6c4e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb59440b21074d9da15679dc2d745f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:37:37.095190 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d39638-dffe-4557-ae80-cdc071a6c4e4 service nova] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:37:37.095689 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d39638-dffe-4557-ae80-cdc071a6c4e4 service nova] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:37:37.095962 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d39638-dffe-4557-ae80-cdc071a6c4e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:37:37.097716 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-64d39638-dffe-4557-ae80-cdc071a6c4e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:37:37.110568 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d39638-dffe-4557-ae80-cdc071a6c4e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:37:37.112431 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d39638-dffe-4557-ae80-cdc071a6c4e4 service nova] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:37:37.125185 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1417/2852] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:37:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:37:38.559872 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dada4cfb-7307-47b0-948e-5b5199ae177b service neutron] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:37:38.561249 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-dada4cfb-7307-47b0-948e-5b5199ae177b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:37:38.649379 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dada4cfb-7307-47b0-948e-5b5199ae177b service neutron] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:37:38.654319 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd90205-4da5-4f90-b20d-ae704c74da90 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '285198b50b50431f96f9225d106417a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:37:38.654951 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd90205-4da5-4f90-b20d-ae704c74da90 service placement] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:37:38.655230 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd90205-4da5-4f90-b20d-ae704c74da90 service placement] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:37:38.655598 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd90205-4da5-4f90-b20d-ae704c74da90 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:37:38.657322 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-6dd90205-4da5-4f90-b20d-ae704c74da90 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:37:38.668536 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd90205-4da5-4f90-b20d-ae704c74da90 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:37:38.670124 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd90205-4da5-4f90-b20d-ae704c74da90 service placement] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:37:38.680278 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1436/2853] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:37:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:37:53.126259 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d39638-dffe-4557-ae80-cdc071a6c4e4 service nova] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:37:53.136091 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d39638-dffe-4557-ae80-cdc071a6c4e4 service nova] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:37:53.139567 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a7d27d-4f03-4d70-a3a2-10d70bf86d19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:37:53.140180 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a7d27d-4f03-4d70-a3a2-10d70bf86d19 service neutron] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:37:53.140467 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a7d27d-4f03-4d70-a3a2-10d70bf86d19 service neutron] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:37:53.140719 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a7d27d-4f03-4d70-a3a2-10d70bf86d19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:37:53.150015 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a7d27d-4f03-4d70-a3a2-10d70bf86d19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:37:53.151440 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a7d27d-4f03-4d70-a3a2-10d70bf86d19 service neutron] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:37:53.160582 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1418/2854] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:37:53 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:39:54.393884 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd90205-4da5-4f90-b20d-ae704c74da90 service placement] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:39:54.404640 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd90205-4da5-4f90-b20d-ae704c74da90 service placement] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:39:54.408259 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd0bcc-1811-4cd0-9db9-c688cd3d2933 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:39:54.408883 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd0bcc-1811-4cd0-9db9-c688cd3d2933 service neutron] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:39:54.409165 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd0bcc-1811-4cd0-9db9-c688cd3d2933 service neutron] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:39:54.409435 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd0bcc-1811-4cd0-9db9-c688cd3d2933 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:39:54.411233 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-48dd0bcc-1811-4cd0-9db9-c688cd3d2933 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:39:54.449180 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dd0bcc-1811-4cd0-9db9-c688cd3d2933 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:39:54.450611 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dd0bcc-1811-4cd0-9db9-c688cd3d2933 service neutron] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:39:54.474796 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1437/2855] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:39:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:39:55.647102 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a7d27d-4f03-4d70-a3a2-10d70bf86d19 service neutron] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:39:55.657693 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a7d27d-4f03-4d70-a3a2-10d70bf86d19 service neutron] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:39:55.661665 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d84c63-76e8-488f-95f8-bc4da8f06f58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:39:55.662495 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d84c63-76e8-488f-95f8-bc4da8f06f58 service neutron] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:39:55.662821 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d84c63-76e8-488f-95f8-bc4da8f06f58 service neutron] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:39:55.663130 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d84c63-76e8-488f-95f8-bc4da8f06f58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:39:55.665243 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-a0d84c63-76e8-488f-95f8-bc4da8f06f58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:39:55.679064 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d84c63-76e8-488f-95f8-bc4da8f06f58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:39:55.680546 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d84c63-76e8-488f-95f8-bc4da8f06f58 service neutron] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:39:55.691848 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1419/2856] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:39:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:40:07.571908 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd0bcc-1811-4cd0-9db9-c688cd3d2933 service neutron] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:40:07.582174 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd0bcc-1811-4cd0-9db9-c688cd3d2933 service neutron] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:40:07.586131 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4d9fa5-1d6b-4d87-8bc3-f22bf07c5a21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:40:07.586764 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d9fa5-1d6b-4d87-8bc3-f22bf07c5a21 service neutron] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:40:07.587041 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d9fa5-1d6b-4d87-8bc3-f22bf07c5a21 service neutron] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:40:07.587311 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d9fa5-1d6b-4d87-8bc3-f22bf07c5a21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:40:07.589081 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-eb4d9fa5-1d6b-4d87-8bc3-f22bf07c5a21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:40:07.601663 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4d9fa5-1d6b-4d87-8bc3-f22bf07c5a21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:40:07.603221 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4d9fa5-1d6b-4d87-8bc3-f22bf07c5a21 service neutron] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:40:07.611448 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1438/2857] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:40:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:40:07.682993 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d84c63-76e8-488f-95f8-bc4da8f06f58 service neutron] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:40:07.692016 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d84c63-76e8-488f-95f8-bc4da8f06f58 service neutron] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:40:07.695710 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e5f6ab-7c07-4898-a47d-56dce451d549 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:40:07.696336 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e5f6ab-7c07-4898-a47d-56dce451d549 service neutron] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:40:07.696610 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e5f6ab-7c07-4898-a47d-56dce451d549 service neutron] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:40:07.696873 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e5f6ab-7c07-4898-a47d-56dce451d549 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:40:07.698589 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-87e5f6ab-7c07-4898-a47d-56dce451d549 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:40:07.712656 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e5f6ab-7c07-4898-a47d-56dce451d549 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:40:07.714059 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e5f6ab-7c07-4898-a47d-56dce451d549 service neutron] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:40:07.724668 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1420/2858] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:40:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:40:21.382938 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4d9fa5-1d6b-4d87-8bc3-f22bf07c5a21 service neutron] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:40:21.384470 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-eb4d9fa5-1d6b-4d87-8bc3-f22bf07c5a21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:40:21.401291 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4d9fa5-1d6b-4d87-8bc3-f22bf07c5a21 service neutron] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:40:21.409160 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df003c-5fa1-425b-9d8a-cef2f53f2572 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb59440b21074d9da15679dc2d745f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:40:21.409907 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df003c-5fa1-425b-9d8a-cef2f53f2572 service nova] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:40:21.410205 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df003c-5fa1-425b-9d8a-cef2f53f2572 service nova] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:40:21.410468 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df003c-5fa1-425b-9d8a-cef2f53f2572 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:40:21.412289 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-c0df003c-5fa1-425b-9d8a-cef2f53f2572 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:40:21.426409 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0df003c-5fa1-425b-9d8a-cef2f53f2572 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:40:21.428035 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0df003c-5fa1-425b-9d8a-cef2f53f2572 service nova] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:40:21.438646 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1439/2859] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:40:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:40:22.327969 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d353c4fe-4519-484a-ad55-42009f85287f None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:40:22.328439 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d353c4fe-4519-484a-ad55-42009f85287f None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:40:22.328537 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d353c4fe-4519-484a-ad55-42009f85287f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:40:22.383773 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-d353c4fe-4519-484a-ad55-42009f85287f None None] MFA Rules not processed for user `0227b2954e61426388214e96e1741eb2`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:40:22.385230 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-d353c4fe-4519-484a-ad55-42009f85287f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:40:22.401437 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1421/2860] 10.222.0.44 () {58 vars in 967 bytes} [Mon May 9 20:40:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:40:22.442120 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df003c-5fa1-425b-9d8a-cef2f53f2572 service nova] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:40:22.462036 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df003c-5fa1-425b-9d8a-cef2f53f2572 service nova] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:40:22.467536 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0980b3-271c-44f2-a6f0-b8ec0c17de3a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965089f1a92f49bd883b337d6042c69f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:40:22.468161 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0980b3-271c-44f2-a6f0-b8ec0c17de3a service swift] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:40:22.468437 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0980b3-271c-44f2-a6f0-b8ec0c17de3a service swift] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:40:22.468706 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0980b3-271c-44f2-a6f0-b8ec0c17de3a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:40:22.476353 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0980b3-271c-44f2-a6f0-b8ec0c17de3a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:40:22.477901 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0980b3-271c-44f2-a6f0-b8ec0c17de3a service swift] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:40:22.486460 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1440/2861] 10.222.0.44 () {60 vars in 1384 bytes} [Mon May 9 20:40:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 09 20:40:29.196038 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d353c4fe-4519-484a-ad55-42009f85287f None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:40:29.277609 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d353c4fe-4519-484a-ad55-42009f85287f None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:40:29.282173 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b565bf34-0b8e-4c26-a0af-98c210f64b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:40:29.283012 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b565bf34-0b8e-4c26-a0af-98c210f64b13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:40:29.283285 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b565bf34-0b8e-4c26-a0af-98c210f64b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:40:29.283582 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b565bf34-0b8e-4c26-a0af-98c210f64b13 admin admin] PATH_INFO: `/v3/users/0022312a6d124579a4d627acbc27bc01` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:40:29.284754 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b565bf34-0b8e-4c26-a0af-98c210f64b13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0022312a6d124579a4d627acbc27bc01)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:40:29.286644 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b565bf34-0b8e-4c26-a0af-98c210f64b13 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:40:29.330806 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-b565bf34-0b8e-4c26-a0af-98c210f64b13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0022312a6d124579a4d627acbc27bc01'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:40:29.337187 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-b565bf34-0b8e-4c26-a0af-98c210f64b13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0022312a6d124579a4d627acbc27bc01'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:40:29.344104 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-b565bf34-0b8e-4c26-a0af-98c210f64b13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0022312a6d124579a4d627acbc27bc01'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:40:29.344712 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-b565bf34-0b8e-4c26-a0af-98c210f64b13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0022312a6d124579a4d627acbc27bc01'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:40:29.345312 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-b565bf34-0b8e-4c26-a0af-98c210f64b13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0022312a6d124579a4d627acbc27bc01'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:40:29.361904 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1422/2862] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:40:29 2022] DELETE /identity/v3/users/0022312a6d124579a4d627acbc27bc01 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:40:29.531003 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0980b3-271c-44f2-a6f0-b8ec0c17de3a service swift] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:40:29.542725 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0980b3-271c-44f2-a6f0-b8ec0c17de3a service swift] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:40:29.596995 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5be0292-b7d9-47e5-b1f9-4defe193b783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:40:29.597866 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5be0292-b7d9-47e5-b1f9-4defe193b783 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:40:29.598144 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5be0292-b7d9-47e5-b1f9-4defe193b783 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:40:29.598415 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5be0292-b7d9-47e5-b1f9-4defe193b783 admin admin] PATH_INFO: `/v3/projects/36dd3d47f0c54036a5821e6815744e22` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:40:29.599629 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5be0292-b7d9-47e5-b1f9-4defe193b783 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36dd3d47f0c54036a5821e6815744e22)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:40:29.601568 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5be0292-b7d9-47e5-b1f9-4defe193b783 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:40:29.646158 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-d5be0292-b7d9-47e5-b1f9-4defe193b783 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36dd3d47f0c54036a5821e6815744e22', 'request_id': 'req-d5be0292-b7d9-47e5-b1f9-4defe193b783'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:40:29.654096 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-d5be0292-b7d9-47e5-b1f9-4defe193b783 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36dd3d47f0c54036a5821e6815744e22', 'request_id': 'req-d5be0292-b7d9-47e5-b1f9-4defe193b783'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:40:29.659222 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-d5be0292-b7d9-47e5-b1f9-4defe193b783 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36dd3d47f0c54036a5821e6815744e22', 'request_id': 'req-d5be0292-b7d9-47e5-b1f9-4defe193b783'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:40:29.684238 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-d5be0292-b7d9-47e5-b1f9-4defe193b783 admin admin] The token cache is being invalidate because project 36dd3d47f0c54036a5821e6815744e22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:40:29.684516 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-d5be0292-b7d9-47e5-b1f9-4defe193b783 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:40:29.685129 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-d5be0292-b7d9-47e5-b1f9-4defe193b783 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:40:29.686650 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1441/2863] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:40:29 2022] DELETE /identity/v3/projects/36dd3d47f0c54036a5821e6815744e22 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:40:29.690588 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b565bf34-0b8e-4c26-a0af-98c210f64b13 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:40:29.692000 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-b565bf34-0b8e-4c26-a0af-98c210f64b13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:40:29.704607 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b565bf34-0b8e-4c26-a0af-98c210f64b13 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:40:29.763480 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68570b7-8272-41c4-8647-3f07eb9017dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:40:29.764327 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68570b7-8272-41c4-8647-3f07eb9017dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:40:29.764597 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68570b7-8272-41c4-8647-3f07eb9017dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:40:29.764858 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68570b7-8272-41c4-8647-3f07eb9017dc admin admin] PATH_INFO: `/v3/users/c7fa957498714cdd960372ffa7168ed2` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:40:29.766019 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68570b7-8272-41c4-8647-3f07eb9017dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7fa957498714cdd960372ffa7168ed2)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:40:29.767963 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68570b7-8272-41c4-8647-3f07eb9017dc admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:40:29.811305 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-c68570b7-8272-41c4-8647-3f07eb9017dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7fa957498714cdd960372ffa7168ed2'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:40:29.817878 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-c68570b7-8272-41c4-8647-3f07eb9017dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7fa957498714cdd960372ffa7168ed2'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:40:29.824427 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-c68570b7-8272-41c4-8647-3f07eb9017dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7fa957498714cdd960372ffa7168ed2'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:40:29.825080 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-c68570b7-8272-41c4-8647-3f07eb9017dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7fa957498714cdd960372ffa7168ed2'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:40:29.825683 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-c68570b7-8272-41c4-8647-3f07eb9017dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7fa957498714cdd960372ffa7168ed2'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:40:29.841986 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1423/2864] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:40:29 2022] DELETE /identity/v3/users/c7fa957498714cdd960372ffa7168ed2 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:40:30.014110 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5be0292-b7d9-47e5-b1f9-4defe193b783 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:40:30.015655 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-d5be0292-b7d9-47e5-b1f9-4defe193b783 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:40:30.031691 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5be0292-b7d9-47e5-b1f9-4defe193b783 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:40:30.087289 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec10a03-4f29-457f-96a4-e16fa828b65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:40:30.088169 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec10a03-4f29-457f-96a4-e16fa828b65b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:40:30.088451 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec10a03-4f29-457f-96a4-e16fa828b65b admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:40:30.088724 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec10a03-4f29-457f-96a4-e16fa828b65b admin admin] PATH_INFO: `/v3/projects/2d7e18dee2644530bb546a658647d04b` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:40:30.090368 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec10a03-4f29-457f-96a4-e16fa828b65b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d7e18dee2644530bb546a658647d04b)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:40:30.092374 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec10a03-4f29-457f-96a4-e16fa828b65b admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:40:30.138577 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-bec10a03-4f29-457f-96a4-e16fa828b65b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d7e18dee2644530bb546a658647d04b', 'request_id': 'req-bec10a03-4f29-457f-96a4-e16fa828b65b'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:40:30.144515 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-bec10a03-4f29-457f-96a4-e16fa828b65b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d7e18dee2644530bb546a658647d04b', 'request_id': 'req-bec10a03-4f29-457f-96a4-e16fa828b65b'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:40:30.149812 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-bec10a03-4f29-457f-96a4-e16fa828b65b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d7e18dee2644530bb546a658647d04b', 'request_id': 'req-bec10a03-4f29-457f-96a4-e16fa828b65b'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:40:30.162112 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-bec10a03-4f29-457f-96a4-e16fa828b65b admin admin] The token cache is being invalidate because project 2d7e18dee2644530bb546a658647d04b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:40:30.162403 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-bec10a03-4f29-457f-96a4-e16fa828b65b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:40:30.163017 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-bec10a03-4f29-457f-96a4-e16fa828b65b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:40:30.164551 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1442/2865] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:40:30 2022] DELETE /identity/v3/projects/2d7e18dee2644530bb546a658647d04b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:40:30.169520 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e83c9-f11a-406b-806e-821b4ed983c7 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:40:30.169812 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e83c9-f11a-406b-806e-821b4ed983c7 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:40:30.170083 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e83c9-f11a-406b-806e-821b4ed983c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:40:30.224216 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-6e2e83c9-f11a-406b-806e-821b4ed983c7 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:40:30.225417 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-6e2e83c9-f11a-406b-806e-821b4ed983c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:40:30.284343 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1424/2866] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:40:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:40:30.292410 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee31a8-b3b5-4b13-a2bd-764cab708169 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:40:30.293361 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee31a8-b3b5-4b13-a2bd-764cab708169 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:40:30.293641 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee31a8-b3b5-4b13-a2bd-764cab708169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:40:30.312061 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-6dee31a8-b3b5-4b13-a2bd-764cab708169 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:40:30.313251 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-6dee31a8-b3b5-4b13-a2bd-764cab708169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:40:30.321153 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1443/2867] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:40:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:40:30.326025 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2e83c9-f11a-406b-806e-821b4ed983c7 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:40:30.335796 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2e83c9-f11a-406b-806e-821b4ed983c7 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:40:30.341021 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b160503-19a7-4a81-8c37-971797e0ca3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:40:30.341667 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b160503-19a7-4a81-8c37-971797e0ca3d admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:40:30.341944 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b160503-19a7-4a81-8c37-971797e0ca3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:40:30.342235 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b160503-19a7-4a81-8c37-971797e0ca3d admin admin] PATH_INFO: `/v3/domains` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:40:30.343010 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b160503-19a7-4a81-8c37-971797e0ca3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 20:40:30.343250 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b160503-19a7-4a81-8c37-971797e0ca3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:40:30.344877 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b160503-19a7-4a81-8c37-971797e0ca3d admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:40:30.359521 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1425/2868] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 9 20:40:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 20:40:30.360863 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee31a8-b3b5-4b13-a2bd-764cab708169 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:40:30.369811 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee31a8-b3b5-4b13-a2bd-764cab708169 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:40:30.374628 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f66555-5aa8-4bf3-88fa-b8db2094830f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:40:30.375274 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f66555-5aa8-4bf3-88fa-b8db2094830f admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:40:30.375929 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f66555-5aa8-4bf3-88fa-b8db2094830f admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:40:30.375929 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f66555-5aa8-4bf3-88fa-b8db2094830f admin admin] PATH_INFO: `/v3/projects` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:40:30.377334 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f66555-5aa8-4bf3-88fa-b8db2094830f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:40:30.379349 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f66555-5aa8-4bf3-88fa-b8db2094830f admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:40:30.405695 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1444/2869] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:40:30 2022] POST /identity/v3/projects => generated 379 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 20:40:30.410585 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b160503-19a7-4a81-8c37-971797e0ca3d admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:40:30.421035 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b160503-19a7-4a81-8c37-971797e0ca3d admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:40:30.474718 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56430179-7e4e-4195-a027-99d1c3c5216e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:40:30.475381 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56430179-7e4e-4195-a027-99d1c3c5216e admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:40:30.475689 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56430179-7e4e-4195-a027-99d1c3c5216e admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:40:30.475962 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56430179-7e4e-4195-a027-99d1c3c5216e admin admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:40:30.476669 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56430179-7e4e-4195-a027-99d1c3c5216e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:40:30.478600 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56430179-7e4e-4195-a027-99d1c3c5216e admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:40:30.497694 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1426/2870] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:40:30 2022] POST /identity/v3/users => generated 290 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:40:30.501747 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f66555-5aa8-4bf3-88fa-b8db2094830f admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:40:30.512325 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f66555-5aa8-4bf3-88fa-b8db2094830f admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:40:30.516804 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373f1816-ea5a-4f82-8e6f-2264cbcdf8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:40:30.517441 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f1816-ea5a-4f82-8e6f-2264cbcdf8f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:40:30.517717 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f1816-ea5a-4f82-8e6f-2264cbcdf8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:40:30.517986 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f1816-ea5a-4f82-8e6f-2264cbcdf8f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:40:30.518693 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373f1816-ea5a-4f82-8e6f-2264cbcdf8f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:40:30.520297 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373f1816-ea5a-4f82-8e6f-2264cbcdf8f8 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:40:30.531046 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1445/2871] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:40:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:40:30.534839 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56430179-7e4e-4195-a027-99d1c3c5216e admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:40:30.544580 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56430179-7e4e-4195-a027-99d1c3c5216e admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:40:30.549327 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be6a8e0-5652-46f4-ae15-0252f3be786b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:40:30.550008 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be6a8e0-5652-46f4-ae15-0252f3be786b admin admin] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:40:30.550316 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be6a8e0-5652-46f4-ae15-0252f3be786b admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:40:30.550603 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be6a8e0-5652-46f4-ae15-0252f3be786b admin admin] PATH_INFO: `/v3/roles` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:40:30.551320 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be6a8e0-5652-46f4-ae15-0252f3be786b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:40:30.552952 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be6a8e0-5652-46f4-ae15-0252f3be786b admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:40:30.562951 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1427/2872] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:40:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:40:30.566837 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373f1816-ea5a-4f82-8e6f-2264cbcdf8f8 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:40:30.577255 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373f1816-ea5a-4f82-8e6f-2264cbcdf8f8 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:40:30.581929 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7117dc0a-5256-4ed8-ac98-06507ed987f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:40:30.582792 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7117dc0a-5256-4ed8-ac98-06507ed987f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:40:30.583071 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7117dc0a-5256-4ed8-ac98-06507ed987f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:40:30.583340 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7117dc0a-5256-4ed8-ac98-06507ed987f8 admin admin] PATH_INFO: `/v3/projects/ceeb72f15a944fcbbd9095bb3d553126/users/95791a44989743338f7177fd8a2e434e/roles/79f90a0bf6ea43d0b3c434e31556253a` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:40:30.598395 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7117dc0a-5256-4ed8-ac98-06507ed987f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ceeb72f15a944fcbbd9095bb3d553126, user_id=95791a44989743338f7177fd8a2e434e, role_id=79f90a0bf6ea43d0b3c434e31556253a)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:40:30.601138 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7117dc0a-5256-4ed8-ac98-06507ed987f8 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:40:30.614630 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1446/2873] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:40:30 2022] PUT /identity/v3/projects/ceeb72f15a944fcbbd9095bb3d553126/users/95791a44989743338f7177fd8a2e434e/roles/79f90a0bf6ea43d0b3c434e31556253a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:40:30.619871 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0102e832-23e4-4d8e-90f5-094b7fe59711 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:40:30.620158 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0102e832-23e4-4d8e-90f5-094b7fe59711 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:40:30.620434 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0102e832-23e4-4d8e-90f5-094b7fe59711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:40:30.638398 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-0102e832-23e4-4d8e-90f5-094b7fe59711 None None] MFA Rules not processed for user `eda0196f36b948c2b847c376ca98040d`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:40:30.639604 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-0102e832-23e4-4d8e-90f5-094b7fe59711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:40:30.694114 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1428/2874] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:40:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:40:30.704402 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7117dc0a-5256-4ed8-ac98-06507ed987f8 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:40:30.706056 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-7117dc0a-5256-4ed8-ac98-06507ed987f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:40:30.764009 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7117dc0a-5256-4ed8-ac98-06507ed987f8 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:40:30.767661 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2488273f-98ae-4123-a262-09371fb91566 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:40:30.768299 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488273f-98ae-4123-a262-09371fb91566 service neutron] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:40:30.768581 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488273f-98ae-4123-a262-09371fb91566 service neutron] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:40:30.768855 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488273f-98ae-4123-a262-09371fb91566 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:40:30.777580 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2488273f-98ae-4123-a262-09371fb91566 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:40:30.779005 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2488273f-98ae-4123-a262-09371fb91566 service neutron] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:40:30.788172 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1447/2875] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:40:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:40:34.750536 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48167c8b-73c2-40c6-aa59-4ad925388515 None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:40:34.751125 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48167c8b-73c2-40c6-aa59-4ad925388515 None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:40:34.751125 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48167c8b-73c2-40c6-aa59-4ad925388515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:40:34.778410 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-48167c8b-73c2-40c6-aa59-4ad925388515 None None] MFA Rules not processed for user `95791a44989743338f7177fd8a2e434e`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:40:34.779566 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-48167c8b-73c2-40c6-aa59-4ad925388515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:40:34.846667 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1429/2876] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:40:34 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:40:34.851214 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2488273f-98ae-4123-a262-09371fb91566 service neutron] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:40:34.864702 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2488273f-98ae-4123-a262-09371fb91566 service neutron] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:40:34.869433 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cb76a4-bfe4-41a8-b750-f6bd943d69d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:40:34.870109 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb76a4-bfe4-41a8-b750-f6bd943d69d8 admin admin] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:40:34.870391 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb76a4-bfe4-41a8-b750-f6bd943d69d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:40:34.871451 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb76a4-bfe4-41a8-b750-f6bd943d69d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:40:34.872159 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cb76a4-bfe4-41a8-b750-f6bd943d69d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:40:34.874076 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cb76a4-bfe4-41a8-b750-f6bd943d69d8 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:40:34.902621 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1448/2877] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 9 20:40:34 2022] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 20:40:34.907094 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48167c8b-73c2-40c6-aa59-4ad925388515 None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:40:34.918068 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48167c8b-73c2-40c6-aa59-4ad925388515 None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:40:34.977166 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16280198-558d-4855-8366-206f888f1ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:40:34.977830 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16280198-558d-4855-8366-206f888f1ee5 admin admin] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:40:34.978112 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16280198-558d-4855-8366-206f888f1ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:40:34.978381 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16280198-558d-4855-8366-206f888f1ee5 admin admin] PATH_INFO: `/v3/users` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:40:34.979060 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16280198-558d-4855-8366-206f888f1ee5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:40:34.981222 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16280198-558d-4855-8366-206f888f1ee5 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:40:35.002080 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1430/2878] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 9 20:40:34 2022] POST /identity/v3/users => generated 296 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 20:40:35.006151 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cb76a4-bfe4-41a8-b750-f6bd943d69d8 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:40:35.017298 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cb76a4-bfe4-41a8-b750-f6bd943d69d8 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:40:35.022104 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfab927-d79d-466d-aaf7-3d967c608a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:40:35.022763 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfab927-d79d-466d-aaf7-3d967c608a3d admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:40:35.023041 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfab927-d79d-466d-aaf7-3d967c608a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:40:35.023312 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfab927-d79d-466d-aaf7-3d967c608a3d admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:40:35.024236 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfab927-d79d-466d-aaf7-3d967c608a3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:40:35.026013 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfab927-d79d-466d-aaf7-3d967c608a3d admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:40:35.039983 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1449/2879] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:40:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 09 20:40:35.044219 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16280198-558d-4855-8366-206f888f1ee5 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:40:35.054196 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16280198-558d-4855-8366-206f888f1ee5 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:40:35.059121 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c09f1f6-a24d-416a-917a-4372d4a9be11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:40:35.060070 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09f1f6-a24d-416a-917a-4372d4a9be11 admin admin] REQUEST_METHOD: `PUT` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:40:35.060347 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09f1f6-a24d-416a-917a-4372d4a9be11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:40:35.060613 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09f1f6-a24d-416a-917a-4372d4a9be11 admin admin] PATH_INFO: `/v3/projects/891d8f40ef014aefb0585d6ebaeb6f40/users/2dda6b027923466ba1d4b9407c3c5eae/roles/274130b78e304bb88789c1b349263f3c` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:40:35.075811 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c09f1f6-a24d-416a-917a-4372d4a9be11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=891d8f40ef014aefb0585d6ebaeb6f40, user_id=2dda6b027923466ba1d4b9407c3c5eae, role_id=274130b78e304bb88789c1b349263f3c)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:40:35.078441 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c09f1f6-a24d-416a-917a-4372d4a9be11 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:40:35.092121 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1431/2880] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:40:35 2022] PUT /identity/v3/projects/891d8f40ef014aefb0585d6ebaeb6f40/users/2dda6b027923466ba1d4b9407c3c5eae/roles/274130b78e304bb88789c1b349263f3c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:40:35.096127 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfab927-d79d-466d-aaf7-3d967c608a3d admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:40:35.106125 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfab927-d79d-466d-aaf7-3d967c608a3d admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:40:35.162270 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6795d488-1c38-4002-92a8-8aaf26a8fc59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:40:35.163062 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6795d488-1c38-4002-92a8-8aaf26a8fc59 admin admin] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:40:35.164383 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6795d488-1c38-4002-92a8-8aaf26a8fc59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:40:35.164383 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6795d488-1c38-4002-92a8-8aaf26a8fc59 admin admin] PATH_INFO: `/v3/roles` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:40:35.164383 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6795d488-1c38-4002-92a8-8aaf26a8fc59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:40:35.165993 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6795d488-1c38-4002-92a8-8aaf26a8fc59 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:40:35.178826 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1450/2881] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 9 20:40:35 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 20:40:35.181119 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c09f1f6-a24d-416a-917a-4372d4a9be11 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:40:35.195076 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c09f1f6-a24d-416a-917a-4372d4a9be11 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:40:35.202648 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75240b57-6e2b-4c0b-8b47-7401d27a1ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:40:35.202648 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75240b57-6e2b-4c0b-8b47-7401d27a1ab4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:40:35.202648 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75240b57-6e2b-4c0b-8b47-7401d27a1ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:40:35.202648 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75240b57-6e2b-4c0b-8b47-7401d27a1ab4 admin admin] PATH_INFO: `/v3/projects/891d8f40ef014aefb0585d6ebaeb6f40/users/2dda6b027923466ba1d4b9407c3c5eae/roles/274130b78e304bb88789c1b349263f3c` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:40:35.204593 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75240b57-6e2b-4c0b-8b47-7401d27a1ab4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=891d8f40ef014aefb0585d6ebaeb6f40, user_id=2dda6b027923466ba1d4b9407c3c5eae, role_id=274130b78e304bb88789c1b349263f3c)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:40:35.209035 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75240b57-6e2b-4c0b-8b47-7401d27a1ab4 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:40:35.220439 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1432/2882] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 9 20:40:35 2022] PUT /identity/v3/projects/891d8f40ef014aefb0585d6ebaeb6f40/users/2dda6b027923466ba1d4b9407c3c5eae/roles/274130b78e304bb88789c1b349263f3c => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 20:40:39.776764 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f9f4e4-2a97-4990-8f7a-372353269793 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:40:39.777320 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f9f4e4-2a97-4990-8f7a-372353269793 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:40:39.777629 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f9f4e4-2a97-4990-8f7a-372353269793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:40:39.804136 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-43f9f4e4-2a97-4990-8f7a-372353269793 None None] MFA Rules not processed for user `2dda6b027923466ba1d4b9407c3c5eae`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:40:39.805347 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-43f9f4e4-2a97-4990-8f7a-372353269793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:40:39.872976 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1451/2883] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:40:39 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:40:39.887611 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75240b57-6e2b-4c0b-8b47-7401d27a1ab4 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:40:39.889291 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-75240b57-6e2b-4c0b-8b47-7401d27a1ab4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:40:39.966765 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75240b57-6e2b-4c0b-8b47-7401d27a1ab4 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:40:39.972686 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdd2a39-db45-41e1-ba2b-4f866820bf4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb59440b21074d9da15679dc2d745f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:40:39.973330 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd2a39-db45-41e1-ba2b-4f866820bf4a service nova] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:40:39.973607 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd2a39-db45-41e1-ba2b-4f866820bf4a service nova] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:40:39.973895 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd2a39-db45-41e1-ba2b-4f866820bf4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:40:40.029759 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdd2a39-db45-41e1-ba2b-4f866820bf4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:40:40.031312 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdd2a39-db45-41e1-ba2b-4f866820bf4a service nova] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:40:40.040259 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1433/2884] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:40:39 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:41:02.598936 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9798fc3-82f6-4f9c-bca3-09ab3e308186 None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:41:02.599493 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9798fc3-82f6-4f9c-bca3-09ab3e308186 None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:41:02.599493 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9798fc3-82f6-4f9c-bca3-09ab3e308186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:41:02.617190 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-e9798fc3-82f6-4f9c-bca3-09ab3e308186 None None] MFA Rules not processed for user `95791a44989743338f7177fd8a2e434e`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:41:02.618368 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-e9798fc3-82f6-4f9c-bca3-09ab3e308186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:41:02.625334 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1452/2885] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:41:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:41:16.605067 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdd2a39-db45-41e1-ba2b-4f866820bf4a service nova] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:41:16.658865 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdd2a39-db45-41e1-ba2b-4f866820bf4a service nova] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:41:16.662386 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6446bb-4e8f-4a4e-b33c-ec65f83f0728 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:41:16.663014 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6446bb-4e8f-4a4e-b33c-ec65f83f0728 service neutron] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:41:16.663288 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6446bb-4e8f-4a4e-b33c-ec65f83f0728 service neutron] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:41:16.663583 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6446bb-4e8f-4a4e-b33c-ec65f83f0728 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:41:16.665308 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-ea6446bb-4e8f-4a4e-b33c-ec65f83f0728 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:41:16.674659 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6446bb-4e8f-4a4e-b33c-ec65f83f0728 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:41:16.676107 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6446bb-4e8f-4a4e-b33c-ec65f83f0728 service neutron] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:41:16.683732 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1434/2886] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:41:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:41:19.044799 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9798fc3-82f6-4f9c-bca3-09ab3e308186 None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:41:19.054583 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9798fc3-82f6-4f9c-bca3-09ab3e308186 None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:41:19.058162 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a7e6c-89d9-44f8-ad80-72d1b4bb667b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:41:19.058900 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a7e6c-89d9-44f8-ad80-72d1b4bb667b service neutron] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:41:19.059202 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a7e6c-89d9-44f8-ad80-72d1b4bb667b service neutron] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:41:19.059485 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a7e6c-89d9-44f8-ad80-72d1b4bb667b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:41:19.068124 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5a7e6c-89d9-44f8-ad80-72d1b4bb667b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:41:19.069574 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5a7e6c-89d9-44f8-ad80-72d1b4bb667b service neutron] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:41:19.079403 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1453/2887] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:41:19 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:42:03.232078 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6446bb-4e8f-4a4e-b33c-ec65f83f0728 service neutron] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:42:03.233511 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-ea6446bb-4e8f-4a4e-b33c-ec65f83f0728 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:42:03.244441 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6446bb-4e8f-4a4e-b33c-ec65f83f0728 service neutron] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:42:03.247978 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c65cd08-bd92-4289-9496-74b6132b8fff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:42:03.248601 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65cd08-bd92-4289-9496-74b6132b8fff service neutron] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:42:03.248873 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65cd08-bd92-4289-9496-74b6132b8fff service neutron] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:42:03.249138 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65cd08-bd92-4289-9496-74b6132b8fff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:42:03.251641 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-5c65cd08-bd92-4289-9496-74b6132b8fff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:42:03.309058 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c65cd08-bd92-4289-9496-74b6132b8fff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:42:03.310491 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c65cd08-bd92-4289-9496-74b6132b8fff service neutron] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:42:03.320627 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1435/2888] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:42:03 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:42:08.060026 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a7e6c-89d9-44f8-ad80-72d1b4bb667b service neutron] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:42:08.070593 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a7e6c-89d9-44f8-ad80-72d1b4bb667b service neutron] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:42:08.074113 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22035dfc-0504-4898-8394-f4599b3ca302 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:42:08.074730 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22035dfc-0504-4898-8394-f4599b3ca302 service neutron] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:42:08.075007 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22035dfc-0504-4898-8394-f4599b3ca302 service neutron] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:42:08.075277 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22035dfc-0504-4898-8394-f4599b3ca302 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:42:08.077033 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-22035dfc-0504-4898-8394-f4599b3ca302 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:42:08.137588 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22035dfc-0504-4898-8394-f4599b3ca302 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:42:08.139008 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22035dfc-0504-4898-8394-f4599b3ca302 service neutron] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:42:08.148899 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1454/2889] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:42:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:42:14.603260 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c65cd08-bd92-4289-9496-74b6132b8fff service neutron] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:42:14.604754 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-5c65cd08-bd92-4289-9496-74b6132b8fff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:42:14.618686 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c65cd08-bd92-4289-9496-74b6132b8fff service neutron] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:42:14.623159 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a018e54-07cc-425f-94d6-4b46b1470cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:42:14.624232 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a018e54-07cc-425f-94d6-4b46b1470cdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:42:14.624626 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a018e54-07cc-425f-94d6-4b46b1470cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:42:14.624903 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a018e54-07cc-425f-94d6-4b46b1470cdf admin admin] PATH_INFO: `/v3/users/a408358ce1ea44a1ad62c41ebadd841d` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:42:14.626160 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a018e54-07cc-425f-94d6-4b46b1470cdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=a408358ce1ea44a1ad62c41ebadd841d)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:42:14.628130 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a018e54-07cc-425f-94d6-4b46b1470cdf admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:42:14.674113 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-3a018e54-07cc-425f-94d6-4b46b1470cdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a408358ce1ea44a1ad62c41ebadd841d'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:42:14.680604 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-3a018e54-07cc-425f-94d6-4b46b1470cdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a408358ce1ea44a1ad62c41ebadd841d'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:42:14.687311 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-3a018e54-07cc-425f-94d6-4b46b1470cdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a408358ce1ea44a1ad62c41ebadd841d'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:42:14.688091 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-3a018e54-07cc-425f-94d6-4b46b1470cdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a408358ce1ea44a1ad62c41ebadd841d'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:42:14.688735 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-3a018e54-07cc-425f-94d6-4b46b1470cdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a408358ce1ea44a1ad62c41ebadd841d'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:42:14.705358 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1436/2890] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:42:14 2022] DELETE /identity/v3/users/a408358ce1ea44a1ad62c41ebadd841d => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:42:14.876758 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22035dfc-0504-4898-8394-f4599b3ca302 service neutron] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:42:14.886758 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22035dfc-0504-4898-8394-f4599b3ca302 service neutron] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:42:14.943763 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9d2842-8e5f-4c22-b31a-50f0b8868266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:42:14.944611 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9d2842-8e5f-4c22-b31a-50f0b8868266 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:42:14.944892 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9d2842-8e5f-4c22-b31a-50f0b8868266 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:42:14.945172 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9d2842-8e5f-4c22-b31a-50f0b8868266 admin admin] PATH_INFO: `/v3/projects/5e23dd64fa8645c3a4ced56a7c9c62df` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:42:14.946325 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9d2842-8e5f-4c22-b31a-50f0b8868266 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e23dd64fa8645c3a4ced56a7c9c62df)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:42:14.948258 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9d2842-8e5f-4c22-b31a-50f0b8868266 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:42:14.995235 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-7c9d2842-8e5f-4c22-b31a-50f0b8868266 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e23dd64fa8645c3a4ced56a7c9c62df', 'request_id': 'req-7c9d2842-8e5f-4c22-b31a-50f0b8868266'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:42:15.001969 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-7c9d2842-8e5f-4c22-b31a-50f0b8868266 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e23dd64fa8645c3a4ced56a7c9c62df', 'request_id': 'req-7c9d2842-8e5f-4c22-b31a-50f0b8868266'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:42:15.007150 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-7c9d2842-8e5f-4c22-b31a-50f0b8868266 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e23dd64fa8645c3a4ced56a7c9c62df', 'request_id': 'req-7c9d2842-8e5f-4c22-b31a-50f0b8868266'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:42:15.019874 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-7c9d2842-8e5f-4c22-b31a-50f0b8868266 admin admin] The token cache is being invalidate because project 5e23dd64fa8645c3a4ced56a7c9c62df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:42:15.020175 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-7c9d2842-8e5f-4c22-b31a-50f0b8868266 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:42:15.020801 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-7c9d2842-8e5f-4c22-b31a-50f0b8868266 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:42:15.022399 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1455/2891] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:42:14 2022] DELETE /identity/v3/projects/5e23dd64fa8645c3a4ced56a7c9c62df => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:42:15.026498 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a018e54-07cc-425f-94d6-4b46b1470cdf admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:42:15.027893 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-3a018e54-07cc-425f-94d6-4b46b1470cdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:42:15.041775 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a018e54-07cc-425f-94d6-4b46b1470cdf admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:42:15.094790 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e05af-b39d-4e8f-861b-ef9eca8ff796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:42:15.095672 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e05af-b39d-4e8f-861b-ef9eca8ff796 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:42:15.095945 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e05af-b39d-4e8f-861b-ef9eca8ff796 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:42:15.096208 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e05af-b39d-4e8f-861b-ef9eca8ff796 admin admin] PATH_INFO: `/v3/users/f6b89d91230b446da9002ece6dd38337` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:42:15.097352 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2e05af-b39d-4e8f-861b-ef9eca8ff796 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6b89d91230b446da9002ece6dd38337)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:42:15.099280 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2e05af-b39d-4e8f-861b-ef9eca8ff796 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:42:15.143919 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-dd2e05af-b39d-4e8f-861b-ef9eca8ff796 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6b89d91230b446da9002ece6dd38337'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:42:15.150370 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-dd2e05af-b39d-4e8f-861b-ef9eca8ff796 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6b89d91230b446da9002ece6dd38337'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:42:15.157307 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-dd2e05af-b39d-4e8f-861b-ef9eca8ff796 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6b89d91230b446da9002ece6dd38337'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:42:15.157895 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-dd2e05af-b39d-4e8f-861b-ef9eca8ff796 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6b89d91230b446da9002ece6dd38337'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:42:15.158492 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-dd2e05af-b39d-4e8f-861b-ef9eca8ff796 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6b89d91230b446da9002ece6dd38337'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:42:15.175728 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1437/2892] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:42:15 2022] DELETE /identity/v3/users/f6b89d91230b446da9002ece6dd38337 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:42:15.348448 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9d2842-8e5f-4c22-b31a-50f0b8868266 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:42:15.349873 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-7c9d2842-8e5f-4c22-b31a-50f0b8868266 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:42:15.366720 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9d2842-8e5f-4c22-b31a-50f0b8868266 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:42:15.423980 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6708c9-52e4-4ecd-ad67-59e32eac7817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:42:15.424759 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6708c9-52e4-4ecd-ad67-59e32eac7817 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:42:15.425040 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6708c9-52e4-4ecd-ad67-59e32eac7817 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:42:15.425319 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6708c9-52e4-4ecd-ad67-59e32eac7817 admin admin] PATH_INFO: `/v3/projects/badcb1610440490eab569e8d918ff5d0` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:42:15.426483 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6708c9-52e4-4ecd-ad67-59e32eac7817 admin admin] RBAC: Authorizing `identity:delete_project(project_id=badcb1610440490eab569e8d918ff5d0)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:42:15.428460 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6708c9-52e4-4ecd-ad67-59e32eac7817 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:42:15.474166 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-dd6708c9-52e4-4ecd-ad67-59e32eac7817 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'badcb1610440490eab569e8d918ff5d0', 'request_id': 'req-dd6708c9-52e4-4ecd-ad67-59e32eac7817'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:42:15.480118 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-dd6708c9-52e4-4ecd-ad67-59e32eac7817 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'badcb1610440490eab569e8d918ff5d0', 'request_id': 'req-dd6708c9-52e4-4ecd-ad67-59e32eac7817'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:42:15.486161 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-dd6708c9-52e4-4ecd-ad67-59e32eac7817 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'badcb1610440490eab569e8d918ff5d0', 'request_id': 'req-dd6708c9-52e4-4ecd-ad67-59e32eac7817'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:42:15.498472 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-dd6708c9-52e4-4ecd-ad67-59e32eac7817 admin admin] The token cache is being invalidate because project badcb1610440490eab569e8d918ff5d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:42:15.498742 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-dd6708c9-52e4-4ecd-ad67-59e32eac7817 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:42:15.500065 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-dd6708c9-52e4-4ecd-ad67-59e32eac7817 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:42:15.501781 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1456/2893] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:42:15 2022] DELETE /identity/v3/projects/badcb1610440490eab569e8d918ff5d0 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:42:40.223140 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e05af-b39d-4e8f-861b-ef9eca8ff796 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:42:40.224521 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-dd2e05af-b39d-4e8f-861b-ef9eca8ff796 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:42:40.290490 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e05af-b39d-4e8f-861b-ef9eca8ff796 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:42:40.346907 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f9f8e-2db1-4c97-aeba-f3195cc44ae2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '285198b50b50431f96f9225d106417a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:42:40.347587 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f9f8e-2db1-4c97-aeba-f3195cc44ae2 service placement] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:42:40.347876 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f9f8e-2db1-4c97-aeba-f3195cc44ae2 service placement] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:42:40.348149 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f9f8e-2db1-4c97-aeba-f3195cc44ae2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:42:40.349898 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-b11f9f8e-2db1-4c97-aeba-f3195cc44ae2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:42:40.361607 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11f9f8e-2db1-4c97-aeba-f3195cc44ae2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:42:40.363255 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11f9f8e-2db1-4c97-aeba-f3195cc44ae2 service placement] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:42:40.372989 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1438/2894] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:42:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:43:38.325458 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f0e48d-27e2-4427-bf25-fb1726f0b49e None None] REQUEST_METHOD: `POST` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:43:38.325957 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f0e48d-27e2-4427-bf25-fb1726f0b49e None None] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:43:38.326063 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f0e48d-27e2-4427-bf25-fb1726f0b49e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:43:38.346487 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.auth.core [None req-21f0e48d-27e2-4427-bf25-fb1726f0b49e None None] MFA Rules not processed for user `95791a44989743338f7177fd8a2e434e`. Rule list: `[]` (Enabled: `True`). {{(pid=79828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:43:38.347763 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-21f0e48d-27e2-4427-bf25-fb1726f0b49e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:43:38.411261 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1457/2895] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:43:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:43:38.724629 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f9f8e-2db1-4c97-aeba-f3195cc44ae2 service placement] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:43:38.726031 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-b11f9f8e-2db1-4c97-aeba-f3195cc44ae2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:43:38.779055 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f9f8e-2db1-4c97-aeba-f3195cc44ae2 service placement] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:43:38.782712 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b386c85c-4ce0-418e-beab-83d5d3570322 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:43:38.783389 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b386c85c-4ce0-418e-beab-83d5d3570322 service neutron] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:43:38.783648 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b386c85c-4ce0-418e-beab-83d5d3570322 service neutron] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:43:38.783915 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b386c85c-4ce0-418e-beab-83d5d3570322 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:43:38.785610 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-b386c85c-4ce0-418e-beab-83d5d3570322 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:43:38.794644 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b386c85c-4ce0-418e-beab-83d5d3570322 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:43:38.796092 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b386c85c-4ce0-418e-beab-83d5d3570322 service neutron] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:43:38.803838 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1439/2896] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:43:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:43:39.236677 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f0e48d-27e2-4427-bf25-fb1726f0b49e None None] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:43:39.238116 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-21f0e48d-27e2-4427-bf25-fb1726f0b49e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:43:39.253042 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f0e48d-27e2-4427-bf25-fb1726f0b49e None None] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:43:39.257894 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ac8c5-7525-4aee-a621-0a2420a7dbcc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '285198b50b50431f96f9225d106417a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:43:39.258554 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ac8c5-7525-4aee-a621-0a2420a7dbcc service placement] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:43:39.258851 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ac8c5-7525-4aee-a621-0a2420a7dbcc service placement] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:43:39.259355 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ac8c5-7525-4aee-a621-0a2420a7dbcc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:43:39.261113 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-355ac8c5-7525-4aee-a621-0a2420a7dbcc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:43:39.274837 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355ac8c5-7525-4aee-a621-0a2420a7dbcc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:43:39.277394 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355ac8c5-7525-4aee-a621-0a2420a7dbcc service placement] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:43:39.289989 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1458/2897] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:43:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:43:53.098860 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b386c85c-4ce0-418e-beab-83d5d3570322 service neutron] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:43:53.100451 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-b386c85c-4ce0-418e-beab-83d5d3570322 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:43:53.175727 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b386c85c-4ce0-418e-beab-83d5d3570322 service neutron] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:43:53.181544 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ac703a-2e00-44d2-9087-2bc1c8847f73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb59440b21074d9da15679dc2d745f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:43:53.182186 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ac703a-2e00-44d2-9087-2bc1c8847f73 service nova] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:43:53.182491 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ac703a-2e00-44d2-9087-2bc1c8847f73 service nova] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:43:53.182760 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ac703a-2e00-44d2-9087-2bc1c8847f73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:43:53.184530 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-61ac703a-2e00-44d2-9087-2bc1c8847f73 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:43:53.197961 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ac703a-2e00-44d2-9087-2bc1c8847f73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:43:53.199523 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ac703a-2e00-44d2-9087-2bc1c8847f73 service nova] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:43:53.210359 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1440/2898] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:43:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:45:44.115032 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ac8c5-7525-4aee-a621-0a2420a7dbcc service placement] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:45:44.116449 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-355ac8c5-7525-4aee-a621-0a2420a7dbcc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:45:44.195349 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ac8c5-7525-4aee-a621-0a2420a7dbcc service placement] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:45:44.198885 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff778fc-8ee6-4e74-bab8-cd1e0c5fb438 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d65e731386d44948dcc1ecd40cbda65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:45:44.199543 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff778fc-8ee6-4e74-bab8-cd1e0c5fb438 service cinder] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:45:44.199820 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff778fc-8ee6-4e74-bab8-cd1e0c5fb438 service cinder] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:45:44.200090 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff778fc-8ee6-4e74-bab8-cd1e0c5fb438 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:45:44.201824 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-aff778fc-8ee6-4e74-bab8-cd1e0c5fb438 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:45:44.212501 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff778fc-8ee6-4e74-bab8-cd1e0c5fb438 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:45:44.213897 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff778fc-8ee6-4e74-bab8-cd1e0c5fb438 service cinder] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:45:44.223025 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1459/2899] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:45:44 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:45:54.098001 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc2c94-4236-4841-a9a1-609f2e01db4e None None] REQUEST_METHOD: `POST` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:45:54.098516 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc2c94-4236-4841-a9a1-609f2e01db4e None None] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:45:54.098516 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc2c94-4236-4841-a9a1-609f2e01db4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:45:54.114822 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.auth.core [None req-f1cc2c94-4236-4841-a9a1-609f2e01db4e None None] MFA Rules not processed for user `95791a44989743338f7177fd8a2e434e`. Rule list: `[]` (Enabled: `True`). {{(pid=79829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 20:45:54.116036 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-f1cc2c94-4236-4841-a9a1-609f2e01db4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:45:54.122837 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1441/2900] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 9 20:45:54 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 26 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 20:45:54.159789 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff778fc-8ee6-4e74-bab8-cd1e0c5fb438 service cinder] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:45:54.161192 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-aff778fc-8ee6-4e74-bab8-cd1e0c5fb438 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:45:54.172002 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff778fc-8ee6-4e74-bab8-cd1e0c5fb438 service cinder] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:45:54.175610 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444361c9-4035-49e0-bd30-524b8bd59715 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d65e731386d44948dcc1ecd40cbda65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:45:54.176236 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444361c9-4035-49e0-bd30-524b8bd59715 service cinder] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:45:54.176519 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444361c9-4035-49e0-bd30-524b8bd59715 service cinder] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:45:54.176801 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444361c9-4035-49e0-bd30-524b8bd59715 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:45:54.178478 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-444361c9-4035-49e0-bd30-524b8bd59715 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:45:54.191605 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444361c9-4035-49e0-bd30-524b8bd59715 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:45:54.193010 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444361c9-4035-49e0-bd30-524b8bd59715 service cinder] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:45:54.203909 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1460/2901] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:45:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:45:54.480948 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cc2c94-4236-4841-a9a1-609f2e01db4e None None] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:45:54.482346 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-f1cc2c94-4236-4841-a9a1-609f2e01db4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:45:54.497998 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cc2c94-4236-4841-a9a1-609f2e01db4e None None] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:45:54.502183 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62a4d2f-0894-4834-ba7d-9e9ef2684a7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:45:54.502813 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a4d2f-0894-4834-ba7d-9e9ef2684a7d service neutron] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:45:54.503090 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a4d2f-0894-4834-ba7d-9e9ef2684a7d service neutron] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:45:54.503359 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a4d2f-0894-4834-ba7d-9e9ef2684a7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:45:54.505111 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-b62a4d2f-0894-4834-ba7d-9e9ef2684a7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:45:54.514701 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62a4d2f-0894-4834-ba7d-9e9ef2684a7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:45:54.516124 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62a4d2f-0894-4834-ba7d-9e9ef2684a7d service neutron] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:45:54.524939 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1442/2902] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:45:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:45:54.963970 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444361c9-4035-49e0-bd30-524b8bd59715 service cinder] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:45:54.973454 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444361c9-4035-49e0-bd30-524b8bd59715 service cinder] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:45:54.976919 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfa1062-392f-40cc-9ae9-073df265117a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:45:54.977539 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfa1062-392f-40cc-9ae9-073df265117a service neutron] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:45:54.977816 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfa1062-392f-40cc-9ae9-073df265117a service neutron] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:45:54.978085 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfa1062-392f-40cc-9ae9-073df265117a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:45:54.979847 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-5dfa1062-392f-40cc-9ae9-073df265117a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:45:54.993216 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfa1062-392f-40cc-9ae9-073df265117a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:45:54.994984 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfa1062-392f-40cc-9ae9-073df265117a service neutron] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:45:55.006588 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1461/2903] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:45:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:46:01.271745 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62a4d2f-0894-4834-ba7d-9e9ef2684a7d service neutron] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:46:01.273235 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-b62a4d2f-0894-4834-ba7d-9e9ef2684a7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:46:01.294702 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62a4d2f-0894-4834-ba7d-9e9ef2684a7d service neutron] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:46:01.301722 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1986fcb-78f0-471e-a134-3c4b05128b90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb59440b21074d9da15679dc2d745f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:46:01.302748 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1986fcb-78f0-471e-a134-3c4b05128b90 service nova] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:46:01.303194 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1986fcb-78f0-471e-a134-3c4b05128b90 service nova] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:46:01.303712 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1986fcb-78f0-471e-a134-3c4b05128b90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:46:01.305801 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-b1986fcb-78f0-471e-a134-3c4b05128b90 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:46:01.320629 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1986fcb-78f0-471e-a134-3c4b05128b90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:46:01.322240 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1986fcb-78f0-471e-a134-3c4b05128b90 service nova] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:46:01.335523 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1443/2904] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:46:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:46:16.763123 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfa1062-392f-40cc-9ae9-073df265117a service neutron] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:46:16.771515 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfa1062-392f-40cc-9ae9-073df265117a service neutron] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:46:16.775849 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fbadfd-3b5f-4fb6-be4f-2ae6f87a405d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:46:16.776482 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fbadfd-3b5f-4fb6-be4f-2ae6f87a405d service neutron] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:46:16.776761 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fbadfd-3b5f-4fb6-be4f-2ae6f87a405d service neutron] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:46:16.777023 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fbadfd-3b5f-4fb6-be4f-2ae6f87a405d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:46:16.778745 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-f1fbadfd-3b5f-4fb6-be4f-2ae6f87a405d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:46:16.789294 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fbadfd-3b5f-4fb6-be4f-2ae6f87a405d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:46:16.790693 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fbadfd-3b5f-4fb6-be4f-2ae6f87a405d service neutron] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:46:16.799366 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1462/2905] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:46:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:47:44.356319 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1986fcb-78f0-471e-a134-3c4b05128b90 service nova] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:47:44.413461 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1986fcb-78f0-471e-a134-3c4b05128b90 service nova] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:47:44.421122 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7018947c-3504-4f32-a878-507e7797cd6a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '285198b50b50431f96f9225d106417a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:47:44.422203 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7018947c-3504-4f32-a878-507e7797cd6a service placement] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:47:44.423164 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7018947c-3504-4f32-a878-507e7797cd6a service placement] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:47:44.423684 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7018947c-3504-4f32-a878-507e7797cd6a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:47:44.433436 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7018947c-3504-4f32-a878-507e7797cd6a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:47:44.435060 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7018947c-3504-4f32-a878-507e7797cd6a service placement] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:47:44.445418 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1444/2906] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:47:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:48:07.492098 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fbadfd-3b5f-4fb6-be4f-2ae6f87a405d service neutron] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:48:07.516728 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fbadfd-3b5f-4fb6-be4f-2ae6f87a405d service neutron] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:48:07.522844 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86c27a4-b093-47e1-b9fa-71f56fa25010 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb59440b21074d9da15679dc2d745f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:48:07.523528 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86c27a4-b093-47e1-b9fa-71f56fa25010 service nova] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:48:07.523809 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86c27a4-b093-47e1-b9fa-71f56fa25010 service nova] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:48:07.524081 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86c27a4-b093-47e1-b9fa-71f56fa25010 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:48:07.525902 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-d86c27a4-b093-47e1-b9fa-71f56fa25010 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:48:07.549102 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86c27a4-b093-47e1-b9fa-71f56fa25010 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:48:07.550710 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86c27a4-b093-47e1-b9fa-71f56fa25010 service nova] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:48:07.562623 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1463/2907] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:48:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:48:19.977641 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7018947c-3504-4f32-a878-507e7797cd6a service placement] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:48:19.996626 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7018947c-3504-4f32-a878-507e7797cd6a service placement] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:48:20.000298 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fcd0e9-64c1-4690-bf93-302e337e64c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a13ad25f27471792ba0758602b6e63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:48:20.000921 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fcd0e9-64c1-4690-bf93-302e337e64c4 service neutron] REQUEST_METHOD: `GET` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:48:20.001228 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fcd0e9-64c1-4690-bf93-302e337e64c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:48:20.001501 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fcd0e9-64c1-4690-bf93-302e337e64c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:48:20.003219 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-46fcd0e9-64c1-4690-bf93-302e337e64c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:48:20.062928 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fcd0e9-64c1-4690-bf93-302e337e64c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:48:20.064386 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fcd0e9-64c1-4690-bf93-302e337e64c4 service neutron] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:48:20.073674 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1445/2908] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:48:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 20:48:26.503536 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86c27a4-b093-47e1-b9fa-71f56fa25010 service nova] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:48:26.505611 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-d86c27a4-b093-47e1-b9fa-71f56fa25010 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:48:26.521220 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86c27a4-b093-47e1-b9fa-71f56fa25010 service nova] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:48:26.526099 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821ce162-d13a-4d33-91cb-f778ff279b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:48:26.527196 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ce162-d13a-4d33-91cb-f778ff279b3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:48:26.527413 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ce162-d13a-4d33-91cb-f778ff279b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:48:26.528098 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ce162-d13a-4d33-91cb-f778ff279b3c admin admin] PATH_INFO: `/v3/users/95791a44989743338f7177fd8a2e434e` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:48:26.529518 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821ce162-d13a-4d33-91cb-f778ff279b3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=95791a44989743338f7177fd8a2e434e)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:48:26.531886 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821ce162-d13a-4d33-91cb-f778ff279b3c admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:48:26.585166 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-821ce162-d13a-4d33-91cb-f778ff279b3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95791a44989743338f7177fd8a2e434e'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:48:26.585939 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-821ce162-d13a-4d33-91cb-f778ff279b3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95791a44989743338f7177fd8a2e434e'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:48:26.593228 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-821ce162-d13a-4d33-91cb-f778ff279b3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95791a44989743338f7177fd8a2e434e'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:48:26.593909 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-821ce162-d13a-4d33-91cb-f778ff279b3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95791a44989743338f7177fd8a2e434e'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:48:26.601860 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-821ce162-d13a-4d33-91cb-f778ff279b3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95791a44989743338f7177fd8a2e434e'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:48:26.618767 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1464/2909] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:48:26 2022] DELETE /identity/v3/users/95791a44989743338f7177fd8a2e434e => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:48:26.793222 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fcd0e9-64c1-4690-bf93-302e337e64c4 service neutron] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:48:26.803981 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fcd0e9-64c1-4690-bf93-302e337e64c4 service neutron] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:48:26.858536 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7e0625-6f52-4938-aad9-a0881c78b614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:48:26.859370 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7e0625-6f52-4938-aad9-a0881c78b614 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:48:26.859674 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7e0625-6f52-4938-aad9-a0881c78b614 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:48:26.859934 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7e0625-6f52-4938-aad9-a0881c78b614 admin admin] PATH_INFO: `/v3/projects/ceeb72f15a944fcbbd9095bb3d553126` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:48:26.861086 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7e0625-6f52-4938-aad9-a0881c78b614 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ceeb72f15a944fcbbd9095bb3d553126)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:48:26.862976 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7e0625-6f52-4938-aad9-a0881c78b614 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:48:26.906917 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-2a7e0625-6f52-4938-aad9-a0881c78b614 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ceeb72f15a944fcbbd9095bb3d553126', 'request_id': 'req-2a7e0625-6f52-4938-aad9-a0881c78b614'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:48:26.912770 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-2a7e0625-6f52-4938-aad9-a0881c78b614 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ceeb72f15a944fcbbd9095bb3d553126', 'request_id': 'req-2a7e0625-6f52-4938-aad9-a0881c78b614'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:48:26.917947 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-2a7e0625-6f52-4938-aad9-a0881c78b614 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ceeb72f15a944fcbbd9095bb3d553126', 'request_id': 'req-2a7e0625-6f52-4938-aad9-a0881c78b614'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:48:26.930548 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-2a7e0625-6f52-4938-aad9-a0881c78b614 admin admin] The token cache is being invalidate because project ceeb72f15a944fcbbd9095bb3d553126 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:48:26.930828 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-2a7e0625-6f52-4938-aad9-a0881c78b614 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:48:26.931473 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-2a7e0625-6f52-4938-aad9-a0881c78b614 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:48:26.933014 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1446/2910] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:48:26 2022] DELETE /identity/v3/projects/ceeb72f15a944fcbbd9095bb3d553126 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:48:26.937037 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821ce162-d13a-4d33-91cb-f778ff279b3c admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:48:26.938495 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-821ce162-d13a-4d33-91cb-f778ff279b3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:48:26.951857 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821ce162-d13a-4d33-91cb-f778ff279b3c admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:48:27.004982 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6e8975-4377-439c-95a7-73711888f916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:48:27.006003 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e8975-4377-439c-95a7-73711888f916 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:48:27.006285 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e8975-4377-439c-95a7-73711888f916 admin admin] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:48:27.006559 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e8975-4377-439c-95a7-73711888f916 admin admin] PATH_INFO: `/v3/users/2dda6b027923466ba1d4b9407c3c5eae` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:48:27.007764 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6e8975-4377-439c-95a7-73711888f916 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2dda6b027923466ba1d4b9407c3c5eae)` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:48:27.009913 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6e8975-4377-439c-95a7-73711888f916 admin admin] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:48:27.053327 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-ac6e8975-4377-439c-95a7-73711888f916 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2dda6b027923466ba1d4b9407c3c5eae'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:48:27.053902 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-ac6e8975-4377-439c-95a7-73711888f916 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2dda6b027923466ba1d4b9407c3c5eae'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:48:27.060430 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-ac6e8975-4377-439c-95a7-73711888f916 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2dda6b027923466ba1d4b9407c3c5eae'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:48:27.061052 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-ac6e8975-4377-439c-95a7-73711888f916 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2dda6b027923466ba1d4b9407c3c5eae'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:48:27.068358 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.notifications [None req-ac6e8975-4377-439c-95a7-73711888f916 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2dda6b027923466ba1d4b9407c3c5eae'} {{(pid=79828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:48:27.084886 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1465/2911] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 9 20:48:26 2022] DELETE /identity/v3/users/2dda6b027923466ba1d4b9407c3c5eae => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:48:27.252252 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7e0625-6f52-4938-aad9-a0881c78b614 admin admin] Authenticating user token {{(pid=79829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:48:27.253664 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.fernet_utils [None req-2a7e0625-6f52-4938-aad9-a0881c78b614 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:48:27.266875 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7e0625-6f52-4938-aad9-a0881c78b614 admin admin] Validating token access rules against request {{(pid=79829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:48:27.322339 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43e51d8-affc-4953-8568-9480cd0d5bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eda0196f36b948c2b847c376ca98040d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc21a92582474562a4faafd37e72b6be', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:48:27.323104 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e51d8-affc-4953-8568-9480cd0d5bc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:48:27.323382 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e51d8-affc-4953-8568-9480cd0d5bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:48:27.323680 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e51d8-affc-4953-8568-9480cd0d5bc5 admin admin] PATH_INFO: `/v3/projects/891d8f40ef014aefb0585d6ebaeb6f40` {{(pid=79829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:48:27.324834 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43e51d8-affc-4953-8568-9480cd0d5bc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=891d8f40ef014aefb0585d6ebaeb6f40)` {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:48:27.326741 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43e51d8-affc-4953-8568-9480cd0d5bc5 admin admin] RBAC: Authorization granted {{(pid=79829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:48:27.370692 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-e43e51d8-affc-4953-8568-9480cd0d5bc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '891d8f40ef014aefb0585d6ebaeb6f40', 'request_id': 'req-e43e51d8-affc-4953-8568-9480cd0d5bc5'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:48:27.376873 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-e43e51d8-affc-4953-8568-9480cd0d5bc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '891d8f40ef014aefb0585d6ebaeb6f40', 'request_id': 'req-e43e51d8-affc-4953-8568-9480cd0d5bc5'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:48:27.381975 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-e43e51d8-affc-4953-8568-9480cd0d5bc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '891d8f40ef014aefb0585d6ebaeb6f40', 'request_id': 'req-e43e51d8-affc-4953-8568-9480cd0d5bc5'} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:48:27.393832 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-e43e51d8-affc-4953-8568-9480cd0d5bc5 admin admin] The token cache is being invalidate because project 891d8f40ef014aefb0585d6ebaeb6f40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 09 20:48:27.394143 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-e43e51d8-affc-4953-8568-9480cd0d5bc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:48:27.394973 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: DEBUG keystone.notifications [None req-e43e51d8-affc-4953-8568-9480cd0d5bc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 09 20:48:27.396455 dv-cinder-836996-15-iscsi devstack@keystone.service[79829]: [pid: 79829|app: 0|req: 1447/2912] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 9 20:48:27 2022] DELETE /identity/v3/projects/891d8f40ef014aefb0585d6ebaeb6f40 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 20:52:48.343681 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6e8975-4377-439c-95a7-73711888f916 admin admin] Authenticating user token {{(pid=79828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 20:52:48.345069 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-ac6e8975-4377-439c-95a7-73711888f916 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:52:48.422520 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6e8975-4377-439c-95a7-73711888f916 admin admin] Validating token access rules against request {{(pid=79828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 20:52:48.483587 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf2de10-5c16-474f-a527-fe8256e4c729 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '285198b50b50431f96f9225d106417a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '563db7f5a25f480e8e6568b92ec3f195', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 20:52:48.484235 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf2de10-5c16-474f-a527-fe8256e4c729 service placement] REQUEST_METHOD: `GET` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 20:52:48.484528 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf2de10-5c16-474f-a527-fe8256e4c729 service placement] SCRIPT_NAME: `/identity` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 20:52:48.484791 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf2de10-5c16-474f-a527-fe8256e4c729 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 20:52:48.486585 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.fernet_utils [None req-ebf2de10-5c16-474f-a527-fe8256e4c729 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 20:52:48.497462 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf2de10-5c16-474f-a527-fe8256e4c729 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 20:52:48.499027 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf2de10-5c16-474f-a527-fe8256e4c729 service placement] RBAC: Authorization granted {{(pid=79828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 20:52:48.509458 dv-cinder-836996-15-iscsi devstack@keystone.service[79828]: [pid: 79828|app: 0|req: 1466/2913] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 9 20:52:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)